00010000:00010000:0.0:1746065130.268530:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146b885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931282 expref: 13 pid: 12258 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.268545:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146b885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931282 expref: 13 pid: 12258 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.268567:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146b885 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931282 expref: 13 pid: 12258 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.268586:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.268622:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881262904192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 132us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.268627:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5097 00000100:00100000:0.0:1746065130.268666:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5098 00000100:00100000:0.0:1746065130.268672:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881262904064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.268678:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.268684:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130104a00/0xad6b7ddc146b7c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4816895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9311e8 expref: 28 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268692:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130104a00/0xad6b7ddc146b7c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4816895) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9311e8 expref: 28 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268701:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130104a00/0xad6b7ddc146b7c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4816895) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9311e8 expref: 28 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268709:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.268722:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881262904064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.268729:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5098 00000100:00100000:0.0:1746065130.268737:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5099 00000100:00100000:0.0:1746065130.268741:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881262904320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.268745:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.268751:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc146b823 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93124a expref: 38 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268757:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc146b823 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93124a expref: 38 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268767:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc146b823 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93124a expref: 38 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268790:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.268804:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881262904320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.268809:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5099 00000100:00100000:0.0:1746065130.268907:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.268919:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262904448 00000100:00100000:0.0:1746065130.268923:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262904448 00010000:00010000:0.0:1746065130.268934:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc146b82a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931251 expref: 27 pid: 3068 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.268946:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5100 00000100:00100000:0.0:1746065130.268949:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881262904448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.268958:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.268964:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc146b82a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931251 expref: 27 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268972:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc146b82a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931251 expref: 27 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268981:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc146b82a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931251 expref: 27 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.268990:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.268992:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.268999:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc146b949 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931307 expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.269006:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc146b949 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931307 expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.269032:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc146b949 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931307 expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065130.269042:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263093120:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065130.269090:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.269254:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881262903808:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 19059us (19753us total) trans 0 rc 421888/421888 00000100:00100000:0.0:1746065130.269260:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2983 00002000:00100000:0.0:1746065130.269268:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1470463) req@ffff880099e10e00 x1830881262903808/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:46/0 lens 488/440 e 0 to 0 dl 1746065141 ref 1 fl Complete:/200/0 rc 421888/421888 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065130.269276:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10e00 with x1830881262903808 ext(1048576->1470463) 00002000:00010000:0.0:1746065130.269279:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e10e00 00000100:00100000:0.0:1746065130.283130:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.283173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.283198:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262904576 00000100:00100000:0.0:1746065130.283205:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262904576 00000100:00100000:0.0:1746065130.283241:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11627 00000100:00100000:0.0:1746065130.283247:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:31431:x1830881262904576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065130.283259:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.283273:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146b950 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93130e expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.283294:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146b942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1867775) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931300 expref: 34 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.283300:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.283302:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.283304:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146b950 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93130e expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.283328:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146b942 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1867775) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931300 expref: 34 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.283338:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146b942 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1867775) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931300 expref: 34 pid: 3067 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.283353:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263093248:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065130.285522:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.297219:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263093248:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065130.297241:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146b950 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93130e expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.297270:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835da00, rc 0) 00000100:00100000:0.0:1746065130.297296:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:31431:x1830881262904576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14050us (14166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.297303:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11627 00000100:00100000:0.0:1746065130.312977:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.313015:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.313038:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.313059:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262905472 00000100:00100000:0.0:1746065130.313067:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262905472 00000100:00100000:0.0:1746065130.313098:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262905344 00000100:00100000:0.0:1746065130.313100:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262905344 00000100:00100000:0.0:1746065130.313122:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262905600 00000100:00100000:0.0:1746065130.313124:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262905600 00000100:00100000:0.0:1746065130.313155:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11628 00000100:00100000:0.0:1746065130.313162:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881262905472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065130.313176:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.313190:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146b957 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93131c expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065130.313238:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263093376:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065130.314254:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.325380:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.330005:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.332474:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263093760:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065130.332488:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.332520:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881262905728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4596us (7141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.332528:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5101 00000100:00100000:0.0:1746065130.337963:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.353253:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.358074:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.363083:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.381215:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.381260:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.396526:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.397249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.404378:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.407425:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.412092:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.413338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.417225:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.417295:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.419714:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.437483:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262909312 00000100:00100000:0.0:1746065130.437490:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262909312 00000100:00100000:0.0:1746065130.437533:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11638 00000100:00100000:0.0:1746065130.437540:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:31431:x1830881262909312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065130.437553:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.437566:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c600/0xad6b7ddc146b99d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93135b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.437583:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.437588:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c600/0xad6b7ddc146b99d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93135b expref: 22 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.437597:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835c600/0xad6b7ddc146b99d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93135b expref: 22 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.437605:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c600, rc 0) 00000100:00100000:0.0:1746065130.437648:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+22:31431:x1830881262909312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 109us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.437654:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11638 00000100:00100000:0.0:1746065130.444897:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.453246:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.468673:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.488370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.498541:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.498581:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.524598:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.534872:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.536140:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881262911104:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11291us (11547us total) trans 21474840612 rc 0/0 00000100:00100000:0.0:1746065130.536152:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1092 00002000:00100000:0.0:1746065130.536162:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4583423) req@ffff88009834ed80 x1830881262911104/t21474840612(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:46/0 lens 488/448 e 0 to 0 dl 1746065141 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065130.536169:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ed80 with x1830881262911104 ext(4194304->4583423) 00010000:00010000:0.0:1746065130.536177:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc146b949 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931307 expref: 30 pid: 3067 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.536189:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc146b949 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931307 expref: 30 pid: 3067 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746065130.536195:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009834ed80 00000100:00100000:0.0:1746065130.538471:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.542433:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.550365:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262911872 00000100:00100000:0.0:1746065130.550371:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262911872 00002000:00100000:0.0:1746065130.550401:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff8800972b3100 x1830881262911872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065130.550410:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972b3100 with x1830881262911872 ext(4194304->4816895) 00002000:00010000:0.0:1746065130.550414:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972b3100 00000100:00100000:0.0:1746065130.550428:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2995 00000100:00100000:0.0:1746065130.550435:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881262911872:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065130.557972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.564873:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.569751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.574580:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262912768 00000100:00100000:0.0:1746065130.574584:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262912768 00000100:00100000:0.0:1746065130.574607:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11646 00000100:00100000:0.0:1746065130.574611:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881262912768:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065130.574618:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.574630:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146b9d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931393 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.574650:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146b9d5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931393 expref: 41 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.574659:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146b9d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931393 expref: 41 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.574681:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:0.0:1746065130.574702:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881262912768:12345-192.168.202.27@tcp:101:cat.0 Request processed in 91us (697us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065130.574706:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11646 00000100:00100000:0.0:1746065130.600962:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.623399:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.631263:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.631334:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.634611:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.634648:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.634674:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.634699:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.634730:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.634765:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262914432 00000100:00100000:0.0:1746065130.634797:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262914432 00000100:00100000:0.0:1746065130.634829:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262914688 00000100:00100000:0.0:1746065130.634832:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262914688 00000100:00100000:0.0:1746065130.634846:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262914304 00000100:00100000:0.0:1746065130.634847:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262914304 00000100:00100000:0.0:1746065130.634855:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262914816 00000100:00100000:0.0:1746065130.634857:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262914816 00000100:00100000:0.0:1746065130.634869:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11649 00000100:00100000:0.0:1746065130.634875:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881262914432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065130.634891:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.634904:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc146ba0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9313b6 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.634921:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.634922:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.634930:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc146ba0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313b6 expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.634942:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc146ba0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313b6 expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.634949:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ca00, rc 0) 00000100:00100000:0.0:1746065130.636008:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881262914432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1131us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.636013:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11649 00000100:00100000:0.0:1746065130.647044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.650436:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.658217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.662727:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.665721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.670518:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.678818:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263098368:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065130.690016:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.690058:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.690088:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.690100:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.690135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.690157:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262916736 00000100:00100000:0.0:1746065130.690163:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262916736 00010000:00010000:0.0:1746065130.690192:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc146b9a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931362 expref: 40 pid: 12260 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.690213:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262916992 00000100:00100000:0.0:1746065130.690216:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262916992 00010000:00010000:0.0:1746065130.690226:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31600/0xad6b7ddc146b934 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312f2 expref: 51 pid: 3067 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.690234:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917248 00000100:00100000:0.0:1746065130.690236:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917248 00010000:00010000:0.0:1746065130.690244:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc146ba0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313b6 expref: 15 pid: 3067 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.690251:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917504 00000100:00100000:0.0:1746065130.690252:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917504 00010000:00010000:0.0:1746065130.690259:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146b98f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93134d expref: 52 pid: 9550 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.690276:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917760 00000100:00100000:0.0:1746065130.690279:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917760 00010000:00010000:0.0:1746065130.690286:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146b9c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4583424->18446744073709551615] (req 4583424->4816895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931385 expref: 30 pid: 12260 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.690297:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5114 00000100:00100000:0.0:1746065130.690303:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881262916736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.690313:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.690328:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc146b9a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931362 expref: 40 pid: 12260 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690337:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc146b9a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931362 expref: 40 pid: 12260 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690355:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96a00/0xad6b7ddc146b9a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931362 expref: 40 pid: 12260 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690369:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.690399:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881262916736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.690405:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5114 00000100:00100000:0.0:1746065130.690416:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5115 00000100:00100000:0.0:1746065130.690420:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881262916992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.690426:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.690435:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31600/0xad6b7ddc146b934 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312f2 expref: 52 pid: 3067 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690441:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31600/0xad6b7ddc146b934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312f2 expref: 52 pid: 3067 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690451:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31600/0xad6b7ddc146b934 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312f2 expref: 52 pid: 3067 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690458:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.690467:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881262916992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.690472:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5115 00000100:00100000:0.0:1746065130.690478:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5116 00000100:00100000:0.0:1746065130.690481:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881262917248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.690486:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.690490:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc146ba0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313b6 expref: 15 pid: 3067 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690497:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc146ba0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313b6 expref: 15 pid: 3067 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690505:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc146ba0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313b6 expref: 15 pid: 3067 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690510:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.690518:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881262917248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.690523:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5116 00000100:00100000:0.0:1746065130.690528:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5117 00000100:00100000:0.0:1746065130.690531:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881262917504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.690535:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.690541:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146b98f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93134d expref: 50 pid: 9550 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690547:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146b98f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93134d expref: 50 pid: 9550 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690555:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146b98f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93134d expref: 50 pid: 9550 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690560:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.690568:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881262917504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.690572:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5117 00000100:00100000:0.0:1746065130.690577:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5118 00000100:00100000:0.0:1746065130.690580:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+30:2004:x1830881262917760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.690584:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.690589:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146b9c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4583424->18446744073709551615] (req 4583424->4816895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931385 expref: 30 pid: 12260 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690596:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146b9c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4583424->18446744073709551615] (req 4583424->4816895) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931385 expref: 30 pid: 12260 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690609:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146b9c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4583424->18446744073709551615] (req 4583424->4816895) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931385 expref: 30 pid: 12260 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690616:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.690623:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881262917760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.690627:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5118 00000100:00100000:0.0:1746065130.690666:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.690677:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262916864 00000100:00100000:0.0:1746065130.690679:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262916864 00010000:00010000:0.0:1746065130.690687:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146b950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93130e expref: 29 pid: 9548 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.690697:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5119 00000100:00100000:0.0:1746065130.690700:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881262916864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.690705:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.690711:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146b950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93130e expref: 29 pid: 9548 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690717:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146b950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93130e expref: 29 pid: 9548 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690725:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146b950 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93130e expref: 29 pid: 9548 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.690735:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.690744:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881262916864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.690748:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5119 00000100:00100000:0.0:1746065130.690815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.690826:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917120 00000100:00100000:0.0:1746065130.690828:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917120 00010000:00010000:0.0:1746065130.690838:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131046800/0xad6b7ddc146ba1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313cb expref: 14 pid: 12258 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.690852:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5120 00000100:00100000:0.0:1746065130.690856:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881262917120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.690861:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.690867:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131046800/0xad6b7ddc146ba1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313cb expref: 14 pid: 12258 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690874:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131046800/0xad6b7ddc146ba1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313cb expref: 14 pid: 12258 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690883:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046800/0xad6b7ddc146ba1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313cb expref: 14 pid: 12258 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690891:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.690904:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881262917120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.690911:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5120 00000100:00100000:0.0:1746065130.690941:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.690952:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917376 00000100:00100000:0.0:1746065130.690954:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917376 00010000:00010000:0.0:1746065130.690964:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc146ba22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313bd expref: 17 pid: 3068 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.690976:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5121 00000100:00100000:0.0:1746065130.690980:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881262917376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.690985:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.690992:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc146ba22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313bd expref: 17 pid: 3068 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.690999:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc146ba22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313bd expref: 17 pid: 3068 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.691008:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc146ba22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313bd expref: 17 pid: 3068 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.691016:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.691018:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.691021:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691028:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691050:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.691063:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881262917376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.691067:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5121 00000100:00100000:0.0:1746065130.691098:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.691106:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917632 00000100:00100000:0.0:1746065130.691121:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917632 00010000:00010000:0.0:1746065130.691131:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136166400/0xad6b7ddc146ba14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313af expref: 16 pid: 12260 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.691143:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5122 00000100:00100000:0.0:1746065130.691148:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881262917632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.691153:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.691161:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136166400/0xad6b7ddc146ba14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313af expref: 16 pid: 12260 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.691168:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136166400/0xad6b7ddc146ba14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313af expref: 16 pid: 12260 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.691177:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136166400/0xad6b7ddc146ba14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313af expref: 16 pid: 12260 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.691185:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.691198:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881262917632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.691202:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5122 00000100:00100000:0.0:1746065130.691285:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.691295:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262918144 00000100:00100000:0.0:1746065130.691297:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262918144 00010000:00010000:0.0:1746065130.691306:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146b903 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312cf expref: 28 pid: 12258 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.691317:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5123 00000100:00100000:0.0:1746065130.691320:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881262918144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.691325:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.691331:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146b903 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312cf expref: 28 pid: 12258 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.691337:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146b903 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312cf expref: 28 pid: 12258 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.691345:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146b903 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312cf expref: 28 pid: 12258 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.691352:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.691364:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881262918144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.691368:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5123 00000100:00100000:0.0:1746065130.691430:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.691441:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262918400 00000100:00100000:0.0:1746065130.691444:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262918400 00010000:00010000:0.0:1746065130.691453:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146b544 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93103d expref: 22 pid: 1880 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.691468:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5124 00000100:00100000:0.0:1746065130.691472:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881262918400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.691477:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.691485:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146b544 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93103d expref: 22 pid: 1880 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.691492:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146b544 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93103d expref: 22 pid: 1880 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.691500:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.691513:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881262918400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.691517:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5124 00000100:00100000:0.0:1746065130.691612:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263098880:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065130.691620:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263099008:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065130.691627:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263099136:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065130.691647:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091a97600/0xad6b7ddc146ba8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691696:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146b544 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93103d expref: 21 pid: 1880 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.691703:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263098752:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065130.691717:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691732:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691737:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691750:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691757:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691762:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691767:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065130.691770:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691794:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691802:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.691810:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ba6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065130.691845:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881262916352:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 22983us (23431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.691851:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11656 00000100:00100000:0.0:1746065130.693673:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.693733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.698495:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.699895:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.699921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.699935:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.699944:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.699953:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.699967:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917888 00000100:00100000:0.0:1746065130.699970:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917888 00010000:00010000:0.0:1746065130.699984:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146b5d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931098 expref: 49 pid: 9549 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.699999:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262918272 00000100:00100000:0.0:1746065130.700000:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262918272 00010000:00010000:0.0:1746065130.700010:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146b9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4816895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931377 expref: 39 pid: 12260 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.700017:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262918016 00000100:00100000:0.0:1746065130.700019:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262918016 00010000:00010000:0.0:1746065130.700026:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146b671 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931108 expref: 11 pid: 9549 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746065130.700033:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262918656 00000100:00100000:0.0:1746065130.700035:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262918656 00010000:00010000:0.0:1746065130.700042:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc146b911 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312dd expref: 40 pid: 12258 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.700048:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262919040 00000100:00100000:0.0:1746065130.700050:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262919040 00010000:00010000:0.0:1746065130.700055:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146b7f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931219 expref: 27 pid: 3068 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.700063:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5127 00000100:00100000:0.0:1746065130.700067:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2006:x1830881262917888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.700074:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.700085:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146b5d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931098 expref: 49 pid: 9549 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.700092:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146b5d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931098 expref: 49 pid: 9549 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.700103:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146b5d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931098 expref: 49 pid: 9549 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.700123:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.700143:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881262917888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.700148:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5127 00000100:00100000:0.0:1746065130.700159:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5128 00000100:00100000:0.0:1746065130.700163:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881262918272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.700169:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.700177:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146b9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4816895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931377 expref: 40 pid: 12260 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700184:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146b9b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4816895) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931377 expref: 40 pid: 12260 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700195:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146b9b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4816895) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931377 expref: 40 pid: 12260 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700204:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.700214:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881262918272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.700218:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5128 00000100:00100000:0.0:1746065130.700226:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5129 00000100:00100000:0.0:1746065130.700230:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881262918016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.700236:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.700241:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146b671 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931108 expref: 11 pid: 9549 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.700247:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146b671 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931108 expref: 11 pid: 9549 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.700256:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146b671 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931108 expref: 11 pid: 9549 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746065130.700263:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.700265:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.700267:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700273:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700286:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.700296:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881262918016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.700301:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5129 00000100:00100000:0.0:1746065130.700308:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5130 00000100:00100000:0.0:1746065130.700312:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881262918656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.700318:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.700325:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc146b911 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312dd expref: 38 pid: 12258 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700331:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc146b911 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312dd expref: 38 pid: 12258 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700340:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc146b911 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9312dd expref: 38 pid: 12258 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700346:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.700347:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.700350:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc146ba7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700355:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc146ba7d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700365:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.700376:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881262918656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.700380:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5130 00000100:00100000:0.0:1746065130.700388:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5131 00000100:00100000:0.0:1746065130.700392:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2006:x1830881262919040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.700396:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.700402:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146b7f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931219 expref: 27 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700409:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146b7f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931219 expref: 27 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700418:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146b7f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931219 expref: 27 pid: 3068 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.700424:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.700435:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881262919040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.700439:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5131 00010000:00010000:0.0:1746065130.700462:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700468:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700479:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700484:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700490:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700495:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683ba00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065130.700497:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700503:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700511:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.700516:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683ba00/0xad6b7ddc146ba84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065130.713579:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.717184:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.723763:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.723834:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.725811:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262920320 00000100:00100000:0.0:1746065130.725815:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262920320 00010000:00010000:0.0:1746065130.725831:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc146b639 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9310e5 expref: 28 pid: 9571 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.725848:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5134 00000100:00100000:0.0:1746065130.725852:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881262920320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.725859:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.725864:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc146b639 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9310e5 expref: 28 pid: 9571 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.725872:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc146b639 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9310e5 expref: 28 pid: 9571 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.725887:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc146b639 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9310e5 expref: 28 pid: 9571 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.726319:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065130.726322:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146ba92 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065130.726327:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.726343:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881262920320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 490us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.726348:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5134 00000100:00100000:0.0:1746065130.727526:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.727884:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.727996:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5139 00000100:00100000:0.0:1746065130.728001:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a850e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881262920832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065130.728007:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065130.728010:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146b3a7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd930f2c expref: 45 pid: 7231 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.728017:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146b3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd930f2c expref: 45 pid: 7231 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.728026:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146b3a7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd930f2c expref: 45 pid: 7231 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746065130.728198:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065130.728200:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.728225:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a850e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881262920832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 223us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.728230:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5139 00000100:00100000:0.0:1746065130.731265:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263100416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.731285:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.731309:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263100928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.731322:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.731333:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065130.731337:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263100288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.731349:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.731358:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263100800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.731371:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.731386:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100800 00000100:00100000:0.0:1746065130.731388:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100800 00000100:00100000:0.0:1746065130.731402:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11663 00000100:00100000:0.0:1746065130.731406:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881263100928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.731449:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3762:x1830881263100928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (126us total) trans 17179873190 rc 0/0 00000100:00100000:0.0:1746065130.731454:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11663 00000100:00100000:0.0:1746065130.732162:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11665 00000100:00100000:0.0:1746065130.732169:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3762:x1830881263100800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.732224:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3762:x1830881263100800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (852us total) trans 17179873192 rc 0/0 00000100:00100000:0.0:1746065130.732229:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11665 00000004:00080000:0.0:1746065130.732257:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9180/2, rc 0, transno 17179873191 00000100:00100000:0.0:1746065130.732261:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263100288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.732267:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9f80/2, rc 0, transno 17179873192 00000100:00100000:0.0:1746065130.732270:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263100800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.732275:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da680/2, rc 0, transno 17179873189 00000100:00100000:0.0:1746065130.732277:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263100416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.732282:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d8700/2, rc 0, transno 17179873190 00000100:00100000:0.0:1746065130.732284:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263100928:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.733878:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da300/2, rc 0, transno 17179873193 00000100:00100000:0.0:1746065130.733884:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263100544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.733892:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d8e00/2, rc 0, transno 17179873194 00000100:00100000:0.0:1746065130.733895:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263100160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.733902:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d8000/2, rc 0, transno 17179873195 00000100:00100000:0.0:1746065130.733905:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263100672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.733914:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263101184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.733938:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.733968:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263101696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.733982:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.733991:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065130.733995:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263101056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734005:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.734013:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263101568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734024:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.734037:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263101440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734051:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.734059:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263101952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734071:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065130.734090:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972b0380/2, rc 0, transno 21474840615 00000100:00100000:0.0:1746065130.734096:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263101184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734106:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11670 00000100:00100000:0.0:1746065130.734124:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3760:x1830881263101696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734162:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11672 00000100:00100000:0.0:1746065130.734166:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3760:x1830881263101568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065130.734206:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:0.0:1746065130.734208:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065130.734210:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.734212:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065130.734214:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:0.0:1746065130.734231:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3760:x1830881263101568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (206us total) trans 21474840618 rc 0/0 00000100:00100000:0.0:1746065130.734236:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11672 00000100:00100000:0.0:1746065130.734245:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11674 00000100:00100000:0.0:1746065130.734249:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3762:x1830881263101952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065130.734282:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:0.0:1746065130.734284:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065130.734286:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.734288:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065130.734289:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:0.0:1746065130.734318:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3762:x1830881263101952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (246us total) trans 21474840620 rc 0/0 00000100:00100000:0.0:1746065130.734322:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11674 00000100:00100000:0.0:1746065130.734330:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11675 00000100:00100000:0.0:1746065130.734334:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3761:x1830881263101312:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.734372:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972b1500/2, rc 0, transno 21474840619 00000100:00100000:0.0:1746065130.734375:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263101440:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.734380:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972b2680/2, rc 0, transno 21474840620 00000100:00100000:0.0:1746065130.734382:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263101952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.734393:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972b3480/2, rc 0, transno 21474840616 00000100:00100000:0.0:1746065130.734395:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263101056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.734401:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972b1880/2, rc 0, transno 21474840618 00000100:00100000:0.0:1746065130.734403:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263101568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734406:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065130.734410:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263102080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734425:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.734460:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3760:x1830881263101696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 337us (478us total) trans 21474840617 rc 0/0 00000100:00100000:0.0:1746065130.734465:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11670 00000004:00080000:0.0:1746065130.734481:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972b1f80/2, rc 0, transno 21474840617 00000100:00100000:0.0:1746065130.734485:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263101696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.734507:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3761:x1830881263101312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (246us total) trans 21474840622 rc 0/0 00000100:00100000:0.0:1746065130.734512:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11675 00000004:00080000:0.0:1746065130.734527:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972b2d80/2, rc 0, transno 21474840623 00000100:00100000:0.0:1746065130.734529:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263102080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.745761:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.749275:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.749432:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.749460:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.749684:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.749697:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.749718:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.749748:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262921216 00000100:00100000:0.0:1746065130.749750:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262921216 00000100:00100000:0.0:1746065130.749766:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11678 00000100:00100000:0.0:1746065130.749788:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881262921344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065130.749802:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.749820:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc146baae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931403 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065130.749839:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6e9, ctime: 0x6812d6ea, blocks: 0x808 00010000:00010000:0.0:1746065130.749853:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.749855:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.749862:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc146baae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931403 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.749875:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc146baae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931403 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.749884:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7600, rc 0) 00000100:00100000:0.0:1746065130.749920:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881262921344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 148us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.749926:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11678 00000100:00100000:0.0:1746065130.749941:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11679 00000100:00100000:0.0:1746065130.749946:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881262921600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065130.749952:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.749961:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ae7200/0xad6b7ddc146bab5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931411 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065130.749973:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6ea, atime: 0x6812d6e9, ctime: 0x6812d6ea, blocks: 0x808 00010000:00010000:0.0:1746065130.749980:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.749982:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.749986:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ae7200/0xad6b7ddc146bab5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931411 expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.749994:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ae7200/0xad6b7ddc146bab5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931411 expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.749999:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7200, rc 0) 00000100:00100000:0.0:1746065130.750013:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881262921600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 68us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.750017:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11679 00000100:00100000:0.0:1746065130.750027:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11680 00000100:00100000:0.0:1746065130.750031:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881262921856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065130.750036:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.750042:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146babc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93141f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065130.750050:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d6ea, atime: 0x6812d6ea, ctime: 0x6812d6ea, blocks: 0x1000 00010000:00010000:0.0:1746065130.750056:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.750057:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.750060:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146babc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93141f expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.750067:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146babc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93141f expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.750072:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6c00, rc 0) 00000100:00100000:0.0:1746065130.750085:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881262921856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 54us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.750090:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11680 00000100:00100000:0.0:1746065130.750099:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11681 00000100:00100000:0.0:1746065130.750103:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881262921472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065130.750119:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.750127:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146bac3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93140a expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065130.750136:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6e8, atime: 0x6812d6e8, ctime: 0x6812d6e8, blocks: 0x800 00010000:00010000:0.0:1746065130.750142:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.750143:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.750146:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146bac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93140a expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.750153:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146bac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93140a expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.750159:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c400, rc 0) 00000100:00100000:0.0:1746065130.750172:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881262921472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 69us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.750176:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11681 00000100:00100000:0.0:1746065130.750185:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11682 00000100:00100000:0.0:1746065130.750189:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881262921216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065130.750194:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.750199:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146baca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9313fc expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065130.750211:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6ea, atime: 0x6812d6e6, ctime: 0x6812d6ea, blocks: 0x7f0 00010000:00010000:0.0:1746065130.750218:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.750219:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.750223:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146baca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313fc expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.750231:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146baca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9313fc expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065130.750237:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61200, rc 0) 00000100:00100000:0.0:1746065130.750248:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881262921216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 59us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.750252:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11682 00000100:00100000:0.0:1746065130.756137:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.757538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.757593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.757607:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.757620:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.757639:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.761499:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.761535:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.761565:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.761755:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.761890:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.762448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.762461:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262923392 00000100:00100000:0.0:1746065130.762464:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262923392 00000100:00100000:0.0:1746065130.762481:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11695 00000100:00100000:0.0:1746065130.762485:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881262923392:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065130.762519:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881262923392:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 34us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.762524:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11695 00000100:00100000:0.0:1746065130.765354:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.776133:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.776442:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.776475:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.776489:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.776512:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.776526:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.776541:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.776569:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262925184 00000100:00100000:0.0:1746065130.776571:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262925184 00000100:00100000:0.0:1746065130.776589:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3000 00000100:00100000:0.0:1746065130.776593:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2007:x1830881262924160:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065130.776622:0:29489:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc146badf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.776635:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.776636:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065130.776640:0:29489:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc146badf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.776652:0:29489:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc146badf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [8192->1048575] (req 8192->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065130.777423:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.820902:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.822748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.824442:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.825878:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.829068:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.833490:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.838438:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.840702:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.842976:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263102976:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065130.842996:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146bb2c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93143b expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.843009:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a800, rc 0) 00000100:00100000:0.0:1746065130.843044:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:31447:x1830881262926848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2053us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.843051:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11701 00000100:00100000:0.0:1746065130.847801:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.850585:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.853297:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.856135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.858505:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.858843:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.859364:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.860553:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.861180:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.861427:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.865615:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.871716:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065130.875949:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc146bb10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065130.875960:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc146bb10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065130.875966:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc146bb10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065130.875972:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065130.875975:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc146bb10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065130.875981:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc146bb10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065130.875995:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065130.875997:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065130.876001:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc146bb10 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065130.876005:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc146bb10 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065130.876040:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263103872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.876314:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.876334:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263104384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.876350:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.876362:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263104896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.876803:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263104128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.877159:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11713 00000100:00100000:0.0:1746065130.877164:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3760:x1830881263104384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065130.877200:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065130.877202:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065130.877204:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.877205:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065130.877206:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:0.0:1746065130.877222:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3760:x1830881263104384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (872us total) trans 17179873202 rc 0/0 00000100:00100000:0.0:1746065130.877226:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11713 00000100:00100000:0.0:1746065130.877233:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11714 00000100:00100000:0.0:1746065130.877236:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3759:x1830881263105280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065130.877265:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:0.0:1746065130.877267:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065130.877268:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065130.877270:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065130.877271:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:0.0:1746065130.877285:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3759:x1830881263105280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (920us total) trans 21474840629 rc 0/0 00000100:00100000:0.0:1746065130.877290:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11714 00000100:00100000:0.0:1746065130.877308:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.877321:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263105408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.877336:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065130.877352:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856f800/2, rc 0, transno 17179873201 00000100:00100000:0.0:1746065130.877356:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263103872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.877366:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856f100/2, rc 0, transno 17179873202 00000100:00100000:0.0:1746065130.877368:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263104384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.877380:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11717 00000100:00100000:0.0:1746065130.877385:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3760:x1830881263105408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.877438:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3760:x1830881263105408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (100us total) trans 17179873203 rc 0/0 00000100:00100000:0.0:1746065130.877443:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11717 00000004:00080000:0.0:1746065130.877471:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f51f80/2, rc 0, transno 21474840631 00000100:00100000:0.0:1746065130.877474:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263104896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.877481:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856e300/2, rc 0, transno 17179873203 00000100:00100000:0.0:1746065130.877483:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263105408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.877492:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.877504:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263104640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.877517:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.877526:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263105152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.877539:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.877552:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263105664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.877564:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.877582:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11718 00000100:00100000:0.0:1746065130.877588:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3762:x1830881263104128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065130.877630:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065130.877632:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.877634:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.877636:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065130.877638:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746065130.877658:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3762:x1830881263104128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (165us total) trans 21474840632 rc 0/0 00000100:00100000:0.0:1746065130.877663:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11718 00000100:00100000:0.0:1746065130.877673:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11720 00000100:00100000:0.0:1746065130.877677:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263105152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.877729:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263105152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (189us total) trans 17179873204 rc 0/0 00000100:00100000:0.0:1746065130.877733:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11720 00000004:00080000:0.0:1746065130.877752:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f50000/2, rc 0, transno 21474840632 00000100:00100000:0.0:1746065130.877755:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263104128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.877761:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f51500/2, rc 0, transno 21474840633 00000100:00100000:0.0:1746065130.877763:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263104640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.877768:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856ed80/2, rc 0, transno 17179873204 00000100:00100000:0.0:1746065130.877771:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263105152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.877806:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6300/2, rc 0, transno 21474840634 00000100:00100000:0.0:1746065130.877809:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263105664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065130.878747:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856d500/2, rc 0, transno 21474840635 00000100:00100000:0.0:1746065130.878750:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263105920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.883752:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.890026:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.923618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.925607:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.933281:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.933314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.933369:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.935009:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262930048 00000100:00100000:0.0:1746065130.935013:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262930048 00000100:00100000:0.0:1746065130.935037:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11727 00000100:00100000:0.0:1746065130.935043:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+27:31461:x1830881262929664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065130.935051:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.935060:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146bba3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931465 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.935076:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146bb17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931426 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.935083:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.935084:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.935087:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146bba3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931465 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.935101:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146bb17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931426 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.935127:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146bb17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931426 expref: 18 pid: 9550 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746065130.935135:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263106176:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065130.935191:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065130.935286:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11728 00000100:00100000:0.0:1746065130.935292:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:31460:x1830881262930048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065130.935298:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.935304:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc146bbaa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931473 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.935313:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065130.935316:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc146bbaa lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931473 expref: 37 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.935324:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc146bbaa lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931473 expref: 37 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.935332:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3400, rc 0) 00000100:00100000:0.0:1746065130.935354:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+37:31460:x1830881262930048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 62us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.935359:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11728 00000100:00100000:0.0:1746065130.937441:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.940746:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.945084:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.945815:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.947131:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13325 00000100:00100000:0.0:1746065130.947138:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+10:31461:x1830881262930944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065130.947146:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.947152:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146bbd4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931488 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.947177:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146bbd4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931488 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.947186:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146bbd4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931488 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.947196:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065130.947198:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065130.947200:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31a00, rc 0) 00000100:00100000:0.0:1746065130.954561:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262931328 00000100:00100000:0.0:1746065130.954568:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262931328 00000100:00100000:0.0:1746065130.954604:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13326 00000100:00100000:0.0:1746065130.954610:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+11:31457:x1830881262931328:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065130.954628:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065130.954641:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146bbdb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93148f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.954897:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146bbdb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93148f expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.954908:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146bbdb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93148f expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065130.954921:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065130.954924:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065130.954927:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2e00, rc 0) 00000100:00100000:0.0:1746065130.954966:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+12:31457:x1830881262931328:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 355us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.954972:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13326 00000100:00100000:0.0:1746065130.961100:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.972682:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.974923:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.976162:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.982339:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.983135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.984281:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263107328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.984300:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.984312:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263107840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.984326:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.984337:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065130.984341:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263107200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.984354:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.984364:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263107712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.984376:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065130.984398:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107328 00000100:00100000:0.0:1746065130.984401:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107328 00000100:00100000:0.0:1746065130.984415:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107840 00000100:00100000:0.0:1746065130.984416:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107840 00000100:00100000:0.0:1746065130.984425:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107200 00000100:00100000:0.0:1746065130.984426:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107200 00000100:00100000:0.0:1746065130.984434:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107712 00000100:00100000:0.0:1746065130.984435:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107712 00000100:00100000:0.0:1746065130.984445:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11736 00000100:00100000:0.0:1746065130.984449:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3762:x1830881263107840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.984482:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11737 00000100:00100000:0.0:1746065130.984486:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3762:x1830881263107200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065130.984518:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065130.984520:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.984521:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065130.984523:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065130.984525:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065130.984539:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3762:x1830881263107200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (185us total) trans 17179873214 rc 0/0 00000100:00100000:0.0:1746065130.984543:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11737 00000100:00100000:0.0:1746065130.984575:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3762:x1830881263107840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (247us total) trans 17179873213 rc 0/0 00000100:00100000:0.0:1746065130.984579:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11736 00000004:00080000:0.0:1746065130.984602:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577ce00/2, rc 0, transno 17179873214 00000100:00100000:0.0:1746065130.984604:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263107200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.984610:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f100/2, rc 0, transno 17179873215 00000100:00100000:0.0:1746065130.984613:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263107712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.984618:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577e680/2, rc 0, transno 17179873212 00000100:00100000:0.0:1746065130.984620:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263107328:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065130.984625:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f480/2, rc 0, transno 17179873213 00000100:00100000:0.0:1746065130.984628:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263107840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065130.985539:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11747 00000100:00100000:0.0:1746065130.985544:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3761:x1830881263109248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065130.985601:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3761:x1830881263109248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (135us total) trans 21474840645 rc 0/0 00000100:00100000:0.0:1746065130.985609:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11747 00000100:00100000:0.0:1746065130.985941:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263107072:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065130.985951:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065130.985973:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881262932352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2980us (3635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065130.985980:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5152 00000100:00100000:0.0:1746065130.986234:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.987979:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.988875:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.989526:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.990428:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065130.993564:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262933888 00000100:00100000:0.0:1746065130.993568:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262933888 00002000:00100000:0.0:1746065130.993587:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (3522560->3526655) req@ffff880135138a80 x1830881262933888/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:46/0 lens 488/0 e 0 to 0 dl 1746065141 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065130.993594:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138a80 with x1830881262933888 ext(3522560->3526655) 00002000:00010000:0.0:1746065130.993597:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138a80 00000100:00100000:0.0:1746065130.993621:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3011 00000100:00100000:0.0:1746065130.993627:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881262933888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065130.993714:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881262933888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 87us (182us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065130.993720:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3011 00002000:00100000:0.0:1746065130.993725:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (3522560->3526655) req@ffff880135138a80 x1830881262933888/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746065141 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065130.993737:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138a80 with x1830881262933888 ext(3522560->3526655) 00002000:00010000:0.0:1746065130.993739:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138a80 00000100:00100000:0.0:1746065130.999011:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.007165:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.007201:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.008227:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.008275:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.011402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.013429:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263109888:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065131.013440:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.013456:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881262934272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5486us (6255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.013462:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5155 00000100:00100000:0.0:1746065131.014549:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.017442:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.017688:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.019121:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.019198:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3015 00000100:00100000:0.0:1746065131.019210:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881262935680:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065131.025380:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.029390:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262936064 00000100:00100000:0.0:1746065131.029398:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262936064 00010000:00010000:0.0:1746065131.029423:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc146bbf7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314a4 expref: 24 pid: 10219 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.029457:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5158 00000100:00100000:0.0:1746065131.029463:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881262936064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.029475:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.029491:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc146bbf7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314a4 expref: 24 pid: 10219 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.029501:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc146bbf7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314a4 expref: 24 pid: 10219 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.029522:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc146bbf7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314a4 expref: 24 pid: 10219 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.031538:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.031544:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.031558:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146bc28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314d5 expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.031568:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146bc28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314d5 expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.031612:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146bc28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314d5 expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.031626:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097cce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263110656:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065131.041648:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.044101:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.044401:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.045208:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.049638:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.050399:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.075530:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.083260:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262937728 00000100:00100000:0.0:1746065131.083263:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262937728 00010000:00010000:0.0:1746065131.083285:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146bb33 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931442 expref: 17 pid: 9550 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.083310:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5160 00000100:00100000:0.0:1746065131.083316:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881262937728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.083331:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.083350:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146bb33 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931442 expref: 17 pid: 9550 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.083362:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146bb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931442 expref: 17 pid: 9550 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.083387:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.083388:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.083394:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146bc3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314ea expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.083400:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146bc3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314ea expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.083433:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146bc3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314ea expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.083444:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ccd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263111296:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065131.084013:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.084127:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11757 00000100:00100000:0.0:1746065131.084133:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881262937600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.084140:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.084149:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146bc4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9314f8 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.084175:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097cce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263111424:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065131.084198:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00010000:00010000:0.0:1746065131.087739:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146bb33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931442 expref: 17 pid: 9550 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.087769:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263111168:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.087812:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146bc3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314ea expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.087823:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46800, rc 0) 00000100:00100000:0.0:1746065131.087878:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+29:31461:x1830881262937344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11691us (12360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.087889:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11755 00000100:00100000:0.0:1746065131.088002:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ccd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263111296:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065131.088013:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.088030:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881262937728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4715us (4813us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.088038:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5160 00000100:00100000:0.0:1746065131.103349:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.104606:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.120668:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.128315:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.136883:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.140044:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.140573:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5161 00000100:00100000:0.0:1746065131.140583:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881262939008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.140596:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.140614:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc146bc0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3522560->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314b9 expref: 24 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.140626:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc146bc0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3522560->3624959) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314b9 expref: 24 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.140646:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc146bc0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3522560->3624959) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314b9 expref: 24 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.140677:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.140679:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.140685:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de4200/0xad6b7ddc146bc52 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314ff expref: 50 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.140693:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4200/0xad6b7ddc146bc52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314ff expref: 50 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.140700:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.140701:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.140704:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc146bc59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931506 expref: 23 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.140710:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc146bc59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931506 expref: 23 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.140735:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc146bc59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931506 expref: 23 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.140745:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263111680:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065131.140856:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090de4200/0xad6b7ddc146bc52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314ff expref: 50 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.140864:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263111808:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065131.140880:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.147178:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.148647:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.148690:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.174955:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.175010:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.175025:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262940032 00000100:00100000:0.0:1746065131.175028:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262940032 00000100:00100000:0.0:1746065131.183869:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.183910:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.187228:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.194995:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.202736:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.202821:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.205719:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.219447:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.222856:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.243531:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.243713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.243803:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262942336 00000100:00100000:0.0:1746065131.243811:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262942336 00000100:00100000:0.0:1746065131.243857:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13331 00000100:00100000:0.0:1746065131.243864:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+9:31468:x1830881262942336:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065131.243883:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.243898:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc146bcad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93153e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.243961:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.243972:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.243981:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.243995:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244001:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244005:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244084:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927800/0xad6b7ddc146bcc2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244092:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927800/0xad6b7ddc146bcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244098:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927800/0xad6b7ddc146bcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065131.244123:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065131.244186:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244192:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244196:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244201:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244205:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065131.244208:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244217:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244227:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065131.244229:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065131.244232:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244237:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bcb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244250:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244255:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244259:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244263:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d927c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065131.244265:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244271:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244276:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091b5de00) 00010000:00010000:0.0:1746065131.244277:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065131.244279:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244283:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927c00/0xad6b7ddc146bcbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.244312:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc146bcad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93153e expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.244322:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927800/0xad6b7ddc146bcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93153e expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.244327:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065131.244329:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065131.244331:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927800, rc 0) 00000100:00100000:0.0:1746065131.244366:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+11:31468:x1830881262942336:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 503us (654us total) trans 8589935574 rc 0/0 00000100:00100000:0.0:1746065131.244372:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13331 00000100:00080000:0.0:1746065131.244495:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065131.263360:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.271466:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.283337:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.289256:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.289278:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262943232 00000100:00100000:0.0:1746065131.289281:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262943232 00002000:00100000:0.0:1746065131.289304:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1605632->1609727) req@ffff880097c9d180 x1830881262943232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.289312:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c9d180 with x1830881262943232 ext(1605632->1609727) 00002000:00010000:0.0:1746065131.289316:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c9d180 00000100:00100000:0.0:1746065131.289326:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3027 00000100:00100000:0.0:1746065131.289330:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881262943232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065131.289410:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881262943232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 79us (156us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.289416:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3027 00002000:00100000:0.0:1746065131.289420:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1605632->1609727) req@ffff880097c9d180 x1830881262943232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.289426:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c9d180 with x1830881262943232 ext(1605632->1609727) 00002000:00010000:0.0:1746065131.289428:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c9d180 00000100:00100000:0.0:1746065131.292527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.296656:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.303729:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.304264:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.308129:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065131.333316:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840646 is committed 00000001:00080000:0.0:1746065131.333330:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840645 is committed 00000001:00080000:0.0:1746065131.333354:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840627 is committed 00000001:00080000:0.0:1746065131.333370:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840614 is committed 00000100:00100000:0.0:1746065131.433718:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.435126:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262945280 00000100:00100000:0.0:1746065131.435129:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262945280 00000100:00100000:0.0:1746065131.435150:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13333 00000100:00100000:0.0:1746065131.435155:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+13:31473:x1830881262945280:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065131.435168:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.435175:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc146bcfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931553 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.435200:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435206:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435214:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435221:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435225:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435229:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435261:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926c00/0xad6b7ddc146bd0f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435268:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926c00/0xad6b7ddc146bd0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435273:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926c00/0xad6b7ddc146bd0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065131.435278:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065131.435331:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435336:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435340:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435344:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435348:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065131.435352:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435357:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435366:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065131.435368:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065131.435371:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.435376:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc146bd01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.436212:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.436218:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.436223:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.436227:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d927200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065131.436229:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.436234:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.436240:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b4a14500) 00010000:00010000:0.0:1746065131.436242:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065131.436244:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.436251:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927200/0xad6b7ddc146bd08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.436282:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc146bcfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931553 expref: 16 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.436291:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926c00/0xad6b7ddc146bd0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931553 expref: 15 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.436297:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065131.436298:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065131.436300:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926c00, rc 0) 00000100:00100000:0.0:1746065131.436340:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+15:31473:x1830881262945280:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1183us (1525us total) trans 8589935577 rc 0/0 00000100:00100000:0.0:1746065131.436346:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13333 00000100:00100000:0.0:1746065131.439328:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.439373:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.439416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.441067:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.459457:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.459503:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.462741:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.477590:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.482906:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.483609:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.483630:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.483654:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.484235:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11771 00000100:00100000:0.0:1746065131.484245:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881262947456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.484254:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.484263:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146bd5c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93157d expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.484292:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263113856:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065131.484313:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00002000:00010000:0.0:1746065131.485594:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime: 1746065130 -> 1746065131 00002000:00010000:0.0:1746065131.485598:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime: 1746065130 -> 1746065131 00000100:00100000:0.0:1746065131.485611:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263113856:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065131.485629:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146bd5c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93157d expref: 25 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.485639:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146bd5c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93157d expref: 25 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.486668:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7acc00, rc 0) 00000100:00100000:0.0:1746065131.486719:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881262947456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2474us (3061us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065131.486725:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11771 00000100:00100000:0.0:1746065131.490220:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.491322:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.496782:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.503742:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.531985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.540143:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.557348:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262948864 00000100:00100000:0.0:1746065131.557355:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262948864 00010000:00010000:0.0:1746065131.557383:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146bc28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314d5 expref: 55 pid: 9549 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.557426:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5168 00000100:00100000:0.0:1746065131.557436:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881262948864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.557450:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.557469:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146bc28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314d5 expref: 55 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.557480:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146bc28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314d5 expref: 55 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.557500:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146bc28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314d5 expref: 55 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.557528:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.557530:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.557539:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc146bd71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931592 expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.557549:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc146bd71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931592 expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.557572:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc146bd71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931592 expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.557588:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263114624:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065131.557654:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.559321:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263114624:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065131.559336:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.559372:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881262948864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1938us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.559379:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5168 00000100:00100000:0.0:1746065131.562530:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.572833:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.577199:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262949504 00000100:00100000:0.0:1746065131.577207:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262949504 00000100:00100000:0.0:1746065131.577255:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11775 00000100:00100000:0.0:1746065131.577263:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+9:31473:x1830881262949504:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065131.577279:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.577293:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9315a0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.577318:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc146bc2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314dc expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.577325:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146bc36 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314e3 expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.577331:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.577333:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.577336:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1769472->2097151] (req 1769472->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.577363:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146bc36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314e3 expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.577374:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146bc36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314e3 expref: 19 pid: 9549 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.577386:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263114752:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.577486:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc146bc2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314dc expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.577494:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc146bc2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314dc expref: 10 pid: 9549 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.577501:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263114880:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065131.577519:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.582980:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.583023:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.583075:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.583093:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262949888 00000100:00100000:0.0:1746065131.583109:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262949888 00000100:00100000:0.0:1746065131.583151:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262950016 00000100:00100000:0.0:1746065131.583154:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262950016 00010000:00010000:0.0:1746065131.583165:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146bc36 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314e3 expref: 20 pid: 9549 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.583187:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5169 00000100:00100000:0.0:1746065131.583194:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881262950016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.583204:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.583221:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146bc36 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314e3 expref: 20 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.583230:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146bc36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314e3 expref: 20 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.583249:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.583296:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881262950016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.583302:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5169 00000100:00100000:0.0:1746065131.583318:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 681 00000100:00100000:0.0:1746065131.583323:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881262949888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.583329:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.583342:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bd8d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931599 expref: 35 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.583358:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065131.583361:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.583374:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881262949888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.583379:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 681 00010000:00010000:0.0:1746065131.583435:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc146bc36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314e3 expref: 19 pid: 9549 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.583445:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263114752:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065131.583454:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263114880:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.583470:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1769472->2097151] (req 1769472->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.583479:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d800, rc 0) 00000100:00100000:0.0:1746065131.583494:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+10:31473:x1830881262949504:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6232us (6374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.583500:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11775 00000100:00100000:0.0:1746065131.583514:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262950144 00000100:00100000:0.0:1746065131.583516:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262950144 00010000:00010000:0.0:1746065131.583524:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc146bc2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314dc expref: 10 pid: 9549 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.583539:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5170 00000100:00100000:0.0:1746065131.583543:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881262950144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.583549:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.583554:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc146bc2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314dc expref: 10 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.583562:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc146bc2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314dc expref: 10 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.583575:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc146bc2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314dc expref: 10 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.583581:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.583583:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.583588:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.583595:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.583616:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.583626:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263115008:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065131.583668:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.583679:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11777 00000100:00100000:0.0:1746065131.583683:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881262950400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.583688:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.583697:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9cc00/0xad6b7ddc146bda9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9315ae expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.583707:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.583708:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.583712:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9cc00/0xad6b7ddc146bda9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315ae expref: 55 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.583724:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9cc00/0xad6b7ddc146bda9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315ae expref: 55 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.583731:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9cc00, rc 0) 00000100:00100000:0.0:1746065131.584963:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+55:2004:x1830881262950400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1278us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.585589:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11777 00000100:00100000:0.0:1746065131.588017:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.588044:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.589049:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.594944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.594972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.594992:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262951424 00000100:00100000:0.0:1746065131.594997:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262951424 00010000:00010000:0.0:1746065131.595022:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf000/0xad6b7ddc146bd63 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931584 expref: 21 pid: 3067 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.595043:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5172 00000100:00100000:0.0:1746065131.595049:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881262951424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.595059:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.595075:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf000/0xad6b7ddc146bd63 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931584 expref: 21 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.595085:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996bf000/0xad6b7ddc146bd63 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931584 expref: 21 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.595118:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf000/0xad6b7ddc146bd63 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931584 expref: 21 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.595145:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.595147:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.595153:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146bdbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315c3 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.595160:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146bdbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315c3 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.595187:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146bdbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315c3 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.595198:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263115648:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065131.595259:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.596338:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262951680 00000100:00100000:0.0:1746065131.596342:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262951680 00002000:00100000:0.0:1746065131.596365:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009077f480 x1830881262951680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.596373:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f480 with x1830881262951680 ext(1048576->2097151) 00002000:00010000:0.0:1746065131.596377:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077f480 00000100:00100000:0.0:1746065131.596397:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262951936 00000100:00100000:0.0:1746065131.596400:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262951936 00002000:00100000:0.0:1746065131.596411:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1769471) req@ffff88009077ed80 x1830881262951936/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.596422:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ed80 with x1830881262951936 ext(1048576->1769471) 00002000:00010000:0.0:1746065131.596425:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ed80 00000100:00100000:0.0:1746065131.596495:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3041 00000100:00100000:0.0:1746065131.596500:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881262951680:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065131.599383:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.600198:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262952320 00000100:00100000:0.0:1746065131.600201:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262952320 00002000:00100000:0.0:1746065131.600221:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2297856->2301951) req@ffff88009aec9180 x1830881262952320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.600229:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881262952320 ext(2297856->2301951) 00010000:00010000:0.0:1746065131.600233:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146bdbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315c3 expref: 21 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.600243:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146bdbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315c3 expref: 21 pid: 9549 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065131.600248:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aec9180 00000100:00100000:0.0:1746065131.600269:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1097 00000100:00100000:0.0:1746065131.600273:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881262952320:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065131.600542:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881262952320:12345-192.168.202.27@tcp:3:cat.0 Request processed in 267us (546us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065131.600547:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1097 00002000:00100000:0.0:1746065131.600552:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2297856->2301951) req@ffff88009aec9180 x1830881262952320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:47/0 lens 488/4536 e 0 to 0 dl 1746065142 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.600563:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881262952320 ext(2297856->2301951) 00010000:00010000:0.0:1746065131.600568:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146bdbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315c3 expref: 21 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.600578:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146bdbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315c3 expref: 21 pid: 9549 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065131.600583:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aec9180 00000100:00100000:0.0:1746065131.605373:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.612736:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.613353:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.620897:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.620940:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065131.621431:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065131.624786:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.626011:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.626074:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.630509:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065131.630838:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146bdef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630845:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146bdef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065131.630883:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00000004:00200000:0.0:1746065131.630886:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065131.630900:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146bdef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630912:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146bdef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630921:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bde1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630925:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bde1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630930:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bde1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630935:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bde1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630940:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065131.630943:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bde1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630948:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bde1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630956:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065131.630958:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065131.630961:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bde1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630965:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc146bde1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630986:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc146bde8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630991:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc146bde8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630995:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc146bde8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.630999:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065131.631001:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc146bde8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.631006:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc146bde8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.631012:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098c34400) 00010000:00010000:0.0:1746065131.631014:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065131.631016:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc146bde8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.631020:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc146bde8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.631046:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96c00/0xad6b7ddc146bdda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315df expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.631056:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146bdef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315df expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.631061:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065131.631063:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065131.631065:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96200, rc 0) 00000100:00100000:0.0:1746065131.631086:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31484:x1830881262952960:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 10006us (10196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.631096:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13336 00000100:00100000:0.0:1746065131.645746:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262955904 00000100:00100000:0.0:1746065131.645752:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262955904 00000100:00100000:0.0:1746065131.645799:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13337 00000100:00100000:0.0:1746065131.645806:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31484:x1830881262955904:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065131.645820:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.645834:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7200/0xad6b7ddc146be35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931625 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.645910:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc146be3c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.645921:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146bdef lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315df expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.645928:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc146be3c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.645951:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146bdef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315df expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.645960:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146bdef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315df expref: 8 pid: 7203 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.645969:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263116800:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065131.646029:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.646558:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.647091:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.647595:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263116800:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.647614:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc146be3c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065131.647874:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.648237:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065131.649480:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc146be3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.649486:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc146be3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065131.649500:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065131.649589:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7200/0xad6b7ddc146be35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931625 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.649603:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc146be3c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931625 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.649608:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065131.649611:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065131.649613:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7600, rc 0) 00000100:00100000:0.0:1746065131.649632:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31484:x1830881262955904:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3827us (3979us total) trans 8589935585 rc 0/0 00000100:00100000:0.0:1746065131.649638:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13337 00000100:00100000:0.0:1746065131.654040:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.655956:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.656021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.664412:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.664449:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.664482:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.670252:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.670293:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.670320:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.670340:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262957824 00000100:00100000:0.0:1746065131.670347:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262957824 00000100:00100000:0.0:1746065131.671090:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11799 00000100:00100000:0.0:1746065131.671096:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881262957824:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065131.671121:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.671132:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.671137:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065131.671139:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065131.671141:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.671156:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.671164:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 13 pid: 3067 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.671172:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263118464:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065131.672335:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.672873:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262958208 00000100:00100000:0.0:1746065131.672878:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262958208 00010000:00010000:0.0:1746065131.672898:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9cc00/0xad6b7ddc146bda9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315ae expref: 55 pid: 3068 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065131.672918:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5178 00000100:00100000:0.0:1746065131.672924:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881262958464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.672931:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.672948:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc146bd71 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931592 expref: 24 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.672957:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc146bd71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931592 expref: 24 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.673436:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.673459:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881262958464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 534us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.673466:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5178 00000100:00100000:0.0:1746065131.682403:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.682428:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.682440:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.682454:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.682476:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.682517:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263118208:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.682541:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.682595:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263118464:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.682605:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.682701:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881262957312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26165us (26680us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065131.682708:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3044 00002000:00100000:0.0:1746065131.682716:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009834df80 x1830881262957312/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:47/0 lens 488/440 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.682725:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834df80 with x1830881262957312 ext(2097152->4194303) 00010000:00010000:0.0:1746065131.682731:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc146bdd3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315d8 expref: 12 pid: 9549 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.682740:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009552ee00/0xad6b7ddc146bdd3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315d8 expref: 12 pid: 9549 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065131.682746:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009834df80 00000100:00100000:0.0:1746065131.682765:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262958592 00000100:00100000:0.0:1746065131.682767:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262958592 00010000:00010000:0.0:1746065131.682791:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bda2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a7 expref: 22 pid: 1880 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065131.682801:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262958848 00000100:00100000:0.0:1746065131.682802:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262958848 00010000:00010000:0.0:1746065131.682809:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc146be04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315f4 expref: 17 pid: 1880 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065131.682817:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5181 00000100:00100000:0.0:1746065131.682822:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881262958720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.682830:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.682844:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc146bdf6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315e6 expref: 13 pid: 1880 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.682851:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc146bdf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315e6 expref: 13 pid: 1880 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.683456:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc146bdf6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315e6 expref: 13 pid: 1880 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.683467:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.683480:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881262958720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 658us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.683485:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5181 00000100:00100000:0.0:1746065131.683515:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262959360 00000100:00100000:0.0:1746065131.683518:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262959360 00002000:00100000:0.0:1746065131.683535:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1769472->2097151) req@ffff88009077e300 x1830881262959360/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:47/0 lens 488/0 e 0 to 0 dl 1746065142 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.683542:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077e300 with x1830881262959360 ext(1769472->2097151) 00010000:00010000:0.0:1746065131.683547:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 12 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.683555:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc146bd9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1769472->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9315a0 expref: 12 pid: 3067 timeout: 827 lvb_type: 0 00002000:00010000:0.0:1746065131.683560:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009077e300 00000100:00100000:0.0:1746065131.683571:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1101 00000100:00100000:0.0:1746065131.683577:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881262959360:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065131.684812:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262959488 00000100:00100000:0.0:1746065131.684816:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262959488 00010000:00010000:0.0:1746065131.686983:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc146bd6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93158b expref: 14 pid: 3067 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.688554:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5190 00000100:00100000:0.0:1746065131.688563:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881262959488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.688572:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.688584:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc146bd6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93158b expref: 14 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.688593:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc146bd6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93158b expref: 14 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.688603:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc146bd6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93158b expref: 14 pid: 3067 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.688612:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.688613:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.688616:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688623:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688637:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.688655:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881262959488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (4381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.688660:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5190 00010000:00010000:0.0:1746065131.688686:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688691:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688701:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688707:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688712:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688717:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065131.688720:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688725:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688732:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.688740:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146be82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.689040:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881262957440:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 23231us (24366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.689046:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11797 00000100:00100000:0.0:1746065131.691036:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262960000 00000100:00100000:0.0:1746065131.691043:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262960000 00000100:00100000:0.0:1746065131.691069:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11801 00000100:00100000:0.0:1746065131.691076:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+21:31479:x1830881262960000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.691088:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.691109:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146be9e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931648 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065131.691126:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d6eb, atime: 0x6812d6ea, ctime: 0x6812d6eb, blocks: 0x1000 00010000:00010000:0.0:1746065131.691141:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.691143:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.691149:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146be9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931648 expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.691160:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146be9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931648 expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.691167:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683be00, rc 0) 00000100:00100000:0.0:1746065131.691199:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:31479:x1830881262960000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 123us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.691204:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11801 00000100:00100000:0.0:1746065131.692026:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.695089:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065131.695855:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.695862:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.695876:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.695883:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.695888:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.695894:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065131.695899:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.695905:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.695914:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.695925:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146be90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.697151:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.698986:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262960768 00000100:00100000:0.0:1746065131.698991:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262960768 00000100:00100000:0.0:1746065131.699567:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13340 00000100:00100000:0.0:1746065131.699575:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:31484:x1830881262960768:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:0.0:1746065131.699610:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.699645:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146be6d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931641 expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699660:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065131.699663:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065131.699683:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc146bea5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.699693:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc146bc83 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93151b expref: 35 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699699:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927800/0xad6b7ddc146bcc2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93153e expref: 15 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699704:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc146bbe9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931496 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699710:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc146bc05 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314b2 expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699717:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc146bea5 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.699742:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc146bc05 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314b2 expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699753:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc146bc05 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9314b2 expref: 35 pid: 7205 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.699765:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263119104:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.699900:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc146bbe9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931496 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699907:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc146bbe9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931496 expref: 15 pid: 7231 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.699913:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263119232:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.699937:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927800/0xad6b7ddc146bcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93153e expref: 15 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699944:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927800/0xad6b7ddc146bcc2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93153e expref: 15 pid: 7205 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.699950:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263119360:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065131.699971:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc146bc83 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93151b expref: 35 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.699982:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc146bc83 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93151b expref: 35 pid: 7203 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.699989:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263119488:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065131.700004:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.704052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.706216:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.706246:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.707770:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.712492:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263120896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.712512:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263120640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.712947:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263119616 00000100:00100000:0.0:1746065131.712951:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263119616 00000100:00100000:0.0:1746065131.712963:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.712976:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263121408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.712988:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.712996:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065131.712999:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263120768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.713010:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.713016:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263121280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.713028:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.713040:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.713046:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263121152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.713058:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.713078:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120768 00000100:00100000:0.0:1746065131.713080:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120768 00000100:00100000:0.0:1746065131.713086:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120640 00000100:00100000:0.0:1746065131.713087:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120640 00000100:00100000:0.0:1746065131.713092:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263121152 00000100:00100000:0.0:1746065131.713094:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263121152 00000100:00100000:0.0:1746065131.713113:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11808 00000100:00100000:0.0:1746065131.713118:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3760:x1830881263120896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065131.713160:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065131.713162:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065131.713164:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.713166:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065131.713167:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746065131.713183:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3760:x1830881263120896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (219us total) trans 17179873219 rc 0/0 00000100:00100000:0.0:1746065131.713187:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11808 00000004:00080000:0.0:1746065131.713209:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f1f80/2, rc 0, transno 17179873219 00000100:00100000:0.0:1746065131.713214:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263120896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.713223:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11810 00000100:00100000:0.0:1746065131.713227:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3761:x1830881263119616:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065131.714339:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f2300/2, rc 0, transno 17179873220 00000100:00100000:0.0:1746065131.714342:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263121408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.714348:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f0000/2, rc 0, transno 17179873222 00000100:00100000:0.0:1746065131.714350:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263120768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.714356:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f1180/2, rc 0, transno 17179873223 00000100:00100000:0.0:1746065131.714358:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263121280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.714412:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263119616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1184us (2150us total) trans 21474840658 rc 0/0 00000100:00100000:0.0:1746065131.714417:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11810 00000100:00100000:0.0:1746065131.714460:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.716197:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.723424:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.726168:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.726214:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.728381:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3047 00000100:00100000:0.0:1746065131.728389:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881262963328:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065131.731451:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.752765:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.752833:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.752862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.752883:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.752924:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262963712 00000100:00100000:0.0:1746065131.752933:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262963712 00000100:00100000:0.0:1746065131.752971:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262963968 00000100:00100000:0.0:1746065131.752973:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262963968 00000100:00100000:0.0:1746065131.752983:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262963584 00000100:00100000:0.0:1746065131.752984:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262963584 00000100:00100000:0.0:1746065131.752991:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262963840 00000100:00100000:0.0:1746065131.752993:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262963840 00000100:00100000:0.0:1746065131.753006:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11826 00000100:00100000:0.0:1746065131.753013:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881262963712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.753028:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.753044:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc146bf1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9316a3 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.753063:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.753064:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.753071:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc146bf1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316a3 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.753084:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc146bf1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316a3 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.753092:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96200, rc 0) 00000100:00100000:0.0:1746065131.753154:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881262963712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 142us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.753160:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11826 00000100:00100000:0.0:1746065131.753173:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11827 00000100:00100000:0.0:1746065131.753177:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881262963968:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.753183:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.753192:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146bf23 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9316b1 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.753201:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.753203:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.753206:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146bf23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316b1 expref: 14 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.753214:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146bf23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316b1 expref: 14 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.753224:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96800, rc 0) 00000100:00100000:0.0:1746065131.753238:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881262963968:12345-192.168.202.27@tcp:101:cat.0 Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.753242:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11827 00000100:00100000:0.0:1746065131.753336:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11828 00000100:00100000:0.0:1746065131.753340:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881262963584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.753345:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.753350:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93169c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.753357:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.753358:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.753361:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 14 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.753368:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 14 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.753374:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97400, rc 0) 00000100:00100000:0.0:1746065131.753385:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881262963584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 45us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.753389:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11828 00000100:00100000:0.0:1746065131.753395:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11829 00000100:00100000:0.0:1746065131.753399:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881262963840:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.753405:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.753409:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96400/0xad6b7ddc146bf31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9316aa expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.753415:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.753416:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.753419:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96400/0xad6b7ddc146bf31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316aa expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.753425:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a96400/0xad6b7ddc146bf31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316aa expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.753430:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96400, rc 0) 00000100:00100000:0.0:1746065131.753438:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881262963840:12345-192.168.202.27@tcp:101:cat.0 Request processed in 39us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.753441:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11829 00000100:00100000:0.0:1746065131.769133:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.802598:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.809856:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.813323:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.814487:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.814535:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.815077:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.815120:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.815147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.815456:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262965632 00000100:00100000:0.0:1746065131.815458:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262965632 00000100:00100000:0.0:1746065131.815529:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11834 00000100:00100000:0.0:1746065131.815535:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881262965632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.815541:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.815547:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146bf85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9316e9 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.815555:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.815556:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.815560:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146bf85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316e9 expref: 55 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.815569:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146bf85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316e9 expref: 55 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065131.815576:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97200, rc 0) 00000100:00100000:0.0:1746065131.815590:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+55:2007:x1830881262965632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.815594:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11834 00000100:00100000:0.0:1746065131.823340:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.825012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.825251:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.826670:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.826685:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.826751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.826786:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.827736:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.827756:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262967296 00000100:00100000:0.0:1746065131.827759:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262967296 00010000:00010000:0.0:1746065131.827770:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61600/0xad6b7ddc146beb3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931656 expref: 9 pid: 7205 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746065131.827799:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5200 00000100:00100000:0.0:1746065131.827803:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881262967296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.827808:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.827811:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61600/0xad6b7ddc146beb3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931656 expref: 9 pid: 7205 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.828952:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61600/0xad6b7ddc146beb3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931656 expref: 9 pid: 7205 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.828964:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61600/0xad6b7ddc146beb3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931656 expref: 9 pid: 7205 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746065131.828988:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065131.828991:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc146bf9a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.828997:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc146bf9a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.829002:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc146bf9a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065131.829450:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.830078:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881262967296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2271us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.830085:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5200 00000100:00100000:0.0:1746065131.839906:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263122432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.839948:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.839981:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263122944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.839993:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.840006:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065131.840009:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263122304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.840020:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.840028:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263122816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.840038:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065131.840055:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122432 00000100:00100000:0.0:1746065131.840060:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122432 00000100:00100000:0.0:1746065131.840083:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122944 00000100:00100000:0.0:1746065131.840085:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122944 00000100:00100000:0.0:1746065131.840095:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122304 00000100:00100000:0.0:1746065131.840105:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122304 00000100:00100000:0.0:1746065131.840115:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122816 00000100:00100000:0.0:1746065131.840116:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122816 00000100:00100000:0.0:1746065131.840129:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11836 00000100:00100000:0.0:1746065131.840134:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3760:x1830881263122432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065131.840240:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065131.840242:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065131.840244:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.840246:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065131.840247:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065131.840270:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3760:x1830881263122432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (322us total) trans 17179873227 rc 0/0 00000100:00100000:0.0:1746065131.840276:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11836 00000100:00100000:0.0:1746065131.840288:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11837 00000100:00100000:0.0:1746065131.840293:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3760:x1830881263122944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.840345:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3760:x1830881263122944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (350us total) trans 17179873228 rc 0/0 00000100:00100000:0.0:1746065131.840349:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11837 00000100:00100000:0.0:1746065131.840359:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11838 00000100:00100000:0.0:1746065131.840363:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3760:x1830881263122304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065131.840398:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065131.840401:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065131.840402:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:0.0:1746065131.840404:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065131 -> 1746065131 00002000:00010000:0.0:1746065131.840406:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065131.840421:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3760:x1830881263122304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (400us total) trans 17179873229 rc 0/0 00000100:00100000:0.0:1746065131.840426:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11838 00000100:00100000:0.0:1746065131.840435:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11839 00000100:00100000:0.0:1746065131.840439:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3760:x1830881263122816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.840483:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3760:x1830881263122816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (444us total) trans 17179873230 rc 0/0 00000100:00100000:0.0:1746065131.840487:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11839 00000004:00080000:0.0:1746065131.840519:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077c000/2, rc 0, transno 17179873229 00000100:00100000:0.0:1746065131.840522:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263122304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.840528:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0000/2, rc 0, transno 17179873230 00000100:00100000:0.0:1746065131.840530:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263122816:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.840534:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fc700/2, rc 0, transno 17179873227 00000100:00100000:0.0:1746065131.840536:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263122432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065131.840541:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3100/2, rc 0, transno 17179873228 00000100:00100000:0.0:1746065131.840543:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263122944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065131.843846:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881262967168:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 16870us (17066us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065131.843855:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3052 00002000:00100000:0.0:1746065131.843864:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009077f800 x1830881262967168/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:47/0 lens 488/440 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.843873:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881262967168 ext(1048576->2097151) 00002000:00010000:0.0:1746065131.843878:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f800 00000001:00080000:0.0:1746065131.850873:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873234 is committed 00000001:00080000:0.0:1746065131.850900:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873218 is committed 00000001:00080000:0.0:1746065131.850909:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873216 is committed 00000001:00080000:0.0:1746065131.850937:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873199 is committed 00000100:00100000:0.0:1746065131.873609:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.873628:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262967808 00000100:00100000:0.0:1746065131.873631:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262967808 00010000:00010000:0.0:1746065131.873649:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146bf23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316b1 expref: 14 pid: 1880 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065131.873667:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5201 00000100:00100000:0.0:1746065131.873672:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881262967808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.873680:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.873694:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146bf23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316b1 expref: 14 pid: 1880 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.873706:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146bf23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316b1 expref: 14 pid: 1880 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.873718:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146bf23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316b1 expref: 14 pid: 1880 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.874487:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065131.874510:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881262967808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 832us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.874516:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5201 00000100:00100000:0.0:1746065131.874644:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262967936 00000100:00100000:0.0:1746065131.874647:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262967936 00010000:00010000:0.0:1746065131.874657:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146bf8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316db expref: 24 pid: 9550 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065131.874691:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5203 00000100:00100000:0.0:1746065131.874695:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881262967936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065131.874702:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065131.874708:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146bf8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316db expref: 24 pid: 9550 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.874715:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146bf8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316db expref: 24 pid: 9550 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.874725:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146bf8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316db expref: 24 pid: 9550 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065131.874733:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.874734:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065131.874739:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f66600/0xad6b7ddc146bfa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2072575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316fe expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.874745:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f66600/0xad6b7ddc146bfa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2072575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316fe expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.874766:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f66600/0xad6b7ddc146bfa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2072575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316fe expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065131.874797:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263124864:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065131.875744:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065131.875807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.877907:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.881689:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.897493:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.897540:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.926428:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.932581:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.936913:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.937544:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.937579:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.937605:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262970496 00000100:00100000:0.0:1746065131.937608:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262970496 00000100:00100000:0.0:1746065131.937631:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13350 00000100:00100000:0.0:1746065131.937637:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+9:31498:x1830881262970496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065131.937650:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065131.937663:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc146bfee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93170c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.937720:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01600/0xad6b7ddc146bff5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.937731:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01600/0xad6b7ddc146bff5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.937740:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01600/0xad6b7ddc146bff5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065131.937758:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00000004:00200000:0.0:1746065131.937761:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065131.937793:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01600/0xad6b7ddc146bff5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065131.937810:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc146bfee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93170c expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.937824:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01600/0xad6b7ddc146bff5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93170c expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065131.937830:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065131.937832:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065131.937835:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01600, rc 0) 00000100:00100000:0.0:1746065131.937862:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+10:31498:x1830881262970496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 225us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065131.937867:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13350 00000100:00100000:0.0:1746065131.944236:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.961136:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.962956:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.963073:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.963918:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3061 00000100:00100000:0.0:1746065131.963926:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881262971136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065131.967941:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.982288:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.982360:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065131.991159:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881262970880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29761us (30014us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065131.991169:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3060 00002000:00100000:0.0:1746065131.991179:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880129f40e00 x1830881262970880/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:47/0 lens 488/440 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.991188:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40e00 with x1830881262970880 ext(0->1048575) 00002000:00010000:0.0:1746065131.991193:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f40e00 00000100:00100000:0.0:1746065131.991666:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881262971136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27740us (28714us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065131.991671:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3061 00002000:00100000:0.0:1746065131.991676:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880129f42680 x1830881262971136/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:47/0 lens 488/440 e 0 to 0 dl 1746065142 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065131.991682:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42680 with x1830881262971136 ext(1048576->2097151) 00002000:00010000:0.0:1746065131.991686:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f42680 00000100:00100000:0.0:1746065132.000512:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262972032 00000100:00100000:0.0:1746065132.000520:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262972032 00010000:00010000:0.0:1746065132.000553:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146bf7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316e2 expref: 24 pid: 10219 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746065132.000575:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5206 00000100:00100000:0.0:1746065132.000581:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881262972032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065132.000592:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065132.000607:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146bf7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316e2 expref: 24 pid: 10219 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065132.000618:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146bf7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316e2 expref: 24 pid: 10219 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065132.000636:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146bf7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316e2 expref: 24 pid: 10219 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746065132.000764:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.000766:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.000789:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146c003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2838527) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93171a expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.000797:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146c003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2838527) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93171a expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.000821:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146c003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->2838527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93171a expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065132.000830:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263125504:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065132.001812:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.003723:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.005040:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263125504:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065132.005056:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065132.005077:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881262972032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4496us (5542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065132.005084:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5206 00000100:00100000:0.0:1746065132.007280:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.012521:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.017890:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.019207:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263125632:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065132.019224:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146c011 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931728 expref: 14 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.019233:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a600, rc 0) 00000100:00100000:0.0:1746065132.019252:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+14:31498:x1830881262972672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5522us (6733us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065132.019257:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11857 00000100:00100000:0.0:1746065132.038269:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.038310:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.038634:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.043798:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263125760:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065132.043817:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065132.043852:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881262973824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5038us (5588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065132.043864:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5207 00000100:00100000:0.0:1746065132.045450:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.047297:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.053674:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.078725:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.096983:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.112515:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.121756:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262975616 00000100:00100000:0.0:1746065132.121764:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262975616 00002000:00100000:0.0:1746065132.121819:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880097a6f800 x1830881262975616/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065132.121829:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f800 with x1830881262975616 ext(2097152->4194303) 00002000:00010000:0.0:1746065132.121834:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6f800 00000100:00100000:0.0:1746065132.121864:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3069 00000100:00100000:0.0:1746065132.121870:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881262975616:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065132.153458:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.172019:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.195614:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.223940:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.251686:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.255629:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.259377:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.263633:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.263669:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.306692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.311676:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.317762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.318223:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.320837:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.322223:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.327828:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.347517:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.348762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.352980:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.404196:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.410448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.412960:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.414638:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.415600:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5214 00000100:00100000:0.0:1746065132.415607:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881262980096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065132.415613:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065132.415620:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146be9e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931648 expref: 8 pid: 1880 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065132.415627:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146be9e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931648 expref: 8 pid: 1880 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065132.415637:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146be9e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931648 expref: 8 pid: 1880 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065132.415646:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.415648:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.415654:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146c0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931783 expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.415661:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146c0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931783 expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.415687:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146c0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931783 expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065132.415698:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263127168:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065132.416443:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.419209:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.425249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.426851:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.434222:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.434257:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.435232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.435254:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.435273:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262981120 00000100:00100000:0.0:1746065132.435277:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262981120 00000100:00100000:0.0:1746065132.435763:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262981248 00000100:00100000:0.0:1746065132.435767:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262981248 00000100:00100000:0.0:1746065132.435803:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11868 00000100:00100000:0.0:1746065132.435808:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881262981120:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065132.435820:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065132.435832:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146c0f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931798 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065132.435873:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263127680:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065132.435925:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.435945:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11869 00000100:00100000:0.0:1746065132.435951:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881262981248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065132.435957:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065132.435965:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146c0ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93179f expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.435975:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.435980:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146c0ff lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93179f expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065132.435988:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146c0ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93179f expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065132.437992:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4000, rc 0) 00000100:00100000:0.0:1746065132.449085:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.456443:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.465131:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.465176:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.484763:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.492535:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.492575:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.492611:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:0.0:1746065132.495950:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065131 -> 1746065132 00000100:00100000:0.0:1746065132.495970:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263128064:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065132.495993:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc146c130 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317bb expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065132.496004:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc146c130 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317bb expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065132.496016:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3a00, rc 0) 00000100:00100000:0.0:1746065132.496041:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881262982656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3272us (3513us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065132.496048:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11871 00000100:00100000:0.0:1746065132.497363:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.503931:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.516915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.516957:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.534448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.534593:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.542369:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.547597:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.558818:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.559199:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.588444:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.590528:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.592043:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.593232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.599356:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.600597:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:1.0:1746065132.607907:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec380 with x1830881262985600 ext(2097152->3145727) 00002000:00010000:1.0:1746065132.607913:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acec380 00000100:00100000:0.0:1746065132.615763:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.616428:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.619044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.624936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.624966:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.624980:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.625003:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.625037:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262986368 00000100:00100000:1.0:1746065132.625044:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262986368 00010000:00010000:1.0:1746065132.625071:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146c1a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317f3 expref: 18 pid: 12258 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065132.625103:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5220 00000100:00100000:1.0:1746065132.625110:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881262986368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065132.625120:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065132.625134:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146c1a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317f3 expref: 18 pid: 12258 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.625144:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146c1a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317f3 expref: 18 pid: 12258 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.625161:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146c1a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317f3 expref: 18 pid: 12258 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.625175:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065132.625191:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881262986368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.625196:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5220 00000100:00100000:1.0:1746065132.625207:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5221 00000100:00100000:1.0:1746065132.625212:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881262986752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065132.625217:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065132.625224:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc146c15a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317de expref: 26 pid: 12258 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.625232:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc146c15a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317de expref: 26 pid: 12258 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.625242:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc146c15a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317de expref: 26 pid: 12258 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.625249:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.625251:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.625549:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c1b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2342911) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931801 expref: 25 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.625557:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c1b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2342911) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931801 expref: 25 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.626344:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c1b5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931801 expref: 25 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065132.626466:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263129856:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065132.626869:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f016c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.633413:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.633442:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.633473:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262986880 00000100:00100000:0.0:1746065132.633478:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262986880 00010000:00010000:0.0:1746065132.633503:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146c0c7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931783 expref: 12 pid: 10219 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746065132.633525:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5222 00000100:00100000:0.0:1746065132.633531:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881262986880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065132.633541:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065132.633557:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146c0c7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931783 expref: 12 pid: 10219 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065132.633568:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146c0c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931783 expref: 12 pid: 10219 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065132.633589:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.633591:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065132.633597:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146c1ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317fa expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.633609:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146c1ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317fa expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.633634:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc146c1ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317fa expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065132.633643:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263129984:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065132.633700:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065132.637461:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263129856:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065132.637476:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065132.637513:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881262986752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12300us (12509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.637521:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5221 00000100:00100000:1.0:1746065132.637961:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130112 00000100:00100000:1.0:1746065132.637971:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130112 00000100:00100000:1.0:1746065132.638011:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1746065132.638018:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263130112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746065132.638034:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1098512704 pending 1105920 free 3910807552 avail 3670331392 00000100:00100000:1.0:1746065132.638061:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263130112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.638066:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1746065132.638694:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263129984:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065132.638706:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065132.638738:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881262986880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5205us (5329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065132.638744:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5222 00000100:00100000:0.0:1746065132.640148:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.640186:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.643123:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.643156:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.643197:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.643262:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262988032 00000100:00100000:1.0:1746065132.643267:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262988032 00000100:00100000:0.0:1746065132.643925:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3085 00000100:00100000:0.0:1746065132.643931:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881262987776:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065132.644374:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4739 00000100:00100000:1.0:1746065132.644381:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+36:31520:x1830881262988032:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065132.644511:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:31520:x1830881262988032:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 130us (1354us total) trans 8589935609 rc 0/0 00000100:00100000:1.0:1746065132.644516:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4739 00000100:00100000:1.0:1746065132.646085:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.647124:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262988288 00000100:00100000:0.0:1746065132.647132:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262988288 00002000:00100000:0.0:1746065132.647165:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2252800->2342911) req@ffff880097a6d880 x1830881262988288/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065132.647178:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d880 with x1830881262988288 ext(2252800->2342911) 00010000:00010000:0.0:1746065132.647186:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c1b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931801 expref: 27 pid: 12258 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065132.647197:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c1b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931801 expref: 27 pid: 12258 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065132.647202:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6d880 00000100:00100000:0.0:1746065132.647756:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1110 00000100:00100000:0.0:1746065132.647765:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881262988288:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065132.655282:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881262988288:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7510us (9191us total) trans 21474840672 rc 0/0 00000100:00100000:0.0:1746065132.655292:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1110 00002000:00100000:0.0:1746065132.655302:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2252800->2342911) req@ffff880097a6d880 x1830881262988288/t21474840672(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:48/0 lens 488/448 e 0 to 0 dl 1746065143 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065132.655310:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d880 with x1830881262988288 ext(2252800->2342911) 00010000:00010000:0.0:1746065132.655319:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c1b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931801 expref: 29 pid: 12258 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746065132.655331:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c1b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931801 expref: 29 pid: 12258 timeout: 828 lvb_type: 0 00002000:00010000:0.0:1746065132.655337:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6d880 00000100:00100000:0.0:1746065132.660815:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.666994:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.674460:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.678011:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.684191:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.696470:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.696511:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.696577:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262989824 00000100:00100000:1.0:1746065132.696584:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262989824 00000100:00100000:1.0:1746065132.696627:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4740 00000100:00100000:1.0:1746065132.696633:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+16:31514:x1830881262989824:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065132.696789:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+17:31514:x1830881262989824:12345-192.168.202.27@tcp:35:cat.0 Request processed in 140us (261us total) trans 8589935610 rc 0/0 00000100:00100000:1.0:1746065132.696795:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4740 00000100:00100000:0.0:1746065132.714867:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.714952:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262990080 00000100:00100000:1.0:1746065132.714960:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262990080 00000100:00100000:1.0:1746065132.715008:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4741 00000100:00100000:1.0:1746065132.715016:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:31518:x1830881262990080:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065132.715197:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+38:31518:x1830881262990080:12345-192.168.202.27@tcp:35:cat.0 Request processed in 181us (337us total) trans 8589935611 rc 0/0 00000100:00100000:1.0:1746065132.715203:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4741 00000100:00100000:0.0:1746065132.730338:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.730424:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.730600:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262990208 00000100:00100000:1.0:1746065132.730604:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262990208 00000100:00100000:0.0:1746065132.734823:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.734856:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.736818:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.739283:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.751904:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.757492:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.768894:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.769042:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262992000 00000100:00100000:1.0:1746065132.769050:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262992000 00000100:00100000:1.0:1746065132.769162:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13359 00000100:00100000:1.0:1746065132.769171:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+38:31529:x1830881262992000:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065132.769192:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.769212:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc146c1e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931832 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.769271:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769282:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769290:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769301:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769306:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769312:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769389:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6556e00/0xad6b7ddc146c1fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769397:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6556e00/0xad6b7ddc146c1fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769403:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6556e00/0xad6b7ddc146c1fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065132.769410:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065132.769468:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769474:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769478:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769483:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769488:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065132.769491:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769496:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769504:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065132.769507:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065132.769510:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769518:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc146c1ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769531:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769535:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769540:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769543:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019ec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065132.769545:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769549:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769554:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f854700) 00010000:00010000:1.0:1746065132.769556:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065132.769557:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769561:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc146c1f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.769728:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc146c1e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931832 expref: 41 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.769740:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6556e00/0xad6b7ddc146c1fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931832 expref: 40 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.769751:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065132.769752:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065132.769754:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6556e00, rc 0) 00000100:00100000:1.0:1746065132.769872:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+40:31529:x1830881262992000:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 702us (984us total) trans 8589935615 rc 0/0 00000100:00100000:1.0:1746065132.769878:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13359 00000100:00100000:0.0:1746065132.776853:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.780274:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.781548:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263131264 00000100:00100000:1.0:1746065132.781552:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263131264 00000100:00100000:1.0:1746065132.781589:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1746065132.781596:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881263131264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746065132.781609:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1207772608 pending 3436544 free 3903471616 avail 3663925248 00000100:00100000:1.0:1746065132.781637:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881263131264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.781642:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00010000:00010000:0.0:1746065132.787563:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96400/0xad6b7ddc146bf31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316aa expref: 9 pid: 1880 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065132.787585:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263130880:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065132.787594:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146bf77 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316d4 expref: 30 pid: 13375 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746065132.787601:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263131008:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065132.787608:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263131136:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065132.787629:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146c209 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [2060288->2097151] (req 2060288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931839 expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065132.787638:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9ce00, rc 0) 00000100:00100000:0.0:1746065132.787656:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+29:31529:x1830881262992256:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7241us (7388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065132.787663:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11887 00000100:00100000:0.0:1746065132.792040:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.797690:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.797766:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.798404:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5230 00000100:00100000:1.0:1746065132.798410:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881262993024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065132.798417:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065132.798423:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146c011 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931728 expref: 18 pid: 9549 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.798431:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146c011 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931728 expref: 18 pid: 9549 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.798441:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146c011 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931728 expref: 18 pid: 9549 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.798850:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065132.799294:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881262993024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 884us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.799300:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5230 00000100:00100000:0.0:1746065132.805474:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.807940:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.875376:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.875597:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262993792 00000100:00100000:1.0:1746065132.875604:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262993792 00000100:00100000:1.0:1746065132.875654:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13360 00000100:00100000:1.0:1746065132.875661:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+18:31533:x1830881262993792:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065132.875680:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.875695:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931847 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.875961:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.875973:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.875981:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.875991:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.875994:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.875997:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876074:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146c22c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876079:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146c22c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876082:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146c22c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065132.876099:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065132.876157:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876163:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876168:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876174:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876178:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065132.876182:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876187:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876197:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065132.876199:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065132.876202:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876210:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c21e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876235:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876240:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876245:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876248:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065132.876251:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876254:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876260:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f854d00) 00010000:00010000:1.0:1746065132.876262:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065132.876264:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876268:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.876300:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931847 expref: 21 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.876314:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146c22c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931847 expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.876323:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065132.876325:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065132.876327:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:1.0:1746065132.876377:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+20:31533:x1830881262993792:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 716us (1007us total) trans 8589935617 rc 0/0 00000100:00100000:1.0:1746065132.876384:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13360 00000100:00100000:0.0:1746065132.878287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.884966:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.888538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.893077:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.897102:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.908041:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.915380:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.925919:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.926028:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262995328 00000100:00100000:1.0:1746065132.926041:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262995328 00000100:00100000:1.0:1746065132.926268:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13361 00000100:00100000:1.0:1746065132.926492:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+20:31537:x1830881262995328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065132.926521:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065132.926544:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146c241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931855 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.927629:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c248 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.927646:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c248 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065132.927658:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c248 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065132.927672:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065132.927815:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146c241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931855 expref: 23 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.927843:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c248 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931855 expref: 22 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.927851:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065132.927854:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065132.927856:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e200, rc 0) 00000100:00100000:1.0:1746065132.927918:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+22:31537:x1830881262995328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1641us (2006us total) trans 8589935619 rc 0/0 00000100:00100000:1.0:1746065132.927926:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13361 00000100:00100000:0.0:1746065132.935430:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.936836:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.940674:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.940703:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.940968:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262995968 00000100:00100000:1.0:1746065132.940974:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262995968 00010000:00010000:1.0:1746065132.940997:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130113e00/0xad6b7ddc146c088 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931760 expref: 42 pid: 7205 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065132.941014:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262995840 00000100:00100000:1.0:1746065132.941015:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262995840 00010000:00010000:1.0:1746065132.941025:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01600/0xad6b7ddc146bff5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93170c expref: 22 pid: 7203 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065132.941039:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5232 00000100:00100000:1.0:1746065132.941045:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881262995968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065132.941057:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065132.941061:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130113e00/0xad6b7ddc146c088 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931760 expref: 42 pid: 7205 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.941069:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130113e00/0xad6b7ddc146c088 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931760 expref: 42 pid: 7205 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.941084:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130113e00/0xad6b7ddc146c088 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931760 expref: 42 pid: 7205 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.941116:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065132.941120:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065132.941127:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065132.941132:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065132.941619:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881262995968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 573us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.941626:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5232 00000100:00100000:0.0:1746065132.941995:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.949737:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.952869:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996352 00000100:00100000:1.0:1746065132.952880:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996352 00000100:00100000:0.0:1746065132.953195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.953227:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.953241:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.953258:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.953271:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.953282:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.953296:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996608 00000100:00100000:0.0:1746065132.953299:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996608 00000100:00100000:0.0:1746065132.953319:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262997376 00000100:00100000:0.0:1746065132.953321:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262997376 00000100:00100000:0.0:1746065132.953331:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996736 00000100:00100000:0.0:1746065132.953332:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996736 00000100:00100000:1.0:1746065132.953363:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 180 00000100:00100000:1.0:1746065132.953370:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881262996352:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065132.953421:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881262996352:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 51us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.953426:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 180 00000100:00100000:0.0:1746065132.953991:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 602 00000100:00100000:0.0:1746065132.953996:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881262996608:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065132.954017:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881262996608:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 22us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065132.954021:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 602 00000100:00100000:0.0:1746065132.954030:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 603 00000100:00100000:0.0:1746065132.954034:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881262997376:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065132.954449:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 604 00000100:00100000:1.0:1746065132.954454:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881262996736:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065132.954475:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881262996736:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 22us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.954479:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 604 00000100:00100000:1.0:1746065132.954575:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.954588:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996992 00000100:00100000:1.0:1746065132.954591:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996992 00000100:00100000:1.0:1746065132.954605:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 605 00000100:00100000:1.0:1746065132.954609:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881262996992:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065132.954624:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881262996992:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 15us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.954629:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 605 00000100:00100000:0.0:1746065132.954876:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881262997376:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 841us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065132.954881:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 603 00000100:00100000:0.0:1746065132.955331:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.955346:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.955350:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262997248 00000100:00100000:1.0:1746065132.955353:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262997248 00000100:00100000:0.0:1746065132.955358:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.955377:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 977 00000100:00100000:1.0:1746065132.955381:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881262997248:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065132.955381:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.955409:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881262997248:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.955414:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 977 00000100:00100000:0.0:1746065132.956571:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065132.959668:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime: 1746065130 -> 1746065133 00000100:00100000:1.0:1746065132.959685:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263132544:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065132.959712:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146c295 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931871 expref: 31 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065132.959723:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9ce00/0xad6b7ddc146c295 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931871 expref: 31 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065132.959736:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9ce00, rc 0) 00000100:00100000:1.0:1746065132.959763:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881262997632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4069us (4403us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065132.959769:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11891 00000100:00100000:0.0:1746065132.969620:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.973582:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.975467:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.978684:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065132.982230:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.982291:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262998656 00000100:00100000:1.0:1746065132.982297:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262998656 00010000:00010000:1.0:1746065132.982318:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c600/0xad6b7ddc146c23a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93184e expref: 12 pid: 13375 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746065132.982574:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5234 00000100:00100000:1.0:1746065132.982582:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881262998656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065132.982595:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065132.982613:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012db9c600/0xad6b7ddc146c23a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93184e expref: 12 pid: 13375 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.982624:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db9c600/0xad6b7ddc146c23a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1564671) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93184e expref: 12 pid: 13375 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.982643:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c600/0xad6b7ddc146c23a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1564671) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93184e expref: 12 pid: 13375 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746065132.982671:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.982673:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065132.982679:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146c2a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93187f expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.982686:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146c2a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93187f expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065132.982713:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146c2a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93187f expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065132.982727:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263133056:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065132.982805:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065132.983672:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.986844:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263133056:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065132.986866:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065132.986912:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881262998656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4329us (5306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065132.986921:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5234 00000100:00100000:0.0:1746065132.988047:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065132.997990:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262999296 00000100:00100000:1.0:1746065132.998003:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262999296 00002000:00100000:1.0:1746065132.998047:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88013513a680 x1830881262999296/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:48/0 lens 488/0 e 0 to 0 dl 1746065143 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065132.998057:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513a680 with x1830881262999296 ext(1048576->2097151) 00002000:00010000:1.0:1746065132.998062:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513a680 00000100:00100000:1.0:1746065132.998098:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3096 00000100:00100000:1.0:1746065132.998106:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881262999296:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.009920:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.010134:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881262999296:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12028us (16127us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065133.010143:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3096 00002000:00100000:1.0:1746065133.010152:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88013513a680 x1830881262999296/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:48/0 lens 488/440 e 0 to 0 dl 1746065143 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.010160:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513a680 with x1830881262999296 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.010164:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513a680 00000100:00080000:0.0:1746065133.010753:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065133.019248:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.019330:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262999680 00000100:00100000:1.0:1746065133.019340:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262999680 00002000:00100000:1.0:1746065133.019381:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800954bf100 x1830881262999680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.019389:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bf100 with x1830881262999680 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.019394:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800954bf100 00000100:00100000:1.0:1746065133.019539:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3097 00000100:00100000:1.0:1746065133.019547:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881262999680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.031028:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.031075:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065133.034296:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065133.034301:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065133.035267:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881262999680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15715us (16020us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065133.035276:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3097 00002000:00100000:0.0:1746065133.035284:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800954bf100 x1830881262999680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.035292:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bf100 with x1830881262999680 ext(1048576->2097151) 00002000:00010000:0.0:1746065133.035297:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800954bf100 00000100:00100000:0.0:1746065133.052919:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.053365:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263000320 00000100:00100000:1.0:1746065133.053372:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263000320 00000100:00100000:1.0:1746065133.053425:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11896 00000100:00100000:1.0:1746065133.053433:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:31542:x1830881263000320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.053449:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.053749:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931894 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.053807:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136166c00/0xad6b7ddc146c1df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93182b expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.053815:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.053816:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.053819:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.053848:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136166c00/0xad6b7ddc146c1df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->3026943) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93182b expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.053863:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136166c00/0xad6b7ddc146c1df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->3026943) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93182b expref: 19 pid: 13375 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.053873:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263133312:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.053940:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.056402:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263133312:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.056420:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.056431:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31200, rc 0) 00000100:00100000:1.0:1746065133.056594:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:31542:x1830881263000320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3161us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.056601:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11896 00000100:00100000:0.0:1746065133.058017:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.062620:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263000576 00000100:00100000:1.0:1746065133.062628:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263000576 00000100:00100000:1.0:1746065133.062678:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11897 00000100:00100000:1.0:1746065133.062685:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+20:31537:x1830881263000576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.062699:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.062712:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146c2bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93189b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.062734:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.062736:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065133.062740:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146c2bf lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93189b expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.062754:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146c2bf lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93189b expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.062761:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30200, rc 0) 00000100:00100000:1.0:1746065133.062832:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:31537:x1830881263000576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 147us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.062837:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11897 00000100:00100000:0.0:1746065133.070190:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.078500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.091693:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.123853:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.123882:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001344 00000100:00100000:1.0:1746065133.123890:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001344 00000100:00100000:0.0:1746065133.123901:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.123989:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001472 00000100:00100000:1.0:1746065133.123991:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001472 00000100:00100000:1.0:1746065133.124013:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11898 00000100:00100000:1.0:1746065133.124019:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263001344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.124034:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.124047:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc146c2c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9318a2 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.124064:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.124066:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.124073:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc146c2c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a2 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.124085:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc146c2c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a2 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.124110:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30a00, rc 0) 00000100:00100000:1.0:1746065133.124144:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263001344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 125us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.124150:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11898 00000100:00100000:0.0:1746065133.124156:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11899 00000100:00100000:0.0:1746065133.124162:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:31540:x1830881263001472:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065133.124171:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.124180:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9318a9 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.124195:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929fa000/0xad6b7ddc146beeb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93166b expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.124203:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146bf69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316c6 expref: 32 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.124209:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 19 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.124215:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.124216:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.124218:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [507904->1048575] (req 507904->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a9 expref: 32 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.124305:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 19 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.124315:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 19 pid: 1880 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065133.124326:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263133696:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.124392:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146bf69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316c6 expref: 32 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.124399:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146bf69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316c6 expref: 32 pid: 13375 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065133.124410:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263133824:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.124434:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800929fa000/0xad6b7ddc146beeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93166b expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.124441:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800929fa000/0xad6b7ddc146beeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93166b expref: 9 pid: 12260 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065133.124455:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263133952:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.124468:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.130361:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.130381:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263133696:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.130391:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263133824:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.130398:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263133952:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065133.130403:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065133.130421:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [507904->1048575] (req 507904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a9 expref: 32 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.130436:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001600 00010000:00010000:1.0:1746065133.130437:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538000, rc 0) 00000100:00100000:0.0:1746065133.130441:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001600 00010000:00010000:0.0:1746065133.130471:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929fa000/0xad6b7ddc146beeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93166b expref: 10 pid: 12260 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065133.130485:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:31540:x1830881263001472:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6322us (6582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.130488:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001728 00000100:00100000:0.0:1746065133.130491:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001728 00000100:00100000:1.0:1746065133.130493:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11899 00010000:00010000:0.0:1746065133.130499:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 20 pid: 1880 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746065133.130511:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5237 00000100:00100000:0.0:1746065133.130517:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263001600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00080000:1.0:1746065133.130523:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746065133.130527:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065133.130535:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5238 00000100:00100000:1.0:1746065133.130541:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263001728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065133.130543:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929fa000/0xad6b7ddc146beeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93166b expref: 10 pid: 12260 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065133.130549:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065133.130552:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929fa000/0xad6b7ddc146beeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93166b expref: 10 pid: 12260 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065133.130561:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 20 pid: 1880 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746065133.130571:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929fa000/0xad6b7ddc146beeb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93166b expref: 10 pid: 12260 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065133.130730:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 20 pid: 1880 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746065133.130741:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065133.130747:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97400/0xad6b7ddc146bf2a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93169c expref: 20 pid: 1880 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065133.130758:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.130762:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263001600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 245us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.130768:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5237 00000100:00100000:1.0:1746065133.130792:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263001728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 233us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.130797:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5238 00000100:00100000:0.0:1746065133.132084:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.132129:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001856 00000100:00100000:0.0:1746065133.132132:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.132134:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001856 00010000:00010000:1.0:1746065133.132151:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146bf69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316c6 expref: 32 pid: 13375 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065133.132167:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5239 00000100:00100000:1.0:1746065133.132171:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263001856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.132178:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.132186:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146bf69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316c6 expref: 32 pid: 13375 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065133.132194:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146bf69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316c6 expref: 32 pid: 13375 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065133.132205:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146bf69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9316c6 expref: 32 pid: 13375 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746065133.132212:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.132213:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.132218:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a9 expref: 31 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.132229:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a9 expref: 31 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.132250:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a9 expref: 31 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.132258:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263134080:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065133.133003:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.135134:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.144552:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.144640:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263002496 00000100:00100000:1.0:1746065133.144649:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263002496 00000100:00100000:1.0:1746065133.144704:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11900 00000100:00100000:1.0:1746065133.144711:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263002496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.144729:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.144744:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdb000/0xad6b7ddc146c2d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9318b0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.144842:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263134208:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065133.144933:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00002000:00010000:1.0:1746065133.147051:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065131 -> 1746065133 00002000:00010000:1.0:1746065133.147056:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065130 -> 1746065133 00002000:00010000:1.0:1746065133.147059:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065131 -> 1746065133 00000100:00100000:1.0:1746065133.147074:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263134208:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065133.147111:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdb000/0xad6b7ddc146c2d4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318b0 expref: 20 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.147128:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdb000/0xad6b7ddc146c2d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318b0 expref: 20 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.147152:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb000, rc 0) 00000100:00100000:1.0:1746065133.147184:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263002496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2473us (2640us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065133.147192:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11900 00000100:00100000:0.0:1746065133.150320:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.150362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.150420:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263002880 00000100:00100000:1.0:1746065133.150424:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263002880 00000100:00100000:1.0:1746065133.150452:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11901 00000100:00100000:1.0:1746065133.150458:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:31540:x1830881263002880:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065133.150471:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.150485:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc146c2db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9318b7 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.150504:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc146c106 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317a6 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.150511:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146c145 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317c9 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.150516:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.150517:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.150519:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc146c2db lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318b7 expref: 32 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.150545:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146c145 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317c9 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.150556:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146c145 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317c9 expref: 32 pid: 9550 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.150565:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263134336:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.150630:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc146c106 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317a6 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.150638:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc146c106 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9317a6 expref: 11 pid: 1880 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.150645:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263134464:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.150663:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00080000:0.0:1746065133.150706:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065133.150961:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.153902:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.153927:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263003264 00000100:00100000:1.0:1746065133.153933:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263003264 00000100:00100000:1.0:1746065133.153976:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13364 00000100:00100000:1.0:1746065133.153984:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+21:31544:x1830881263003264:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065133.154002:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.154016:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c2e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9318c5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.154074:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154086:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154106:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154117:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154122:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154126:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154197:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146c2fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154205:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146c2fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154210:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146c2fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065133.154217:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065133.154272:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154278:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154284:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154289:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154294:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.154297:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154303:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154312:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065133.154314:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065133.154317:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154321:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c2f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154333:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154337:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154341:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154345:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.154347:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154350:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154355:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f854200) 00010000:00010000:1.0:1746065133.154357:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065133.154359:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154363:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c2f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065133.154392:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c2e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318c5 expref: 24 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.154402:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146c2fe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318c5 expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.154408:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.154409:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065133.154412:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046c00, rc 0) 00000100:00100000:1.0:1746065133.154442:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+23:31544:x1830881263003264:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 459us (547us total) trans 8589935622 rc 0/0 00000100:00100000:1.0:1746065133.154448:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13364 00000100:00080000:1.0:1746065133.154469:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065133.154498:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263134336:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.154507:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263134464:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.154526:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc146c2db lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318b7 expref: 32 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.154536:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb000, rc 0) 00000100:00100000:0.0:1746065133.155158:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.155969:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:31540:x1830881263002880:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4099us (4195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.155976:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11901 00000100:00100000:0.0:1746065133.162060:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263134720:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065133.162078:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.162131:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263003520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5053us (5105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.162141:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5241 00000100:00080000:0.0:1746065133.162240:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065133.164314:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.178607:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.178664:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263004160 00000100:00100000:1.0:1746065133.178672:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263004160 00000100:00100000:1.0:1746065133.178718:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11903 00000100:00100000:1.0:1746065133.178725:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+19:31544:x1830881263004160:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065133.178739:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.178752:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9318cc expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.178806:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.178814:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146c2bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93189b expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.178820:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.178822:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.178825:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->3842047] (req 3424256->3842047) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.178848:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146c2bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93189b expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.178858:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146c2bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93189b expref: 20 pid: 9549 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.178869:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263134848:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.179197:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.179206:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 28 pid: 9549 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.179214:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263134976:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.179233:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.184581:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263134848:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.184593:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263134976:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.184618:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->3842047] (req 3424256->3842047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.184849:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065133.186069:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047400, rc 0) 00000100:00100000:1.0:1746065133.186222:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+21:31544:x1830881263004160:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7496us (7619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.186229:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11903 00000100:00100000:0.0:1746065133.186390:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.186410:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263004416 00000100:00100000:0.0:1746065133.186414:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263004416 00010000:00010000:0.0:1746065133.186430:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 29 pid: 9549 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065133.186456:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5243 00000100:00100000:0.0:1746065133.186462:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263004416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065133.186469:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065133.187710:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 29 pid: 9549 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.187720:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 29 pid: 9549 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.187732:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146c2b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931894 expref: 29 pid: 9549 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.187768:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.187770:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.187791:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.187798:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.187822:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.187831:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263135104:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065133.188115:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.190927:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.195650:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.204067:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.249243:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.249341:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263005312 00000100:00100000:1.0:1746065133.249348:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263005312 00000100:00080000:0.0:1746065133.249429:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065133.249472:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13365 00000100:00100000:1.0:1746065133.249480:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31550:x1830881263005312:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065133.249498:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.249512:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146c313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9318d3 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.249563:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.249620:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.249630:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.249640:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.249645:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.249649:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.249702:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.249712:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931863 expref: 43 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.249718:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.249743:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931863 expref: 43 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.249753:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931863 expref: 43 pid: 7231 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.249764:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263135232:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.250361:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.251924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.252407:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263135232:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.252424:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065133.255163:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263005696 00000100:00100000:0.0:1746065133.255169:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263005696 00010000:00010000:0.0:1746065133.255195:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931863 expref: 45 pid: 7231 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065133.255223:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5244 00000100:00100000:0.0:1746065133.255229:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263005696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065133.255239:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065133.255244:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931863 expref: 45 pid: 7231 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.255252:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931863 expref: 45 pid: 7231 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.255269:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146c25d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931863 expref: 45 pid: 7231 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.255635:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065133.255640:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065133.255649:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065133.255655:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065133.255682:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.255713:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263005696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 484us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.255719:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5244 00010000:00010000:1.0:1746065133.255874:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255881:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065133.255920:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00000004:00200000:1.0:1746065133.255924:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065133.255937:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255946:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255955:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255960:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255965:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255970:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255975:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.255978:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255984:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.255992:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065133.255994:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065133.255997:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256002:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c31a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256013:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256018:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256023:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256026:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.256028:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256032:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256037:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f854400) 00010000:00010000:1.0:1746065133.256038:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065133.256040:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256044:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.256067:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146c313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318d3 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.256077:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318d3 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.256083:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.256097:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065133.256099:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046a00, rc 0) 00000100:00100000:1.0:1746065133.256122:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31550:x1830881263005312:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 6643us (6888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.256129:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13365 00000100:00100000:0.0:1746065133.261596:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263135616:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065133.261619:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc146c34b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318f6 expref: 13 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.261629:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc146c34b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318f6 expref: 13 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.261643:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60800, rc 0) 00000100:00100000:0.0:1746065133.261667:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263006336:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1949us (2426us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065133.261674:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11908 00000100:00100000:0.0:1746065133.261710:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263135360:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065133.261722:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc146c32f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318da expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.261730:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc146c32f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318da expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.261737:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61000, rc 0) 00000100:00100000:0.0:1746065133.261751:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263005824:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 2406us (2608us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065133.261756:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11904 00000100:00100000:1.0:1746065133.266602:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263006720 00000100:00100000:1.0:1746065133.266609:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263006720 00000100:00100000:1.0:1746065133.266645:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13366 00000100:00100000:1.0:1746065133.266651:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31550:x1830881263006720:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065133.266666:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.266680:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931904 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.266764:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146c360 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.266795:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318d3 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.266802:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146c360 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.266826:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318d3 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.266841:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318d3 expref: 10 pid: 7203 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.266850:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263135744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.267912:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.273597:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065133.274169:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146c328 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318d3 expref: 10 pid: 7203 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.274196:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263135744:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.274210:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146c360 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.274217:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146c360 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.274221:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146c360 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065133.274235:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065133.274334:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931904 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.274345:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146c360 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931904 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.274351:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.274353:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065133.274355:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047000, rc 0) 00000100:00100000:1.0:1746065133.274389:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:31550:x1830881263006720:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7737us (7866us total) trans 8589935626 rc 0/0 00000100:00100000:1.0:1746065133.274394:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13366 00000100:00100000:0.0:1746065133.282046:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.282138:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.282208:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263007104 00000100:00100000:1.0:1746065133.282215:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263007104 00000100:00100000:1.0:1746065133.282263:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263007360 00000100:00100000:1.0:1746065133.282265:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263007360 00000100:00100000:1.0:1746065133.282281:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13367 00000100:00100000:1.0:1746065133.282287:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+24:31553:x1830881263007104:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.282304:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.282320:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146c36e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93190b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.282377:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282387:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282395:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282405:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282410:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282414:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282483:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146c383 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282492:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146c383 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282497:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146c383 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065133.282504:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065133.282556:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282561:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282566:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282571:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282576:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.282579:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282584:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282593:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065133.282595:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065133.282598:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282603:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146c375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282628:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282633:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282637:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282641:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.282643:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282648:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282653:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f854d00) 00010000:00010000:1.0:1746065133.282655:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065133.282657:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282661:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046e00/0xad6b7ddc146c37c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282688:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146c36e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93190b expref: 27 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.282697:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146c383 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93190b expref: 26 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.282703:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.282705:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065133.282707:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046800, rc 0) 00000100:00100000:1.0:1746065133.282742:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+26:31553:x1830881263007104:12345-192.168.202.27@tcp:101:cat.0 Request processed in 455us (704us total) trans 8589935627 rc 0/0 00000100:00100000:1.0:1746065133.282748:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13367 00000100:00100000:1.0:1746065133.282761:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13368 00000100:00100000:1.0:1746065133.282765:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:31550:x1830881263007360:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065133.282797:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.282799:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065133.282809:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146c360 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931904 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.282816:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.282819:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065133.282823:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c391 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931912 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.282865:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda600/0xad6b7ddc146c398 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282871:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda600/0xad6b7ddc146c398 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065133.282877:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda600/0xad6b7ddc146c398 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065133.282883:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065133.282916:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146c391 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931912 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.282929:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda600/0xad6b7ddc146c398 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931912 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.282934:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.282936:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065133.282938:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:1.0:1746065133.282953:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:31550:x1830881263007360:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 187us (815us total) trans 8589935628 rc 0/0 00000100:00100000:1.0:1746065133.282958:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13368 00000100:00100000:0.0:1746065133.284896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.284933:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.284972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.287617:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.287652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.288235:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.288636:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263008256 00000100:00100000:1.0:1746065133.288640:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263008256 00000100:00100000:0.0:1746065133.288667:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11910 00000100:00100000:0.0:1746065133.288675:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263008000:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065133.288706:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.288720:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a9 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.288727:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065133.288728:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065133.288730:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.288754:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a9 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.288765:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146c2cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 507904->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318a9 expref: 27 pid: 10219 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065133.288791:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263135872:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065133.288844:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.288869:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.289741:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.290485:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11913 00000100:00100000:1.0:1746065133.290494:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263008384:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065133.290515:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.290526:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146c2aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931886 expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.290533:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146c344 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318ef expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.290539:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c2b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93188d expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.290544:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.290546:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.290548:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.290563:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c2b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93188d expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.290570:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c2b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93188d expref: 27 pid: 3067 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.290578:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263136512:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.290605:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146c344 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318ef expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.290612:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146c344 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318ef expref: 11 pid: 3068 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746065133.290618:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263136640:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065133.290636:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146c2aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931886 expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.290643:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146c2aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931886 expref: 18 pid: 3067 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.290649:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263136768:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065133.290661:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.291023:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.291039:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.291050:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.291110:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263135872:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065133.291129:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.291756:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11916 00000100:00100000:1.0:1746065133.291763:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263008896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.291797:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.291811:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146c3d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931927 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.292153:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263137280:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065133.292171:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.298053:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.298203:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.298216:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009152 00000100:00100000:1.0:1746065133.298220:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009152 00002000:00100000:1.0:1746065133.298238:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1490943) req@ffff88009856ea00 x1830881263009152/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.298245:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856ea00 with x1830881263009152 ext(1048576->1490943) 00010000:00010000:1.0:1746065133.298250:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc146c2db lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318b7 expref: 31 pid: 10219 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.298258:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc146c2db lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318b7 expref: 31 pid: 10219 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746065133.298263:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856ea00 00000100:00100000:0.0:1746065133.298305:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263136512:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065133.298314:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263136640:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065133.298320:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263136768:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065133.298334:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.298370:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.298429:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.298611:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.298635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.298648:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.298688:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.298728:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263136384:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065133.298743:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.298791:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.298812:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.298838:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.299074:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009792 00000100:00100000:1.0:1746065133.299077:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009792 00002000:00100000:1.0:1746065133.299099:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3424256->3842047) req@ffff88009adf7100 x1830881263009792/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.299106:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7100 with x1830881263009792 ext(3424256->3842047) 00010000:00010000:1.0:1746065133.299111:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 20 pid: 10219 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.299118:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 20 pid: 10219 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746065133.299123:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009adf7100 00000100:00100000:1.0:1746065133.299132:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1116 00000100:00100000:1.0:1746065133.299137:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263009152:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065133.299214:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1117 00000100:00100000:1.0:1746065133.299218:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263009792:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065133.299276:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263137280:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065133.299290:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146c3d7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931927 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.299298:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146c3d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931927 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.299307:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e890c00, rc 0) 00000100:00100000:1.0:1746065133.299321:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263008896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7559us (8281us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065133.299326:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11916 00010000:00010000:0.0:1746065133.300970:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.300977:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.300992:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.300998:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301004:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301008:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065133.301012:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301018:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301026:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301031:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc146c3bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.301068:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263008256:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 10912us (12834us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.301075:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11912 00010000:00010000:0.0:1746065133.301108:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301115:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301126:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301131:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301136:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301140:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065133.301142:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301147:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301154:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.301159:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6600/0xad6b7ddc146c3c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.301190:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263008384:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 10698us (12320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.301196:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11913 00000100:00100000:1.0:1746065133.309915:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.310612:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263009152:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11473us (12407us total) trans 17179873239 rc 0/0 00000100:00100000:1.0:1746065133.310621:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1116 00002000:00100000:1.0:1746065133.310627:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1490943) req@ffff88009856ea00 x1830881263009152/t17179873239(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.310634:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856ea00 with x1830881263009152 ext(1048576->1490943) 00010000:00010000:1.0:1746065133.310640:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc146c2db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318b7 expref: 31 pid: 10219 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.310648:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc146c2db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318b7 expref: 31 pid: 10219 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746065133.310652:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856ea00 00000100:00100000:1.0:1746065133.315986:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263009792:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 16758us (17548us total) trans 21474840676 rc 0/0 00000100:00100000:1.0:1746065133.315997:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1117 00002000:00100000:1.0:1746065133.316006:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3424256->3842047) req@ffff88009adf7100 x1830881263009792/t21474840676(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.316014:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7100 with x1830881263009792 ext(3424256->3842047) 00010000:00010000:1.0:1746065133.316022:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 21 pid: 10219 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.316033:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 21 pid: 10219 timeout: 829 lvb_type: 0 00002000:00010000:1.0:1746065133.316038:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009adf7100 00000100:00100000:0.0:1746065133.318502:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.319102:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.319821:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.319832:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263010944 00000100:00100000:0.0:1746065133.319835:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263010944 00010000:00010000:0.0:1746065133.319848:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 21 pid: 10219 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065133.319861:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5257 00000100:00100000:0.0:1746065133.319866:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263010944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065133.319871:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065133.319878:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 21 pid: 10219 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.319885:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 21 pid: 10219 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.319895:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146c30c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3424256->3842047) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9318cc expref: 21 pid: 10219 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.319905:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.319907:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.319910:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc146c3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.319917:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc146c3c9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.319933:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.319959:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263010944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.319964:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5257 00010000:00010000:1.0:1746065133.320345:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320352:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320362:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320367:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320372:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320377:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84a800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065133.320379:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320384:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320392:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.320393:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.320397:0:3068:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc146c3e5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93192e expref: 19 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320403:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc146c3e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93192e expref: 19 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.320430:0:3068:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc146c3e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93192e expref: 19 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.320440:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263137664:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065133.320478:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.323820:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263137664:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065133.323842:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.323849:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c3ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.324023:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263008000:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 35347us (36410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.324031:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11910 00000100:00100000:0.0:1746065133.325159:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.328733:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.329241:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.329429:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263011456 00000100:00100000:1.0:1746065133.329435:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263011456 00002000:00100000:1.0:1746065133.329470:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009adf5f80 x1830881263011456/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.329478:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5f80 with x1830881263011456 ext(0->1048575) 00002000:00010000:1.0:1746065133.329482:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf5f80 00000100:00100000:1.0:1746065133.329499:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3108 00000100:00100000:1.0:1746065133.329506:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263011456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.331269:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.333835:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.334244:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.334676:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.339688:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263011456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10178us (10957us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065133.339724:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3108 00002000:00100000:1.0:1746065133.339734:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009adf5f80 x1830881263011456/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.339743:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5f80 with x1830881263011456 ext(0->1048575) 00002000:00010000:1.0:1746065133.339747:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf5f80 00000100:00100000:1.0:1746065133.341575:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263138432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.341617:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065133.341659:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263138432 00000100:00100000:1.0:1746065133.341664:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263138432 00000100:00100000:1.0:1746065133.341699:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11919 00000100:00100000:1.0:1746065133.341704:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263138432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.341825:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3759:x1830881263138432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (208us total) trans 17179873240 rc 0/0 00000100:00100000:1.0:1746065133.341831:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11919 00000100:00100000:1.0:1746065133.341841:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263138560 00000100:00100000:1.0:1746065133.341843:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263138560 00000100:00100000:1.0:1746065133.341857:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139072 00000100:00100000:1.0:1746065133.341859:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139072 00000100:00100000:1.0:1746065133.341867:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139584 00000100:00100000:1.0:1746065133.341868:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139584 00000100:00100000:1.0:1746065133.341877:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11920 00000100:00100000:1.0:1746065133.341881:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3760:x1830881263138560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065133.341934:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065133.341936:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065133 -> 1746065133 00002000:00010000:1.0:1746065133.341939:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065133 -> 1746065130 00002000:00010000:1.0:1746065133.341941:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065133 -> 1746065133 00002000:00010000:1.0:1746065133.341943:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:1.0:1746065133.341963:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263138560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (158us total) trans 21474840677 rc 0/0 00000100:00100000:1.0:1746065133.341968:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11920 00000100:00100000:1.0:1746065133.341977:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11922 00000100:00100000:1.0:1746065133.341981:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263139584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.342026:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263139584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (171us total) trans 21474840679 rc 0/0 00000100:00100000:1.0:1746065133.342030:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11922 00000100:00100000:1.0:1746065133.342039:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11924 00000100:00100000:1.0:1746065133.342042:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3760:x1830881263139456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065133.342078:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:1.0:1746065133.342080:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065133.342082:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065133.342093:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065133.342095:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:1.0:1746065133.342113:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263139456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (211us total) trans 21474840680 rc 0/0 00000100:00100000:1.0:1746065133.342117:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11924 00000100:00080000:1.0:1746065133.342131:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065133.342134:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065133.342598:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139200 00000100:00100000:0.0:1746065133.342601:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139200 00000100:00100000:0.0:1746065133.342611:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139712 00000100:00100000:0.0:1746065133.342613:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139712 00000100:00100000:0.0:1746065133.342620:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11925 00000100:00100000:0.0:1746065133.342624:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263138304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065133.342682:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881263138304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (470us total) trans 17179873241 rc 0/0 00000100:00100000:0.0:1746065133.342686:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11925 00000100:00100000:0.0:1746065133.342696:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11926 00000100:00100000:0.0:1746065133.342700:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263138816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065133.342734:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065133.342736:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065133.342737:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065133.342739:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065133.342740:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:0.0:1746065133.342756:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881263138816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (519us total) trans 17179873242 rc 0/0 00000100:00100000:0.0:1746065133.342760:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11926 00000100:00100000:0.0:1746065133.342769:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11927 00000100:00100000:0.0:1746065133.342787:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263139328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065133.342823:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065133.342825:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065133.342826:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065133.342828:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065133.342830:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746065133.342845:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263139328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (588us total) trans 21474840681 rc 0/0 00000100:00100000:0.0:1746065133.342849:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11927 00000100:00100000:0.0:1746065133.342857:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11928 00000100:00100000:0.0:1746065133.342861:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263139840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065133.342893:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:0.0:1746065133.342895:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065133.342896:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065133.342898:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065133.342900:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:0.0:1746065133.342914:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263139840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (639us total) trans 21474840682 rc 0/0 00000100:00100000:0.0:1746065133.342920:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11928 00000100:00100000:0.0:1746065133.342928:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11929 00000100:00100000:0.0:1746065133.342932:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263139200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065133.342988:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263139200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (669us total) trans 21474840683 rc 0/0 00000100:00100000:0.0:1746065133.342993:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11929 00000100:00100000:0.0:1746065133.343003:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11930 00000100:00100000:0.0:1746065133.343007:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263139712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065133.343040:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065133.343042:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065133.343043:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065133.343045:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065133.343046:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:0.0:1746065133.343060:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263139712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (725us total) trans 21474840684 rc 0/0 00000100:00100000:0.0:1746065133.343064:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11930 00000100:00100000:0.0:1746065133.343081:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263139968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065133.343110:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065133.343131:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873234 gen 2 00000004:00080000:0.0:1746065133.343134:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a7a680, transno 17179873134 00000004:00080000:0.0:1746065133.343139:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a79c00, transno 17179873135 00000004:00080000:0.0:1746065133.343141:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a7bb80, transno 17179873136 00000004:00080000:0.0:1746065133.343143:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78e00, transno 17179873137 00000004:00080000:0.0:1746065133.343145:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a79500, transno 17179873138 00000004:00080000:0.0:1746065133.343146:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78380, transno 17179873139 00000004:00080000:0.0:1746065133.343148:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a79880, transno 17179873140 00000004:00080000:0.0:1746065133.343150:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78000, transno 17179873141 00000004:00080000:0.0:1746065133.343152:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf4700, transno 17179873142 00000004:00080000:0.0:1746065133.343154:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf4e00, transno 17179873143 00000004:00080000:0.0:1746065133.343157:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf5500, transno 17179873144 00000004:00080000:0.0:1746065133.343158:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf6300, transno 17179873145 00000004:00080000:0.0:1746065133.343160:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf5880, transno 17179873146 00000004:00080000:0.0:1746065133.343162:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf6680, transno 17179873147 00000004:00080000:0.0:1746065133.343163:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf7100, transno 17179873148 00000004:00080000:0.0:1746065133.343165:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880076cf7480, transno 17179873149 00000004:00080000:0.0:1746065133.343167:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221880, transno 17179873160 00000004:00080000:0.0:1746065133.343169:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223100, transno 17179873161 00000004:00080000:0.0:1746065133.343171:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222a00, transno 17179873162 00000004:00080000:0.0:1746065133.343173:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223b80, transno 17179873163 00000004:00080000:0.0:1746065133.343174:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222300, transno 17179873164 00000004:00080000:0.0:1746065133.343176:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221180, transno 17179873165 00000004:00080000:0.0:1746065133.343177:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222680, transno 17179873166 00000004:00080000:0.0:1746065133.343179:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135220a80, transno 17179873167 00000004:00080000:0.0:1746065133.343181:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dc380, transno 17179873168 00000004:00080000:0.0:1746065133.343183:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dc700, transno 17179873169 00000004:00080000:0.0:1746065133.343184:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6df100, transno 17179873170 00000004:00080000:0.0:1746065133.343186:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6ddf80, transno 17179873171 00000004:00080000:0.0:1746065133.343188:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dca80, transno 17179873172 00000004:00080000:0.0:1746065133.343190:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edad880, transno 17179873173 00000004:00080000:0.0:1746065133.343192:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf800, transno 17179873174 00000004:00080000:0.0:1746065133.343194:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edad500, transno 17179873175 00000004:00080000:0.0:1746065133.343195:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957db800, transno 17179873188 00000004:00080000:0.0:1746065133.343197:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da680, transno 17179873189 00000004:00080000:0.0:1746065133.343199:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d8700, transno 17179873190 00000004:00080000:0.0:1746065133.343201:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9180, transno 17179873191 00000004:00080000:0.0:1746065133.343202:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9f80, transno 17179873192 00000004:00080000:0.0:1746065133.343204:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da300, transno 17179873193 00000004:00080000:0.0:1746065133.343206:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d8e00, transno 17179873194 00000004:00080000:0.0:1746065133.343208:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d8000, transno 17179873195 00000004:00080000:0.0:1746065133.343210:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856c380, transno 17179873200 00000004:00080000:0.0:1746065133.343212:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f800, transno 17179873201 00000004:00080000:0.0:1746065133.343213:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f100, transno 17179873202 00000004:00080000:0.0:1746065133.343215:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856e300, transno 17179873203 00000004:00080000:0.0:1746065133.343217:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856ed80, transno 17179873204 00000004:00080000:0.0:1746065133.343219:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856ca80, transno 17179873205 00000004:00080000:0.0:1746065133.343220:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856e680, transno 17179873206 00000004:00080000:0.0:1746065133.343222:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856d880, transno 17179873207 00000004:00080000:0.0:1746065133.343224:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577df80, transno 17179873208 00000004:00080000:0.0:1746065133.343225:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f480, transno 17179873209 00000004:00080000:0.0:1746065133.343227:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577d180, transno 17179873210 00000004:00080000:0.0:1746065133.343228:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221500, transno 17179873211 00000004:00080000:0.0:1746065133.343229:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577e680, transno 17179873212 00000004:00080000:0.0:1746065133.343231:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f480, transno 17179873213 00000004:00080000:0.0:1746065133.343233:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ce00, transno 17179873214 00000004:00080000:0.0:1746065133.343235:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f100, transno 17179873215 00000004:00080000:0.0:1746065133.343236:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1f80, transno 17179873219 00000004:00080000:0.0:1746065133.343238:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f2300, transno 17179873220 00000004:00080000:0.0:1746065133.343240:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0700, transno 17179873221 00000004:00080000:0.0:1746065133.343241:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0000, transno 17179873222 00000004:00080000:0.0:1746065133.343243:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1180, transno 17179873223 00000004:00080000:0.0:1746065133.343245:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3100, transno 17179873224 00000004:00080000:0.0:1746065133.343246:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f2d80, transno 17179873225 00000004:00080000:0.0:1746065133.343248:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0a80, transno 17179873226 00000004:00080000:0.0:1746065133.343250:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fc700, transno 17179873227 00000004:00080000:0.0:1746065133.343251:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3100, transno 17179873228 00000004:00080000:0.0:1746065133.343253:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c000, transno 17179873229 00000004:00080000:0.0:1746065133.343255:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0000, transno 17179873230 00000004:00080000:0.0:1746065133.343257:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd180, transno 17179873231 00000004:00080000:0.0:1746065133.343259:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3480, transno 17179873232 00000004:00080000:0.0:1746065133.343261:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd500, transno 17179873233 00000004:00080000:0.0:1746065133.343262:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1880, transno 17179873234 00000100:00100000:0.0:1746065133.343267:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009adf5c00 x1830881263138432/t17179873240(17179873240) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065149 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065133.343274:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf5c00/2, rc 0, transno 17179873240 00000100:00100000:0.0:1746065133.343278:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263138432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065133.343284:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065133.343288:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263140096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065133.343302:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065133.343317:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139968 00000100:00100000:0.0:1746065133.343320:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139968 00000100:00100000:0.0:1746065133.343330:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140096 00000100:00100000:0.0:1746065133.343332:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140096 00000100:00100000:0.0:1746065133.343338:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11931 00000100:00100000:0.0:1746065133.343341:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3759:x1830881263139968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065133.343395:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263139968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (284us total) trans 17179873243 rc 0/0 00000100:00100000:0.0:1746065133.343399:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11931 00000100:00100000:0.0:1746065133.343408:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11932 00000100:00100000:0.0:1746065133.343412:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3759:x1830881263140096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065133.343455:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263140096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (151us total) trans 17179873244 rc 0/0 00000100:00100000:0.0:1746065133.343459:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11932 00000004:00080000:0.0:1746065133.343476:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e10380/2, rc 0, transno 17179873244 00000100:00100000:0.0:1746065133.343479:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263140096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065133.343486:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc1c00/2, rc 0, transno 17179873243 00000100:00100000:0.0:1746065133.343488:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263139968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065133.343726:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 72 done 00000100:00100000:1.0:1746065133.345821:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140224 00000100:00100000:1.0:1746065133.345826:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140224 00000100:00100000:1.0:1746065133.345843:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140352 00000100:00100000:1.0:1746065133.345845:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140352 00000100:00100000:1.0:1746065133.345855:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11934 00000100:00100000:1.0:1746065133.345859:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263140224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.345931:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263140224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (325us total) trans 17179873246 rc 0/0 00000100:00100000:1.0:1746065133.345936:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11934 00000100:00100000:1.0:1746065133.345946:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11935 00000100:00100000:1.0:1746065133.345950:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263140352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.346003:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3761:x1830881263140352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (210us total) trans 21474840685 rc 0/0 00000100:00100000:1.0:1746065133.346007:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11935 00000100:00100000:1.0:1746065133.346660:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.346673:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263012352 00000100:00100000:0.0:1746065133.346677:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263012352 00000100:00100000:0.0:1746065133.347295:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11936 00000100:00100000:0.0:1746065133.347301:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:31553:x1830881263012352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.347309:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.347320:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c51b000/0xad6b7ddc146c40f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93193c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065133.347334:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6ed, atime: 0x6812d6ec, ctime: 0x6812d6ed, blocks: 0x808 00010000:00010000:0.0:1746065133.347344:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.347346:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.347351:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c51b000/0xad6b7ddc146c40f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93193c expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.347360:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c51b000/0xad6b7ddc146c40f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93193c expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.347366:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51b000, rc 0) 00000100:00100000:0.0:1746065133.347395:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+10:31553:x1830881263012352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 94us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.347400:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11936 00000100:00100000:0.0:1746065133.351665:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.351883:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.353431:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.363249:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.364311:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.366540:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263013120 00000100:00100000:1.0:1746065133.366547:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263013120 00002000:00100000:1.0:1746065133.366581:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880136a7bb80 x1830881263013120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.366590:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7bb80 with x1830881263013120 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.366594:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7bb80 00000100:00100000:1.0:1746065133.366635:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3109 00000100:00100000:1.0:1746065133.366643:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263013120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.379622:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.379658:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.379683:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.379697:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.379721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.380586:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.380649:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263013760 00000100:00100000:1.0:1746065133.380653:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263013760 00000100:00100000:1.0:1746065133.380672:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11942 00000100:00100000:1.0:1746065133.380676:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263013760:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065133.380683:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.380690:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146c45c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931974 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065133.380699:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 4813376, mtime: 0x6812d6ed, atime: 0x6812d6ed, ctime: 0x6812d6ed, blocks: 0x14c0 00010000:00010000:1.0:1746065133.380707:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.380708:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.380712:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146c45c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931974 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.380720:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146c45c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931974 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065133.380726:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046800, rc 0) 00000100:00100000:1.0:1746065133.380742:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263013760:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 66us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.380747:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11942 00000100:00100000:1.0:1746065133.381437:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263013120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14794us (17126us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065133.381443:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3109 00002000:00100000:1.0:1746065133.381450:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880136a7bb80 x1830881263013120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.381457:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7bb80 with x1830881263013120 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.381461:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7bb80 00000100:00100000:0.0:1746065133.403231:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.403277:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.403350:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263014016 00000100:00100000:1.0:1746065133.403357:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263014016 00000100:00100000:1.0:1746065133.404806:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11943 00000100:00100000:1.0:1746065133.404817:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:31553:x1830881263014016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.404830:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.404842:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146c486 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931982 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.404862:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.404863:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.404870:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146c486 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931982 expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.404882:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146c486 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931982 expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.404890:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:1.0:1746065133.404941:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+11:31553:x1830881263014016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 125us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.404946:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11943 00000100:00100000:0.0:1746065133.412292:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.415803:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263014656 00000100:00100000:1.0:1746065133.415809:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263014656 00002000:00100000:1.0:1746065133.415841:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880099bd7480 x1830881263014656/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.415849:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7480 with x1830881263014656 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.415853:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd7480 00000100:00100000:1.0:1746065133.415865:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3110 00000100:00100000:1.0:1746065133.415871:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263014656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.416737:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.425411:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.425449:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.425473:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.425496:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.425508:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.425526:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.425550:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015168 00000100:00100000:0.0:1746065133.425553:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015168 00000100:00100000:0.0:1746065133.425567:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015424 00000100:00100000:0.0:1746065133.425569:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015424 00000100:00100000:0.0:1746065133.425578:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015680 00000100:00100000:0.0:1746065133.425579:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015680 00000100:00100000:0.0:1746065133.427600:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11945 00000100:00100000:0.0:1746065133.427612:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263015168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.427625:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.427637:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146c4c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9319a5 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.427660:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427661:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427668:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146c4c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319a5 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427679:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146c4c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319a5 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427686:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:0.0:1746065133.427714:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263015168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 106us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.427719:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11945 00000100:00100000:0.0:1746065133.427733:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11946 00000100:00100000:0.0:1746065133.427738:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263015296:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.427744:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.427750:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146c4cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9319ac expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.427760:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427761:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427764:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146c4cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319ac expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427785:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146c4cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319ac expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427796:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a600, rc 0) 00000100:00100000:0.0:1746065133.427810:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263015296:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.427815:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11946 00000100:00100000:0.0:1746065133.427825:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11947 00000100:00100000:0.0:1746065133.427829:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263015424:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.427835:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.427842:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc146c4d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9319b3 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.427850:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427852:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427855:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc146c4d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319b3 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427863:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc146c4d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319b3 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427868:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d600, rc 0) 00000100:00100000:0.0:1746065133.427879:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263015424:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.427883:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11947 00000100:00100000:0.0:1746065133.427890:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11948 00000100:00100000:0.0:1746065133.427895:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263015552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.427902:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.427907:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc146c4da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9319ba expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.427916:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427917:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427921:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc146c4da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319ba expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427927:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc146c4da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319ba expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427932:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a000, rc 0) 00000100:00100000:0.0:1746065133.427942:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263015552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 48us (2433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.427946:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11948 00000100:00100000:0.0:1746065133.427954:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11949 00000100:00100000:0.0:1746065133.427958:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263015680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.427962:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.427968:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146c4e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9319c1 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.427975:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427977:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.427979:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146c4e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319c1 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427986:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146c4e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319c1 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.427992:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d000, rc 0) 00000100:00100000:0.0:1746065133.428004:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263015680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 47us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.428009:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11949 00000100:00100000:0.0:1746065133.428118:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.429958:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263014656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14082us (14246us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065133.429969:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3110 00002000:00100000:1.0:1746065133.429975:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880099bd7480 x1830881263014656/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.429983:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7480 with x1830881263014656 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.429987:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd7480 00000100:00100000:0.0:1746065133.431642:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.434100:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.434422:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.434481:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016064 00000100:00100000:1.0:1746065133.434488:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016064 00010000:00010000:1.0:1746065133.434518:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146c494 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931990 expref: 29 pid: 9571 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.434547:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016320 00000100:00100000:1.0:1746065133.434549:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016320 00010000:00010000:1.0:1746065133.434559:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc146c424 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93194a expref: 8 pid: 9571 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065133.434911:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.435704:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016448 00000100:00100000:1.0:1746065133.435708:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016448 00010000:00010000:1.0:1746065133.435721:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45800/0xad6b7ddc146c432 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931951 expref: 9 pid: 7204 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.435736:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5263 00000100:00100000:1.0:1746065133.435741:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263016064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.435749:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.435753:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146c494 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931990 expref: 30 pid: 9571 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.435760:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146c494 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931990 expref: 30 pid: 9571 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.435788:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146c494 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931990 expref: 30 pid: 9571 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.435799:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.435802:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c4ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065133.435806:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c4ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065133.435810:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.435826:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263016064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.435831:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5263 00000100:00100000:1.0:1746065133.435841:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5265 00000100:00100000:1.0:1746065133.435845:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263016448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.435850:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.435853:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45800/0xad6b7ddc146c432 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931951 expref: 9 pid: 7204 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.435860:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45800/0xad6b7ddc146c432 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931951 expref: 9 pid: 7204 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.435868:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45800/0xad6b7ddc146c432 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931951 expref: 8 pid: 7204 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.436041:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.436046:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc146c4f6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319cf expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.436052:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.436070:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263016448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 224us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.436075:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5265 00000100:00100000:1.0:1746065133.441067:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.441728:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016576 00000100:00100000:0.0:1746065133.441737:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016576 00000100:00100000:0.0:1746065133.441767:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11950 00000100:00100000:0.0:1746065133.441796:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+20:31553:x1830881263016576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.441812:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.441826:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1b000/0xad6b7ddc146c4fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9319d6 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.441845:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.441846:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.441853:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1b000/0xad6b7ddc146c4fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319d6 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.441864:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1b000/0xad6b7ddc146c4fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319d6 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.441872:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b000, rc 0) 00000100:00100000:0.0:1746065133.441916:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:31553:x1830881263016576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 142us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.441921:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11950 00000100:00100000:1.0:1746065133.443578:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263140992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.443617:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065133.443651:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263141504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.443665:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065133.443674:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065133.443678:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263141120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.443689:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065133.443707:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263141632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.443719:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065133.443735:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140992 00000100:00100000:1.0:1746065133.443739:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140992 00000100:00100000:1.0:1746065133.443766:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141504 00000100:00100000:1.0:1746065133.443768:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141504 00000100:00100000:1.0:1746065133.443792:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141120 00000100:00100000:1.0:1746065133.443793:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141120 00000100:00100000:1.0:1746065133.443804:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11951 00000100:00100000:1.0:1746065133.443808:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3759:x1830881263140992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065133.443892:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065133.443894:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065133 -> 1746065133 00002000:00010000:1.0:1746065133.443897:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065133.443899:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065133 -> 1746065133 00002000:00010000:1.0:1746065133.443901:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:1.0:1746065133.443922:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3759:x1830881263140992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (305us total) trans 21474840687 rc 0/0 00000100:00100000:1.0:1746065133.443927:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11951 00000100:00100000:1.0:1746065133.443938:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11954 00000100:00100000:1.0:1746065133.443942:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881263141632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.443986:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881263141632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (267us total) trans 21474840689 rc 0/0 00000100:00100000:1.0:1746065133.443991:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11954 00000004:00080000:1.0:1746065133.444016:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd6a00/2, rc 0, transno 21474840688 00000100:00100000:1.0:1746065133.444028:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263141120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065133.444036:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf5880/2, rc 0, transno 21474840689 00000100:00100000:1.0:1746065133.444038:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263141632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065133.444044:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4380/2, rc 0, transno 21474840687 00000100:00100000:1.0:1746065133.444046:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263140992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.444924:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142528 00000100:00100000:1.0:1746065133.444927:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142528 00000100:00100000:1.0:1746065133.444941:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143040 00000100:00100000:1.0:1746065133.444943:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143040 00000100:00100000:1.0:1746065133.444951:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142912 00000100:00100000:1.0:1746065133.444952:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142912 00000100:00100000:1.0:1746065133.445250:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11960 00000100:00100000:1.0:1746065133.445256:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263143040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.445309:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3762:x1830881263143040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (418us total) trans 17179873249 rc 0/0 00000100:00100000:1.0:1746065133.445315:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11960 00000100:00100000:1.0:1746065133.445323:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11962 00000100:00100000:1.0:1746065133.445327:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263142912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.445369:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263142912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (434us total) trans 17179873251 rc 0/0 00000100:00100000:1.0:1746065133.445374:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11962 00000100:00100000:1.0:1746065133.445385:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263142144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065133.445553:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142272 00000100:00100000:0.0:1746065133.445556:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142272 00000100:00100000:1.0:1746065133.447357:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142784 00000100:00100000:1.0:1746065133.447361:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142784 00000100:00100000:1.0:1746065133.447383:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11963 00000100:00100000:1.0:1746065133.447389:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3760:x1830881263142272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065133.447459:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065133.447461:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065133 -> 1746065133 00002000:00010000:1.0:1746065133.447463:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065130 -> 1746065130 00002000:00010000:1.0:1746065133.447465:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065133 -> 1746065133 00002000:00010000:1.0:1746065133.447467:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065133.447490:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3760:x1830881263142272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (2094us total) trans 17179873252 rc 0/0 00000100:00100000:0.0:1746065133.447493:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11964 00000100:00100000:1.0:1746065133.447497:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11963 00000100:00100000:0.0:1746065133.447499:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3760:x1830881263142784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.447515:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065133.447528:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263142656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.447545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065133.447552:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3760:x1830881263142784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (1306us total) trans 17179873253 rc 0/0 00000100:00100000:1.0:1746065133.447556:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263143168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065133.447557:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11964 00000100:00100000:0.0:1746065133.447566:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142144 00000100:00100000:1.0:1746065133.447568:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065133.447568:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142144 00000100:00100000:0.0:1746065133.447576:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142656 00000100:00100000:0.0:1746065133.447577:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142656 00000100:00100000:1.0:1746065133.447582:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143168 00000100:00100000:1.0:1746065133.447585:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143168 00000100:00100000:0.0:1746065133.447585:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11965 00000100:00100000:0.0:1746065133.447588:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263142144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.447593:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11966 00000100:00100000:1.0:1746065133.447597:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263142656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065133.447623:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065133.447625:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065133 -> 1746065133 00002000:00010000:0.0:1746065133.447626:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065132 -> 1746065132 00002000:00010000:0.0:1746065133.447628:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065133 -> 1746065133 00002000:00010000:0.0:1746065133.447630:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065133.447637:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263142656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (91us total) trans 17179873255 rc 0/0 00000100:00100000:1.0:1746065133.447642:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11966 00000100:00100000:0.0:1746065133.447643:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263142144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (128us total) trans 17179873254 rc 0/0 00000100:00100000:0.0:1746065133.447648:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11965 00000100:00100000:1.0:1746065133.447650:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11967 00000100:00100000:1.0:1746065133.447654:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263143168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065133.447702:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3759:x1830881263143168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (133us total) trans 21474840694 rc 0/0 00000100:00100000:1.0:1746065133.447706:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11967 00000004:00080000:1.0:1746065133.447729:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972b1880/2, rc 0, transno 21474840694 00000100:00100000:1.0:1746065133.447733:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263143168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065133.447740:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fd180/2, rc 0, transno 17179873254 00000100:00100000:1.0:1746065133.447743:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263142144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065133.447748:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c30700/2, rc 0, transno 17179873255 00000100:00100000:1.0:1746065133.447750:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263142656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065133.447801:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.448224:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016704 00000100:00100000:1.0:1746065133.448227:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016704 00000100:00100000:1.0:1746065133.448249:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13380 00000100:00100000:1.0:1746065133.448253:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+10:31553:x1830881263016704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.448263:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.448276:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131055600/0xad6b7ddc146c504 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9319dd expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.448314:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131055600/0xad6b7ddc146c504 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319dd expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.448325:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131055600/0xad6b7ddc146c504 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319dd expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.448338:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.448341:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065133.448344:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055600, rc 0) 00000100:00100000:1.0:1746065133.448368:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+11:31553:x1830881263016704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 114us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.448373:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13380 00000004:00080000:1.0:1746065133.449745:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf5500/2, rc 0, transno 21474840686 00000100:00100000:1.0:1746065133.449750:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263141504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065133.450046:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016832 00000100:00100000:0.0:1746065133.450050:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016832 00000100:00100000:0.0:1746065133.450078:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4751 00000100:00100000:0.0:1746065133.450095:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:31560:x1830881263016832:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:0.0:1746065133.450157:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:31560:x1830881263016832:12345-192.168.202.27@tcp:49:cat.0 Request processed in 73us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.450162:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4751 00000100:00100000:0.0:1746065133.461762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.470471:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.470608:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263017216 00000100:00100000:1.0:1746065133.470618:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263017216 00002000:00100000:1.0:1746065133.470663:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097c31880 x1830881263017216/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.470672:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c31880 with x1830881263017216 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.470677:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c31880 00000100:00100000:1.0:1746065133.470704:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3111 00000100:00100000:1.0:1746065133.470713:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263017216:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:0.0:1746065133.477455:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146c4e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319c1 expref: 33 pid: 10219 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746065133.477481:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263143296:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065133.478203:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263143424:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065133.478224:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc146c50b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2125824->2727935] (req 2125824->2727935) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319e4 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.478234:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c600, rc 0) 00000100:00100000:0.0:1746065133.478270:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+12:31555:x1830881263016960:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 16104us (16516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.478277:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11968 00000100:00100000:0.0:1746065133.482347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.493245:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.493268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.494683:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.495625:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263143552:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065133.495647:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.495694:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263017472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 17051us (17476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.495707:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5267 00000100:00100000:1.0:1746065133.496424:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3114 00000100:00100000:1.0:1746065133.496431:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263018240:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.501705:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.504300:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263017216:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 33588us (33840us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065133.504307:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3111 00002000:00100000:1.0:1746065133.504311:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097c31880 x1830881263017216/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.504317:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c31880 with x1830881263017216 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.504321:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c31880 00000100:00100000:0.0:1746065133.512405:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.530128:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263018240:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33687us (36848us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065133.530139:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3114 00002000:00100000:1.0:1746065133.530149:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097c32300 x1830881263018240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.530158:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c32300 with x1830881263018240 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.530163:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c32300 00000100:00100000:0.0:1746065133.552424:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.554125:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263019136 00000100:00100000:1.0:1746065133.554136:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263019136 00002000:00100000:1.0:1746065133.554178:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097c33100 x1830881263019136/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.554186:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c33100 with x1830881263019136 ext(2097152->4194303) 00002000:00010000:1.0:1746065133.554193:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c33100 00000100:00100000:1.0:1746065133.554222:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3117 00000100:00100000:1.0:1746065133.554228:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263019136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065133.559868:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.560872:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.570242:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3119 00000100:00100000:0.0:1746065133.570257:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263019648:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065133.584537:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263019136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30297us (32111us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065133.584548:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3117 00002000:00100000:1.0:1746065133.584561:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097c33100 x1830881263019136/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.584569:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c33100 with x1830881263019136 ext(2097152->4194303) 00002000:00010000:1.0:1746065133.584576:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c33100 00000100:00100000:0.0:1746065133.615644:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.618025:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.618129:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.622253:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.635646:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.635689:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.635727:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263020544 00000100:00100000:0.0:1746065133.635733:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263020544 00000100:00100000:0.0:1746065133.635766:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263020672 00000100:00100000:0.0:1746065133.635768:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263020672 00000100:00100000:0.0:1746065133.635815:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11971 00000100:00100000:0.0:1746065133.635822:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+33:31559:x1830881263020544:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065133.635836:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.635850:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9319f9 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.635870:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065133.635874:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc146c519 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f2 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.635883:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065133.635887:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2101248->3059711] (req 2101248->3059711) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.635915:0:12258:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc146c519 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f2 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.635926:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2101248->3059711] (req 2101248->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.635935:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:0.0:1746065133.635972:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+34:31559:x1830881263020544:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 150us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.635978:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11971 00000100:00100000:0.0:1746065133.635992:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11972 00000100:00100000:0.0:1746065133.635997:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263020672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.636003:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.636008:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc146c527 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931a00 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065133.636032:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263143936:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065133.636095:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.638946:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.639016:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263020800 00000100:00100000:1.0:1746065133.639023:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263020800 00010000:00010000:1.0:1746065133.639050:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c600/0xad6b7ddc146c50b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2125824->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319e4 expref: 16 pid: 13375 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065133.645129:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.649852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.649895:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.650514:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3121 00000100:00100000:1.0:1746065133.650522:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263021440:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065133.655415:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.655583:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263021696 00000100:00100000:1.0:1746065133.655591:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263021696 00000100:00100000:1.0:1746065133.655638:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4753 00000100:00100000:1.0:1746065133.655645:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+10:31553:x1830881263021696:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065133.655863:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+11:31553:x1830881263021696:12345-192.168.202.27@tcp:35:cat.0 Request processed in 218us (456us total) trans 8589935636 rc 0/0 00000100:00100000:1.0:1746065133.655869:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4753 00000100:00100000:1.0:1746065133.662252:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263021440:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11722us (12347us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065133.662262:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3121 00002000:00100000:1.0:1746065133.662273:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880136a79500 x1830881263021440/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.662281:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79500 with x1830881263021440 ext(3145728->4194303) 00002000:00010000:1.0:1746065133.662286:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a79500 00000100:00100000:0.0:1746065133.680761:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.682454:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.684021:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263021952 00000100:00100000:1.0:1746065133.684032:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263021952 00010000:00010000:1.0:1746065133.684074:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc146c519 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f2 expref: 35 pid: 13375 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.684254:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5269 00000100:00100000:1.0:1746065133.684262:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263021952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.684276:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.684303:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc146c519 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f2 expref: 35 pid: 13375 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.684315:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc146c519 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f2 expref: 35 pid: 13375 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.684339:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577a400/0xad6b7ddc146c519 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f2 expref: 35 pid: 13375 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.684363:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.684364:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.684371:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.684378:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.684411:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.684424:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263144192:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065133.684530:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.684958:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.688013:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.688042:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263022464 00000100:00100000:0.0:1746065133.688048:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263022464 00002000:00100000:0.0:1746065133.688080:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2101248->2105343) req@ffff8800900f1180 x1830881263022464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.688098:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1180 with x1830881263022464 ext(2101248->2105343) 00002000:00010000:0.0:1746065133.688102:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1180 00000100:00100000:0.0:1746065133.688135:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3123 00000100:00100000:0.0:1746065133.688142:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263022464:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065133.688221:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263144192:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065133.688237:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.688250:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263022464:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 108us (246us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.688254:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263021952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3995us (5802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.688255:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3123 00000100:00100000:1.0:1746065133.688261:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5269 00002000:00100000:0.0:1746065133.688261:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2101248->2105343) req@ffff8800900f1180 x1830881263022464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.688267:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1180 with x1830881263022464 ext(2101248->2105343) 00002000:00010000:0.0:1746065133.688269:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1180 00000100:00100000:0.0:1746065133.700362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.701043:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.701327:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263022848 00000100:00100000:0.0:1746065133.701331:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263022848 00002000:00100000:0.0:1746065133.701354:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3055616->3059711) req@ffff88009577d180 x1830881263022848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.701363:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d180 with x1830881263022848 ext(3055616->3059711) 00002000:00010000:0.0:1746065133.701366:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577d180 00000100:00100000:0.0:1746065133.701388:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3124 00000100:00100000:0.0:1746065133.701394:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263022848:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065133.701610:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263022848:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 216us (566us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065133.701616:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3124 00002000:00100000:0.0:1746065133.701621:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3055616->3059711) req@ffff88009577d180 x1830881263022848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.701628:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d180 with x1830881263022848 ext(3055616->3059711) 00002000:00010000:0.0:1746065133.701630:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577d180 00000100:00100000:0.0:1746065133.704564:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.704613:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023232 00000100:00100000:1.0:1746065133.704620:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023232 00000100:00100000:1.0:1746065133.704662:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4754 00000100:00100000:1.0:1746065133.704669:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:31559:x1830881263023232:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065133.704855:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+28:31559:x1830881263023232:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 185us (295us total) trans 8589935637 rc 0/0 00000100:00100000:1.0:1746065133.704861:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4754 00000100:00100000:1.0:1746065133.709705:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.709883:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023360 00000100:00100000:0.0:1746065133.709891:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023360 00002000:00100000:0.0:1746065133.709923:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff88009856c700 x1830881263023360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.709931:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c700 with x1830881263023360 ext(4194304->4816895) 00002000:00010000:0.0:1746065133.709936:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c700 00000100:00100000:0.0:1746065133.710701:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3125 00000100:00100000:0.0:1746065133.710709:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263023360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.717498:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.719302:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.722259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.722338:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023872 00000100:00100000:1.0:1746065133.722345:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023872 00000100:00100000:1.0:1746065133.722385:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4755 00000100:00100000:1.0:1746065133.722391:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+28:31560:x1830881263023872:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065133.722877:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+29:31560:x1830881263023872:12345-192.168.202.27@tcp:35:cat.0 Request processed in 484us (621us total) trans 8589935638 rc 0/0 00000100:00100000:1.0:1746065133.722886:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4755 00000100:00100000:0.0:1746065133.844126:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.847470:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.852185:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.864528:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.864632:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263024640 00000100:00100000:1.0:1746065133.864641:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263024640 00000100:00100000:1.0:1746065133.864693:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13383 00000100:00100000:1.0:1746065133.864700:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+11:31570:x1830881263024640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065133.864720:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.864735:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146c589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931a3f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.864836:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.864846:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.864856:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.864867:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.864872:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.864877:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.864952:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.864960:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.864965:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065133.864972:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065133.865026:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865032:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865037:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865042:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835dc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.865045:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865050:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865059:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.865061:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065133.865065:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865069:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc146c59e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865102:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865107:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865115:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865119:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865122:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835ce00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.865124:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865129:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865135:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065133.865137:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065133.865139:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865143:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc146c590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865151:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865155:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865159:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865163:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065133.865165:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865172:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865177:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e826b00) 00010000:00010000:1.0:1746065133.865179:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065133.865180:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865184:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146c597 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.865214:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146c589 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a3f expref: 13 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.865220:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146c589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a3f expref: 13 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.865226:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ca00, rc 0) 00000100:00100000:1.0:1746065133.865265:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+12:31570:x1830881263024640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 564us (743us total) trans 8589935640 rc 301/301 00000100:00100000:1.0:1746065133.865271:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13383 00000100:00100000:0.0:1746065133.872581:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.880691:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.885490:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.903665:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.903743:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263025408 00000100:00100000:1.0:1746065133.903750:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263025408 00000100:00100000:1.0:1746065133.903823:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13385 00000100:00100000:1.0:1746065133.903831:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+13:31573:x1830881263025408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065133.903847:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065133.903860:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146c5dd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931a5b expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.903927:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146c5e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.903938:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146c5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.903946:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146c5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065133.903966:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00000004:00200000:1.0:1746065133.903969:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065133.903980:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146c5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065133.903998:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146c5dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a5b expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.904013:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146c5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a5b expref: 14 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.904020:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065133.904022:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065133.904024:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d600, rc 0) 00000100:00100000:1.0:1746065133.904071:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+14:31573:x1830881263025408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 241us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.904076:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13385 00000100:00100000:0.0:1746065133.905315:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263024896:12345-192.168.202.27@tcp:4:cat.0 Request processed in 24436us (24629us total) trans 17179873257 rc 0/0 00000100:00100000:0.0:1746065133.905323:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1120 00002000:00100000:0.0:1746065133.905331:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2101248->3059711) req@ffff880097ccd880 x1830881263024896/t17179873257(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:49/0 lens 488/448 e 0 to 0 dl 1746065144 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.905340:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ccd880 with x1830881263024896 ext(2101248->3059711) 00010000:00010000:0.0:1746065133.905347:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 37 pid: 12258 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.905359:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 37 pid: 12258 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746065133.905365:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097ccd880 00000100:00100000:0.0:1746065133.908752:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.910265:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.910320:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263025664 00000100:00100000:0.0:1746065133.910325:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263025664 00010000:00010000:0.0:1746065133.910347:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 37 pid: 12258 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746065133.911751:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5270 00000100:00100000:0.0:1746065133.911759:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263025664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065133.911769:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065133.911807:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 37 pid: 12258 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.911818:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 37 pid: 12258 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.911833:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146c520 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2101248->3145727] (req 2101248->3059711) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319f9 expref: 37 pid: 12258 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746065133.911849:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.911851:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065133.911857:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146c5ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a46 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.911866:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146c5ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a46 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.911914:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146c5ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a46 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.911932:0:10893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146c5ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a46 expref: 36 pid: 13375 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.911944:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263144576:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065133.912000:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065133.913479:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263144576:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065133.913492:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065133.913604:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263025664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1845us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065133.913611:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5270 00000100:00100000:0.0:1746065133.918385:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.925558:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.925594:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.925612:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263026176 00000100:00100000:0.0:1746065133.925619:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263026176 00002000:00100000:0.0:1746065133.925652:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800907be300 x1830881263026176/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.925662:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907be300 with x1830881263026176 ext(0->1048575) 00002000:00010000:0.0:1746065133.925667:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907be300 00000100:00100000:0.0:1746065133.925686:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263026432 00000100:00100000:0.0:1746065133.925688:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263026432 00002000:00100000:0.0:1746065133.925698:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff8800907bd180 x1830881263026432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065133.925704:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd180 with x1830881263026432 ext(1048576->2097151) 00002000:00010000:0.0:1746065133.925707:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bd180 00000100:00100000:0.0:1746065133.925716:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3126 00000100:00100000:0.0:1746065133.925722:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263026176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.927966:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.928112:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263026560 00000100:00100000:1.0:1746065133.928118:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263026560 00002000:00100000:1.0:1746065133.928147:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800907bea00 x1830881263026560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.928157:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bea00 with x1830881263026560 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.928472:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bea00 00000100:00100000:1.0:1746065133.928498:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3128 00000100:00100000:1.0:1746065133.928505:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263026560:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065133.932452:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.937751:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.937853:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027072 00000100:00100000:1.0:1746065133.937860:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027072 00010000:00010000:1.0:1746065133.937886:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146c5ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a46 expref: 36 pid: 13375 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746065133.937916:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5271 00000100:00100000:1.0:1746065133.937922:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263027072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065133.937932:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065133.937947:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146c5ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a46 expref: 36 pid: 13375 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.937957:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146c5ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a46 expref: 36 pid: 13375 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.937974:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146c5ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a46 expref: 36 pid: 13375 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746065133.937996:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.937998:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065133.938004:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc146c5b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2195456->3145727] (req 2195456->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a4d expref: 17 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.938011:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc146c5b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2195456->3145727] (req 2195456->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a4d expref: 17 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065133.938036:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc146c5b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2195456->3145727] (req 2195456->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a4d expref: 17 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065133.938046:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263144704:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065133.938125:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065133.943209:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.946256:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.946405:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263144704:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065133.946422:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.946526:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263027072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8602us (8779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.946534:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5271 00000100:00100000:1.0:1746065133.948367:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263026560:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19856us (21165us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065133.948378:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3128 00002000:00100000:1.0:1746065133.948385:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800907bea00 x1830881263026560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/440 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.948394:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bea00 with x1830881263026560 ext(1048576->2097151) 00002000:00010000:1.0:1746065133.948398:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bea00 00000100:00100000:0.0:1746065133.951160:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027584 00000100:00100000:0.0:1746065133.951168:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027584 00000100:00100000:0.0:1746065133.951204:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 11983 00000100:00100000:0.0:1746065133.951210:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263027584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065133.951222:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065133.951240:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01e00/0xad6b7ddc146c61c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931a77 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065133.951265:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f01e00/0xad6b7ddc146c61c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a77 expref: 36 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.951275:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01e00/0xad6b7ddc146c61c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a77 expref: 36 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065133.951289:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01e00, rc 0) 00000100:00100000:0.0:1746065133.951329:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263027584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 119us (235us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065133.951334:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11983 00000100:00100000:0.0:1746065133.952260:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.952312:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027840 00000100:00100000:1.0:1746065133.952316:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027840 00002000:00100000:1.0:1746065133.952339:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2416640->2420735) req@ffff8800907bd500 x1830881263027840/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/0 e 0 to 0 dl 1746065144 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.952348:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd500 with x1830881263027840 ext(2416640->2420735) 00002000:00010000:1.0:1746065133.952352:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bd500 00000100:00100000:1.0:1746065133.952373:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3130 00000100:00100000:1.0:1746065133.952377:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263027840:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065133.953335:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263027840:12345-192.168.202.27@tcp:3:cat.0 Request processed in 954us (1074us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065133.953343:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3130 00002000:00100000:1.0:1746065133.953348:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2416640->2420735) req@ffff8800907bd500 x1830881263027840/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746065144 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065133.953355:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd500 with x1830881263027840 ext(2416640->2420735) 00002000:00010000:1.0:1746065133.953359:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bd500 00000100:00100000:0.0:1746065133.962432:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.962479:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.962857:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028224 00000100:00100000:1.0:1746065133.962865:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028224 00000100:00100000:1.0:1746065133.962912:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4756 00000100:00100000:1.0:1746065133.962919:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+14:31570:x1830881263028224:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065133.963127:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+15:31570:x1830881263028224:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 207us (645us total) trans 8589935643 rc 0/0 00000100:00100000:1.0:1746065133.963133:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4756 00000100:00100000:0.0:1746065133.970434:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.991263:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.991350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065133.995567:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065133.995668:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028992 00000100:00100000:0.0:1746065133.995675:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028992 00010000:00010000:0.0:1746065133.995695:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146c535 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a0e expref: 36 pid: 13375 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065133.995722:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5272 00000100:00100000:0.0:1746065133.995728:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263028992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065133.995738:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065133.995749:0:10893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065133 -> 1746065134 00002000:00010000:0.0:1746065133.995751:0:10893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065133 -> 1746065134 00010000:00010000:0.0:1746065133.995756:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146c535 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a0e expref: 36 pid: 13375 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065133.995765:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146c535 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a0e expref: 36 pid: 13375 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065133.995801:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146c535 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a0e expref: 36 pid: 13375 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065133.995815:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065133.995837:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263028992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065133.995842:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5272 00000100:00100000:0.0:1746065133.998184:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.004585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.004617:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.004669:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029376 00000100:00100000:1.0:1746065134.004675:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029376 00002000:00100000:1.0:1746065134.004704:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3551232->3555327) req@ffff880136a78380 x1830881263029376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.004713:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78380 with x1830881263029376 ext(3551232->3555327) 00002000:00010000:1.0:1746065134.004717:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78380 00000100:00100000:1.0:1746065134.004728:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029632 00000100:00100000:1.0:1746065134.004729:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029632 00002000:00100000:1.0:1746065134.004737:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800900f1f80 x1830881263029632/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.004743:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1f80 with x1830881263029632 ext(2097152->3145727) 00002000:00010000:1.0:1746065134.004746:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1f80 00000100:00100000:1.0:1746065134.004755:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3131 00000100:00100000:1.0:1746065134.004759:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263029376:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065134.004860:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263029376:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 100us (277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.004866:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3131 00002000:00100000:1.0:1746065134.004870:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3551232->3555327) req@ffff880136a78380 x1830881263029376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.004882:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78380 with x1830881263029376 ext(3551232->3555327) 00002000:00010000:1.0:1746065134.004884:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78380 00000100:00100000:1.0:1746065134.004894:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3132 00000100:00100000:1.0:1746065134.004898:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263029632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065134.013626:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029888 00000100:00100000:0.0:1746065134.013635:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029888 00002000:00100000:0.0:1746065134.013668:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (4005888->4009983) req@ffff88009adf6a00 x1830881263029888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065134.013677:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6a00 with x1830881263029888 ext(4005888->4009983) 00002000:00010000:0.0:1746065134.013682:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf6a00 00000100:00100000:0.0:1746065134.013699:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3133 00000100:00100000:0.0:1746065134.013704:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263029888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065134.013821:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263029888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 115us (1508us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065134.013830:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3133 00002000:00100000:0.0:1746065134.013835:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (4005888->4009983) req@ffff88009adf6a00 x1830881263029888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065134.013841:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6a00 with x1830881263029888 ext(4005888->4009983) 00002000:00010000:0.0:1746065134.013844:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf6a00 00000100:00100000:1.0:1746065134.014073:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263029632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9172us (9454us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065134.014087:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3132 00002000:00100000:1.0:1746065134.014092:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800900f1f80 x1830881263029632/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/440 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.014099:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1f80 with x1830881263029632 ext(2097152->3145727) 00002000:00010000:1.0:1746065134.014102:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1f80 00000100:00100000:0.0:1746065134.018994:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.019052:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.019227:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263030144 00000100:00100000:1.0:1746065134.019235:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263030144 00000100:00100000:1.0:1746065134.019409:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4758 00000100:00100000:1.0:1746065134.019418:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+33:31575:x1830881263030144:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065134.020594:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+34:31575:x1830881263030144:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1176us (1604us total) trans 8589935645 rc 0/0 00000100:00100000:1.0:1746065134.020601:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4758 00000100:00100000:0.0:1746065134.026459:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.038032:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.043094:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.061259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.061314:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263031040 00000100:00100000:1.0:1746065134.061323:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263031040 00000100:00100000:1.0:1746065134.061372:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4759 00000100:00100000:1.0:1746065134.061380:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+15:31573:x1830881263031040:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065134.062175:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+16:31573:x1830881263031040:12345-192.168.202.27@tcp:35:cat.0 Request processed in 794us (922us total) trans 8589935646 rc 0/0 00000100:00100000:1.0:1746065134.062182:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4759 00000100:00100000:0.0:1746065134.111506:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.117474:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.129402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.164372:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.165998:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13388 00000100:00100000:1.0:1746065134.166010:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+35:31584:x1830881263031936:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065134.166085:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.166103:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931aa8 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.166161:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166172:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166181:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166192:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166197:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166202:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166272:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166279:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166285:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065134.166293:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065134.166440:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166447:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166452:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166456:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.166460:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166465:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166473:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065134.166476:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065134.166479:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166483:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c67e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166511:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166516:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166520:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166527:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166531:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.166532:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166536:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166542:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065134.166543:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.166546:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166550:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166556:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166559:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166563:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166567:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.166569:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166573:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166580:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009074dc00) 00010000:00010000:1.0:1746065134.166582:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.166584:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166588:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c677 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.166613:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c669 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931aa8 expref: 37 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.166620:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146c669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931aa8 expref: 37 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.166625:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8c00, rc 0) 00000100:00100000:1.0:1746065134.166677:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+36:31584:x1830881263031936:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 671us (2312us total) trans 8589935648 rc 301/301 00000100:00100000:1.0:1746065134.166684:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13388 00000100:00100000:1.0:1746065134.172072:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032192 00000100:00100000:1.0:1746065134.172088:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032192 00000100:00100000:1.0:1746065134.172159:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4760 00000100:00100000:1.0:1746065134.172165:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+36:31582:x1830881263032192:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065134.172368:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+37:31582:x1830881263032192:12345-192.168.202.27@tcp:35:cat.0 Request processed in 203us (419us total) trans 8589935649 rc 0/0 00000100:00100000:1.0:1746065134.172374:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4760 00000100:00100000:0.0:1746065134.186688:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.186806:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032448 00000100:00100000:1.0:1746065134.186814:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032448 00000100:00100000:1.0:1746065134.186863:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13389 00000100:00100000:1.0:1746065134.186870:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+16:31586:x1830881263032448:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065134.186892:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.186906:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c68c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931aaf expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.186965:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.186975:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.186984:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.186994:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.186999:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187009:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187088:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187096:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187102:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065134.187110:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065134.187157:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187163:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187168:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187173:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.187176:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187181:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187189:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065134.187191:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065134.187194:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187199:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6a1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187218:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187222:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187227:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187231:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187239:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.187241:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187245:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187250:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065134.187252:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.187254:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187258:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187623:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187628:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187632:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187636:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.187638:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187643:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187649:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008d8c4100) 00010000:00010000:1.0:1746065134.187651:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.187654:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187658:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c69a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.187684:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c68c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931aaf expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.187691:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c68c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931aaf expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.187697:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8a00, rc 0) 00000100:00100000:1.0:1746065134.188910:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+17:31586:x1830881263032448:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2036us (2225us total) trans 8589935650 rc 301/301 00000100:00100000:1.0:1746065134.188919:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13389 00000100:00100000:0.0:1746065134.193622:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263145600:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065134.193632:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263145728:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065134.193638:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263145856:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065134.193659:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1724416->1736703] (req 1724416->1736703) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.193671:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00000100:00100000:0.0:1746065134.193904:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+23:31586:x1830881263032576:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2453us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.193912:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 11989 00000100:00100000:0.0:1746065134.194768:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.194813:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.194834:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.194856:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032704 00000100:00100000:0.0:1746065134.194860:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032704 00010000:00010000:0.0:1746065134.194879:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc146c4d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319b3 expref: 31 pid: 10219 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746065134.194895:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032832 00000100:00100000:0.0:1746065134.194896:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032832 00010000:00010000:0.0:1746065134.194902:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146c440 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93196d expref: 12 pid: 9548 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746065134.194911:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032960 00000100:00100000:0.0:1746065134.194913:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032960 00010000:00010000:0.0:1746065134.194919:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1b000/0xad6b7ddc146c4fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319d6 expref: 23 pid: 3068 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746065134.194929:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5275 00000100:00100000:0.0:1746065134.194933:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263032704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065134.194942:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065134.194960:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc146c4d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319b3 expref: 31 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.194969:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc146c4d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319b3 expref: 31 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.194993:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc146c4d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319b3 expref: 31 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.195004:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.195020:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263032704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.195025:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5275 00000100:00100000:0.0:1746065134.195034:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5276 00000100:00100000:0.0:1746065134.195038:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263032832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065134.195042:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065134.195047:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146c440 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93196d expref: 12 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.195054:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146c440 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93196d expref: 12 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.195063:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146c440 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93196d expref: 12 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.195069:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.195091:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263032832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.195096:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5276 00000100:00100000:0.0:1746065134.195103:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5277 00000100:00100000:0.0:1746065134.195107:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263032960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065134.195113:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065134.195118:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1b000/0xad6b7ddc146c4fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319d6 expref: 23 pid: 3068 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065134.195126:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1b000/0xad6b7ddc146c4fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319d6 expref: 23 pid: 3068 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065134.195135:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1b000/0xad6b7ddc146c4fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319d6 expref: 23 pid: 3068 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065134.195143:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065134.195145:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065134.195151:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.195159:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.195188:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065134.195197:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263145984:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065134.195236:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.201588:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.204347:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.208299:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.208355:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033728 00000100:00100000:1.0:1746065134.208362:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033728 00000100:00100000:1.0:1746065134.208409:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4761 00000100:00100000:1.0:1746065134.208416:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+17:31586:x1830881263033728:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065134.208598:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+18:31586:x1830881263033728:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 182us (304us total) trans 8589935651 rc 0/0 00000100:00100000:1.0:1746065134.208605:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4761 00000100:00100000:0.0:1746065134.289598:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.289660:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033984 00000100:00100000:1.0:1746065134.289667:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033984 00000100:00100000:1.0:1746065134.289719:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13390 00000100:00100000:1.0:1746065134.289726:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+37:31594:x1830881263033984:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065134.289748:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.289764:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931abd expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.289852:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.289862:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.289870:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.289880:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.289885:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.289890:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.289952:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.289958:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.289961:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065134.289968:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065134.290017:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290022:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290027:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290032:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.290034:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290039:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290047:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065134.290050:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065134.290053:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290057:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146c6cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290113:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290118:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290122:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290125:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290128:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.290130:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290137:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290142:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065134.290144:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.290146:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290149:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146c6bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290155:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290159:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290162:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290165:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.290166:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290169:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290173:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012edbdd00) 00010000:00010000:1.0:1746065134.290174:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.290176:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290179:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146c6c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.290206:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931abd expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.290212:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc146c6b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931abd expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.290218:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6200, rc 0) 00000100:00100000:1.0:1746065134.290262:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+38:31594:x1830881263033984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 536us (671us total) trans 8589935652 rc 301/301 00000100:00100000:1.0:1746065134.290268:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13390 00000100:00100000:0.0:1746065134.293102:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.293189:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034240 00000100:00100000:1.0:1746065134.293195:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034240 00000100:00100000:1.0:1746065134.293234:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13391 00000100:00100000:1.0:1746065134.293241:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+18:31593:x1830881263034240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065134.293260:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.293274:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc146c6d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931ac4 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.293339:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293349:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293357:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293367:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293375:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293384:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293451:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293459:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293463:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065134.293471:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065134.293519:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293525:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293530:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293534:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.293537:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293542:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293550:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065134.293552:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065134.293556:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293560:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c6ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293571:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293576:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293580:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293584:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293588:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.293590:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293594:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293599:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065134.293600:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.293602:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293606:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c6e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293611:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293618:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293623:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293626:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.293628:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293633:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293638:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012edbd500) 00010000:00010000:1.0:1746065134.293640:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.293642:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293646:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c6e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.293672:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc146c6d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ac4 expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.293679:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc146c6d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ac4 expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.293685:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46000, rc 0) 00000100:00100000:1.0:1746065134.293717:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+19:31593:x1830881263034240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 476us (621us total) trans 8589935653 rc 301/301 00000100:00100000:1.0:1746065134.293722:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13391 00000100:00100000:0.0:1746065134.294206:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.302858:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.302933:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.303005:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034624 00000100:00100000:1.0:1746065134.303013:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034624 00002000:00100000:1.0:1746065134.303055:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097243b80 x1830881263034624/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 504/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.303063:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243b80 with x1830881263034624 ext(1048576->2097151) 00002000:00010000:1.0:1746065134.303068:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097243b80 00000100:00100000:1.0:1746065134.303824:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1124 00000100:00100000:1.0:1746065134.303837:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263034624:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065134.311300:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034880 00000100:00100000:1.0:1746065134.311307:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034880 00002000:00100000:1.0:1746065134.311337:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1724416->1736703) req@ffff88009adf4380 x1830881263034880/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 12776/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.311344:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4380 with x1830881263034880 ext(1724416->1736703) 00010000:00010000:1.0:1746065134.311351:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 24 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.311361:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 24 pid: 12258 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065134.311366:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009adf4380 00000100:00100000:1.0:1746065134.311394:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1125 00000100:00100000:1.0:1746065134.311401:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263034880:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065134.312176:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263034880:12345-192.168.202.27@tcp:4:cat.0 Request processed in 774us (1064us total) trans 21474840695 rc 0/0 00000100:00100000:1.0:1746065134.312183:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1125 00002000:00100000:1.0:1746065134.312189:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1724416->1736703) req@ffff88009adf4380 x1830881263034880/t21474840695(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 12776/448 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.312196:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4380 with x1830881263034880 ext(1724416->1736703) 00010000:00010000:1.0:1746065134.312307:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 26 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.312319:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 26 pid: 12258 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065134.312325:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009adf4380 00000100:00100000:1.0:1746065134.313399:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263034624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9566us (10544us total) trans 0 rc 1036288/1036288 00000100:00100000:1.0:1746065134.313406:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1124 00002000:00100000:1.0:1746065134.313412:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097243b80 x1830881263034624/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 504/440 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.313419:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243b80 with x1830881263034624 ext(1048576->2097151) 00010000:00010000:1.0:1746065134.313425:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 24 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.313435:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c31600/0xad6b7ddc146c6af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ab6 expref: 24 pid: 12258 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065134.313441:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097243b80 00000100:00100000:0.0:1746065134.325727:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.329188:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.334620:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.335278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.335348:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035392 00000100:00100000:1.0:1746065134.335356:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035392 00002000:00100000:1.0:1746065134.335393:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097c9c380 x1830881263035392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.335402:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c9c380 with x1830881263035392 ext(1048576->2097151) 00002000:00010000:1.0:1746065134.335407:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c9c380 00000100:00100000:1.0:1746065134.335424:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3139 00000100:00100000:1.0:1746065134.335431:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263035392:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065134.335444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.335470:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035776 00000100:00100000:0.0:1746065134.335473:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035776 00000100:00100000:0.0:1746065134.335503:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4762 00000100:00100000:0.0:1746065134.335507:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+19:31593:x1830881263035776:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065134.335642:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+20:31593:x1830881263035776:12345-192.168.202.27@tcp:35:cat.0 Request processed in 134us (197us total) trans 8589935654 rc 0/0 00000100:00100000:0.0:1746065134.335648:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4762 00000100:00100000:0.0:1746065134.345647:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035904 00000100:00100000:0.0:1746065134.345654:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035904 00010000:00010000:0.0:1746065134.345676:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146c45c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931974 expref: 11 pid: 10219 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746065134.345739:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5279 00000100:00100000:0.0:1746065134.345746:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263035904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065134.345756:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065134.345771:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146c45c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931974 expref: 11 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.345799:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146c45c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931974 expref: 11 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.345817:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146c45c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931974 expref: 11 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.345829:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.345846:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263035904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.345852:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5279 00000100:00100000:0.0:1746065134.348720:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.358707:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.363210:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.387346:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.388482:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.389903:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263037312 00000100:00100000:0.0:1746065134.389907:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263037312 00002000:00100000:0.0:1746065134.389930:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff88013513b800 x1830881263037312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065134.389938:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881263037312 ext(4194304->4816895) 00002000:00010000:0.0:1746065134.389942:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513b800 00000100:00100000:0.0:1746065134.389962:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3142 00000100:00100000:0.0:1746065134.389966:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263037312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065134.396589:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.396621:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.396868:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263037312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6900us (7348us total) trans 0 rc 622592/622592 00000100:00100000:1.0:1746065134.396875:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3142 00002000:00100000:1.0:1746065134.396882:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff88013513b800 x1830881263037312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/440 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.396889:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881263037312 ext(4194304->4816895) 00002000:00010000:1.0:1746065134.396893:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513b800 00000100:00100000:0.0:1746065134.401373:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.403039:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.404839:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.404917:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.405043:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263038592 00000100:00100000:1.0:1746065134.405047:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263038592 00000100:00100000:1.0:1746065134.405093:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4765 00000100:00100000:1.0:1746065134.405098:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+38:31584:x1830881263038592:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065134.405270:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+39:31584:x1830881263038592:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 171us (353us total) trans 8589935657 rc 0/0 00000100:00100000:1.0:1746065134.405276:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4765 00000100:00100000:0.0:1746065134.413612:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.413662:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263038848 00000100:00100000:1.0:1746065134.413670:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263038848 00000100:00100000:1.0:1746065134.413722:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4766 00000100:00100000:1.0:1746065134.413730:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+39:31594:x1830881263038848:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065134.414137:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+40:31594:x1830881263038848:12345-192.168.202.27@tcp:35:cat.0 Request processed in 405us (530us total) trans 8589935658 rc 0/0 00000100:00100000:1.0:1746065134.414144:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4766 00000100:00100000:0.0:1746065134.446644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.460285:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.460921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.466125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.469163:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.471834:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.474541:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.474610:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040000 00000100:00100000:1.0:1746065134.474615:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040000 00002000:00100000:1.0:1746065134.474645:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3395584->4194303) req@ffff880097ccf800 x1830881263040000/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.474654:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ccf800 with x1830881263040000 ext(3395584->4194303) 00010000:00010000:1.0:1746065134.474659:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db9cc00/0xad6b7ddc146c711 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3395584->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ae0 expref: 31 pid: 13375 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.474669:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db9cc00/0xad6b7ddc146c711 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3395584->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ae0 expref: 31 pid: 13375 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065134.474675:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097ccf800 00000100:00100000:1.0:1746065134.474698:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1126 00000100:00100000:1.0:1746065134.474705:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263040000:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065134.482846:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263040000:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8134us (8298us total) trans 21474840696 rc 0/0 00000100:00100000:1.0:1746065134.482857:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1126 00002000:00100000:1.0:1746065134.482866:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3395584->4194303) req@ffff880097ccf800 x1830881263040000/t21474840696(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/448 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.482875:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ccf800 with x1830881263040000 ext(3395584->4194303) 00010000:00010000:1.0:1746065134.482884:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db9cc00/0xad6b7ddc146c711 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3395584->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ae0 expref: 33 pid: 13375 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.482902:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db9cc00/0xad6b7ddc146c711 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3395584->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ae0 expref: 33 pid: 13375 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065134.482909:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097ccf800 00000100:00100000:0.0:1746065134.493620:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.498527:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263148032:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065134.498546:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.498585:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263040128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4513us (4973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.498593:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5285 00000100:00100000:0.0:1746065134.499276:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.500047:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040384 00000100:00100000:1.0:1746065134.500054:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040384 00002000:00100000:1.0:1746065134.500103:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3293184->3297279) req@ffff8800972b1f80 x1830881263040384/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.500113:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972b1f80 with x1830881263040384 ext(3293184->3297279) 00002000:00010000:1.0:1746065134.500117:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972b1f80 00000100:00100000:1.0:1746065134.500316:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3145 00000100:00100000:1.0:1746065134.500324:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263040384:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065134.500567:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263040384:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 242us (1292us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065134.500572:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3145 00002000:00100000:1.0:1746065134.500578:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3293184->3297279) req@ffff8800972b1f80 x1830881263040384/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.500585:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972b1f80 with x1830881263040384 ext(3293184->3297279) 00002000:00010000:1.0:1746065134.500588:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972b1f80 00000100:00100000:0.0:1746065134.504042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.504274:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040640 00000100:00100000:1.0:1746065134.504282:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040640 00000100:00100000:1.0:1746065134.504331:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4767 00000100:00100000:1.0:1746065134.504339:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+21:31601:x1830881263040640:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065134.504521:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+22:31601:x1830881263040640:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 182us (486us total) trans 8589935660 rc 0/0 00000100:00100000:1.0:1746065134.504527:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4767 00000100:00100000:0.0:1746065134.537254:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.538050:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040896 00000100:00100000:1.0:1746065134.538058:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040896 00000100:00100000:1.0:1746065134.538122:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13393 00000100:00100000:1.0:1746065134.538130:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+40:31604:x1830881263040896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065134.538153:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.538169:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc146c75e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b11 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.538230:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538241:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538250:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538261:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538266:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538271:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538344:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c773 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538355:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c773 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538361:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c773 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065134.538368:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065134.538421:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538427:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538432:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538437:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538442:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.538445:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538449:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538458:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065134.538460:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.538463:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.538468:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e200/0xad6b7ddc146c765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.539355:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.539363:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.539367:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.539371:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065134.539374:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.539379:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.539386:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012edbd400) 00010000:00010000:1.0:1746065134.539388:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065134.539390:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.539394:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c76c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.539432:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc146c75e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b11 expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.539442:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c773 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b11 expref: 42 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.539448:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065134.539450:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065134.539453:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f600, rc 0) 00000100:00100000:1.0:1746065134.539603:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+42:31604:x1830881263040896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1473us (2354us total) trans 8589935661 rc 0/0 00000100:00100000:1.0:1746065134.539610:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13393 00000100:00100000:0.0:1746065134.544281:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.584457:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.584568:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263041280 00000100:00100000:1.0:1746065134.584579:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263041280 00000100:00100000:1.0:1746065134.584636:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13394 00000100:00100000:1.0:1746065134.584644:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+22:31607:x1830881263041280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065134.584671:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.584691:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b18 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.585096:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c788 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.585109:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c788 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.585118:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c788 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065134.585129:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065134.586518:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b18 expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.586936:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c788 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b18 expref: 24 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.586943:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065134.586946:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065134.586949:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e600, rc 0) 00000100:00100000:1.0:1746065134.586993:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+24:31607:x1830881263041280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2350us (2545us total) trans 8589935662 rc 0/0 00000100:00100000:1.0:1746065134.587000:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13394 00000100:00100000:0.0:1746065134.589861:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.603270:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.603346:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263041664 00000100:00100000:1.0:1746065134.603354:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263041664 00002000:00100000:1.0:1746065134.603391:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880090dd8000 x1830881263041664/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.603401:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8000 with x1830881263041664 ext(1048576->2097151) 00002000:00010000:1.0:1746065134.603405:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd8000 00000100:00100000:1.0:1746065134.603430:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3146 00000100:00100000:1.0:1746065134.603437:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263041664:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065134.624641:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263041664:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21195us (21369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065134.624649:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3146 00002000:00100000:1.0:1746065134.624658:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880090dd8000 x1830881263041664/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/440 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.624666:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8000 with x1830881263041664 ext(1048576->2097151) 00002000:00010000:1.0:1746065134.624671:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd8000 00000100:00100000:0.0:1746065134.624975:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.625063:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263041920 00000100:00100000:1.0:1746065134.625070:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263041920 00000100:00100000:1.0:1746065134.625119:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13395 00000100:00100000:1.0:1746065134.625124:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+24:31610:x1830881263041920:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065134.625142:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.625158:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c79d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b26 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.625239:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.625251:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146c57b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a31 expref: 40 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.625257:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146c5e4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a5b expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.625262:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.625285:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146c5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a5b expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.625293:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146c5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a5b expref: 25 pid: 9571 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065134.625301:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263148288:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065134.625359:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146c57b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a31 expref: 40 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.625367:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146c57b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931a31 expref: 40 pid: 7204 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065134.625372:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263148416:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065134.625385:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f016d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.627333:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263148288:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065134.627343:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263148416:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065134.627361:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065134.628602:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.628635:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065134.629603:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065134.629610:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065134.629626:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065134.629724:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc146c79d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b26 expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.629738:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b26 expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.629744:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065134.629747:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065134.629749:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f400, rc 0) 00000100:00100000:1.0:1746065134.629790:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+25:31610:x1830881263041920:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4665us (4815us total) trans 8589935663 rc 0/0 00000100:00100000:1.0:1746065134.629797:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13395 00000100:00100000:0.0:1746065134.633344:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.637875:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.638755:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.638828:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042688 00000100:00100000:0.0:1746065134.638831:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042688 00002000:00100000:0.0:1746065134.638853:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880097c33b80 x1830881263042688/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065134.638862:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c33b80 with x1830881263042688 ext(2097152->3145727) 00002000:00010000:0.0:1746065134.638866:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c33b80 00000100:00100000:0.0:1746065134.638889:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3147 00000100:00100000:0.0:1746065134.638894:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263042688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065134.643359:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.643981:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042816 00000100:00100000:1.0:1746065134.643986:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042816 00010000:00010000:1.0:1746065134.644007:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146c4cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319ac expref: 38 pid: 10219 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746065134.644030:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5289 00000100:00100000:1.0:1746065134.644035:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263042816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.644045:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.644064:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146c4cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319ac expref: 38 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.644081:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146c4cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319ac expref: 38 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.644098:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146c4cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319ac expref: 38 pid: 10219 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.644114:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.644411:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263042816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 374us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.644417:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5289 00000100:00100000:1.0:1746065134.644428:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042944 00000100:00100000:1.0:1746065134.644430:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042944 00010000:00010000:1.0:1746065134.644439:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146c455 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931966 expref: 8 pid: 9548 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746065134.644461:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5290 00000100:00100000:1.0:1746065134.644466:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263042944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.644472:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.644478:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146c455 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931966 expref: 8 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.644490:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146c455 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931966 expref: 8 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.644501:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146c455 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931966 expref: 8 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.644508:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.644509:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.644514:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146c7b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b2d expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.644521:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146c7b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b2d expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.644542:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146c7b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b2d expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.644551:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263148928:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065134.644589:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.650827:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263148928:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065134.650842:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.650884:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263042944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6416us (6638us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.650893:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5290 00000100:00100000:0.0:1746065134.653104:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149056 00000100:00100000:0.0:1746065134.653110:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149056 00000100:00100000:0.0:1746065134.653142:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1746065134.653561:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3760:x1830881263149056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065134.653585:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065134.653626:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3760:x1830881263149056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.653631:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1746065134.654827:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.658234:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.660019:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263043328 00000100:00100000:1.0:1746065134.660023:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263043328 00010000:00010000:1.0:1746065134.660043:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be200/0xad6b7ddc146c703 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ad2 expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065134.660084:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5291 00000100:00100000:1.0:1746065134.660091:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263043328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.660099:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.660114:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996be200/0xad6b7ddc146c703 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ad2 expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.660123:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996be200/0xad6b7ddc146c703 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ad2 expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.660139:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996be200/0xad6b7ddc146c703 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ad2 expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.660153:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.660172:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263043328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.660178:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5291 00000100:00100000:1.0:1746065134.660748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.660799:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.660965:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263043712 00000100:00100000:0.0:1746065134.660969:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263043712 00000100:00100000:0.0:1746065134.660996:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13396 00000100:00100000:0.0:1746065134.661001:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+40:31613:x1830881263043712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065134.661015:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065134.661025:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc146c7c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b42 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.661084:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661093:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661101:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661111:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661116:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661121:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661203:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c7dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661211:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661221:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065134.661228:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065134.661281:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661287:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661293:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661297:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661301:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065134.661305:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661310:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661318:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065134.661320:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065134.661323:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661327:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47600/0xad6b7ddc146c7ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661340:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661349:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661354:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661358:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065134.661360:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661364:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661370:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a4b5600) 00010000:00010000:0.0:1746065134.661372:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065134.661374:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661378:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146c7d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065134.661406:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc146c7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b42 expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.661414:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c7dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b42 expref: 42 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065134.661420:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065134.661421:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065134.661424:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:0.0:1746065134.661446:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+42:31613:x1830881263043712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 445us (673us total) trans 8589935664 rc 0/0 00000100:00100000:0.0:1746065134.661451:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13396 00000100:00100000:0.0:1746065134.663296:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263043840 00000100:00100000:0.0:1746065134.663301:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263043840 00002000:00100000:0.0:1746065134.663323:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3117056->3145727) req@ffff88009aec8a80 x1830881263043840/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065134.663332:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881263043840 ext(3117056->3145727) 00010000:00010000:0.0:1746065134.663338:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc146c750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b03 expref: 16 pid: 13375 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746065134.663349:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc146c750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b03 expref: 16 pid: 13375 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746065134.663355:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aec8a80 00000100:00100000:0.0:1746065134.663366:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1127 00000100:00100000:0.0:1746065134.663372:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263043840:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065134.666196:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.666216:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.667674:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12004 00000100:00100000:1.0:1746065134.667684:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263044096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065134.667694:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.667703:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc146c7f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b50 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.667883:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263149824:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065134.667927:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.669430:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881263150208:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669465:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065134.669497:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3759:1830881263150720:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669513:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065134.669523:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263151232:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065134.669554:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1746065134.669559:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263150336:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065134.669583:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3759:1830881263150848:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669598:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065134.669609:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3759:1830881263151360:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669623:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065134.669642:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150208 00000100:00100000:1.0:1746065134.669647:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150208 00000100:00100000:1.0:1746065134.669670:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150720 00000100:00100000:1.0:1746065134.669672:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150720 00000100:00100000:1.0:1746065134.669685:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150848 00000100:00100000:1.0:1746065134.669687:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150848 00000100:00100000:1.0:1746065134.669696:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151360 00000100:00100000:1.0:1746065134.669697:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151360 00000100:00100000:1.0:1746065134.669706:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1746065134.669711:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881263150208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669738:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881263150208:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.669744:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1746065134.669755:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:1.0:1746065134.669759:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3759:x1830881263150720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669804:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3759:x1830881263150720:12345-0@lo:400:kworker.0 Request processed in 44us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.669809:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:1.0:1746065134.669818:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1746065134.669822:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3759:x1830881263150848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669841:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3759:x1830881263150848:12345-0@lo:400:kworker.0 Request processed in 19us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.669845:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1746065134.669852:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1746065134.669856:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3759:x1830881263151360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.669874:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3759:x1830881263151360:12345-0@lo:400:kworker.0 Request processed in 18us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.669879:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00080000:1.0:1746065134.669892:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746065134.669895:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746065134.669902:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151232 00000100:00100000:1.0:1746065134.669904:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151232 00000100:00100000:0.0:1746065134.671084:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150336 00000100:00100000:0.0:1746065134.671088:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150336 00000100:00100000:0.0:1746065134.671112:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151104 00000100:00100000:0.0:1746065134.671114:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151104 00000100:00100000:0.0:1746065134.671125:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150464 00000100:00100000:0.0:1746065134.671127:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150464 00000100:00100000:0.0:1746065134.671138:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1746065134.671143:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263150336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065134.671172:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263150336:12345-0@lo:400:kworker.0 Request processed in 29us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.671177:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1746065134.671186:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1746065134.671189:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881263151104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065134.671209:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881263151104:12345-0@lo:400:kworker.0 Request processed in 19us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.671213:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1746065134.671221:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1746065134.671225:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263150464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065134.671242:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263150464:12345-0@lo:400:kworker.0 Request processed in 17us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.671246:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1746065134.672836:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1746065134.672844:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263151232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.672877:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263151232:12345-0@lo:400:kworker.0 Request processed in 35us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.672881:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1746065134.672910:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263150336:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.672919:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3759:1830881263150848:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.672927:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3759:1830881263151360:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.672937:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881263150208:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.672946:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3759:1830881263150720:0@lo:400:kworker.0 00000100:00100000:1.0:1746065134.672955:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263151232:0@lo:400:kworker.0 00000100:00100000:0.0:1746065134.673874:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.673916:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.674791:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263149824:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065134.674809:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc146c7f1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b50 expref: 38 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065134.674817:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc146c7f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b50 expref: 38 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065134.674826:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47c00, rc 0) 00000100:00100000:1.0:1746065134.674850:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263044096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7168us (8633us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065134.674855:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12004 00000100:00100000:0.0:1746065134.681490:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.681557:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.688843:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.694306:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.695717:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.725687:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.734322:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151744 00000100:00100000:0.0:1746065134.734329:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151744 00000100:00100000:0.0:1746065134.734376:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1746065134.734383:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881263151744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746065134.734411:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445687296 avail 1316225024 00000100:00100000:0.0:1746065134.735586:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881263151744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1200us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.735594:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1746065134.740711:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.747895:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.763232:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.763277:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.765315:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065134.765326:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263152128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065134.765357:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065134.765634:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263152128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065134.775148:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.775526:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263046656 00000100:00100000:1.0:1746065134.775531:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263046656 00002000:00100000:1.0:1746065134.775559:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880129f41500 x1830881263046656/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.775568:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41500 with x1830881263046656 ext(3145728->4194303) 00002000:00010000:1.0:1746065134.775572:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41500 00000100:00100000:1.0:1746065134.775602:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3153 00000100:00100000:1.0:1746065134.775610:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263046656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065134.781306:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152256 00000100:00100000:0.0:1746065134.781313:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152256 00000100:00100000:0.0:1746065134.781353:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1746065134.781362:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263152256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065134.781385:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 135168 granted 1134274880 pending 4468736 free 3910807552 avail 3679285248 00000100:00100000:0.0:1746065134.781431:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263152256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.781438:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1746065134.793128:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.794909:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263046656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19298us (19769us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065134.794917:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3153 00002000:00100000:1.0:1746065134.794925:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880129f41500 x1830881263046656/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/440 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.794933:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41500 with x1830881263046656 ext(3145728->4194303) 00002000:00010000:1.0:1746065134.794936:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41500 00000100:00100000:0.0:1746065134.799307:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.800658:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.802734:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.802761:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047168 00000100:00100000:1.0:1746065134.802765:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047168 00000100:00100000:1.0:1746065134.802803:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047040 00000100:00100000:1.0:1746065134.802805:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047040 00000100:00100000:1.0:1746065134.802817:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12008 00000100:00100000:1.0:1746065134.802822:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263047168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065134.802829:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.802837:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b73 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.802850:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.802851:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.802858:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065134.802877:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065134.802887:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2400, rc 0) 00000100:00100000:1.0:1746065134.802910:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263047168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 88us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.802916:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12008 00000100:00100000:1.0:1746065134.802930:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12009 00000100:00100000:1.0:1746065134.802935:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263047040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065134.802940:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.802946:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146c814 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b6c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.802968:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263152640:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065134.802993:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.807660:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.807728:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047424 00000100:00100000:1.0:1746065134.807736:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047424 00002000:00100000:1.0:1746065134.807769:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880129f42d80 x1830881263047424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.807792:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42d80 with x1830881263047424 ext(2097152->3145727) 00002000:00010000:1.0:1746065134.807796:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f42d80 00000100:00100000:1.0:1746065134.808484:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3154 00000100:00100000:1.0:1746065134.808491:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263047424:12345-192.168.202.27@tcp:3:cat.0 00002000:00010000:1.0:1746065134.812542:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065134 -> 1746065135 00000100:00100000:1.0:1746065134.812552:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263152640:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065134.812577:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146c814 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b6c expref: 26 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065134.812589:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146c814 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b6c expref: 26 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065134.812602:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2c00, rc 0) 00000100:00100000:1.0:1746065134.812629:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263047040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9693us (9895us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065134.812637:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12009 00000100:00100000:1.0:1746065134.828422:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263047424:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19923us (20764us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065134.828432:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3154 00002000:00100000:1.0:1746065134.828441:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880129f42d80 x1830881263047424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/440 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.828449:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42d80 with x1830881263047424 ext(2097152->3145727) 00002000:00010000:1.0:1746065134.828454:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f42d80 00000100:00100000:0.0:1746065134.829160:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.829199:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047680 00000100:00100000:1.0:1746065134.829205:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047680 00002000:00100000:1.0:1746065134.829232:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff880076cf4700 x1830881263047680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.829239:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf4700 with x1830881263047680 ext(4194304->4816895) 00002000:00010000:1.0:1746065134.829242:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880076cf4700 00000100:00100000:1.0:1746065134.829271:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3155 00000100:00100000:1.0:1746065134.829278:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263047680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065134.845309:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263047680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16023us (16142us total) trans 0 rc 622592/622592 00000100:00100000:1.0:1746065134.845318:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3155 00002000:00100000:1.0:1746065134.845327:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff880076cf4700 x1830881263047680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:50/0 lens 488/440 e 0 to 0 dl 1746065145 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.845336:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf4700 with x1830881263047680 ext(4194304->4816895) 00002000:00010000:1.0:1746065134.845341:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880076cf4700 00000100:00100000:1.0:1746065134.851734:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12010 00000100:00100000:1.0:1746065134.851744:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+38:31613:x1830881263047808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065134.851755:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.851765:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3400/0xad6b7ddc146c83e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b7a expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.851798:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.851800:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.851805:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3400/0xad6b7ddc146c83e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b7a expref: 39 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.851815:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3400/0xad6b7ddc146c83e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b7a expref: 39 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.851822:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3400, rc 0) 00000100:00100000:1.0:1746065134.851847:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+39:31613:x1830881263047808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 106us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.851851:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12010 00000100:00100000:0.0:1746065134.864100:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.864135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.864218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.864631:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048192 00000100:00100000:1.0:1746065134.864635:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048192 00000100:00100000:1.0:1746065134.864655:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048320 00000100:00100000:1.0:1746065134.864657:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048320 00000100:00100000:1.0:1746065134.864668:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12011 00000100:00100000:1.0:1746065134.864673:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+25:31610:x1830881263048192:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065134.864685:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.864696:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146c845 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b88 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.864715:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 32 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.864722:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 26 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065134.864727:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.864728:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.864731:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146c845 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b88 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.864752:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 26 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065134.864761:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 26 pid: 9548 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746065134.864793:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263152768:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065134.864851:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 32 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.864859:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 32 pid: 12258 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065134.864871:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263152896:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065134.864886:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.864942:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12012 00000100:00100000:1.0:1746065134.864948:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263048320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065134.864955:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065134.864963:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146c84c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931b8f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.864986:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263153024:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065134.865006:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.868976:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.869017:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.869055:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.869709:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048832 00000100:00100000:1.0:1746065134.869712:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048832 00002000:00100000:1.0:1746065134.869735:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880076cf6680 x1830881263048832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.869743:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf6680 with x1830881263048832 ext(2097152->4194303) 00002000:00010000:1.0:1746065134.869747:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880076cf6680 00000100:00100000:1.0:1746065134.869757:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049088 00000100:00100000:1.0:1746065134.869758:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049088 00002000:00100000:1.0:1746065134.869766:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880076cf7100 x1830881263049088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/0 e 0 to 0 dl 1746065145 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.869792:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf7100 with x1830881263049088 ext(3145728->4194303) 00010000:00010000:1.0:1746065134.869797:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.869810:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065134.869814:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880076cf7100 00000100:00100000:1.0:1746065134.869830:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1130 00000100:00100000:1.0:1746065134.869835:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263049088:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065134.875094:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.875188:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263153024:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065134.875212:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146c84c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b8f expref: 19 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065134.875224:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146c84c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b8f expref: 19 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065134.875236:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:0.0:1746065134.875269:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263048320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10321us (11133us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065134.875277:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12012 00000100:00100000:0.0:1746065134.875305:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049216 00000100:00100000:0.0:1746065134.875310:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049216 00010000:00010000:0.0:1746065134.875329:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 29 pid: 9548 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746065134.875346:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5296 00000100:00100000:0.0:1746065134.875351:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+29:2006:x1830881263049216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065134.875361:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065134.875372:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 29 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.875380:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 29 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:0.0:1746065134.875395:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065134.875408:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+29:2006:x1830881263049216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065134.875413:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5296 00010000:00010000:1.0:1746065134.875551:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2400/0xad6b7ddc146c80d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b73 expref: 28 pid: 9548 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746065134.875566:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263152768:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065134.875575:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263152896:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065134.875590:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146c845 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b88 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.875597:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2600, rc 0) 00000100:00100000:1.0:1746065134.875614:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:31610:x1830881263048192:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10941us (11522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.875619:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12011 00000100:00100000:1.0:1746065134.878695:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263049088:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8850us (9630us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065134.878705:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1130 00002000:00100000:1.0:1746065134.878714:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880076cf7100 x1830881263049088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:50/0 lens 488/440 e 0 to 0 dl 1746065145 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065134.878728:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880076cf7100 with x1830881263049088 ext(3145728->4194303) 00010000:00010000:1.0:1746065134.878735:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.878747:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00002000:00010000:1.0:1746065134.878753:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880076cf7100 00000100:00100000:0.0:1746065134.880737:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.885807:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.885878:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049472 00000100:00100000:1.0:1746065134.885886:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049472 00010000:00010000:1.0:1746065134.885919:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065134.885978:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5297 00000100:00100000:1.0:1746065134.885986:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263049472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.885998:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.886016:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.886028:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.886047:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d200/0xad6b7ddc146c7ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b5e expref: 33 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.886548:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.886552:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.886561:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146c845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b88 expref: 25 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.886569:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146c845 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b88 expref: 25 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.886605:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146c845 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b88 expref: 25 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.886618:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263153280:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065134.887573:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.888496:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.888526:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.888550:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.888566:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049600 00000100:00100000:0.0:1746065134.888570:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049600 00000100:00100000:0.0:1746065134.888606:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049728 00000100:00100000:0.0:1746065134.888609:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049728 00000100:00100000:0.0:1746065134.888620:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049856 00000100:00100000:0.0:1746065134.888622:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049856 00000100:00100000:0.0:1746065134.888634:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12015 00000100:00100000:0.0:1746065134.888639:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263049600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065134.888652:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065134.888664:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67000/0xad6b7ddc146c861 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931ba4 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065134.888698:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880076cf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263153408:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065134.888746:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065134.888762:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12016 00000100:00100000:0.0:1746065134.888767:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880076cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263049728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065134.888793:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065134.888803:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146c868 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931bab expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065134.888826:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263153536:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065134.888856:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.894242:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263153280:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065134.894255:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.894303:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880076cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263049472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8317us (8530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.894310:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5297 00000100:00100000:0.0:1746065134.904968:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.912447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.920103:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.924576:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.924662:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263051008 00000100:00100000:1.0:1746065134.924668:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263051008 00010000:00010000:1.0:1746065134.924692:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099524800/0xad6b7ddc146c7c0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b3b expref: 20 pid: 13375 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065134.924713:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5298 00000100:00100000:1.0:1746065134.924718:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263051008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.924730:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.924744:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099524800/0xad6b7ddc146c7c0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b3b expref: 20 pid: 13375 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.924759:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099524800/0xad6b7ddc146c7c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b3b expref: 20 pid: 13375 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.924798:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.924823:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263051008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.924828:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5298 00000100:00100000:0.0:1746065134.927382:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.928661:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.928730:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263051264 00000100:00100000:1.0:1746065134.928734:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263051264 00010000:00010000:1.0:1746065134.928750:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d400/0xad6b7ddc146c7f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b57 expref: 18 pid: 12258 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065134.928841:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5300 00000100:00100000:1.0:1746065134.928846:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263051264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.928853:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.928861:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db9d400/0xad6b7ddc146c7f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b57 expref: 18 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.928869:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db9d400/0xad6b7ddc146c7f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b57 expref: 18 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.928880:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d400/0xad6b7ddc146c7f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b57 expref: 18 pid: 12258 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.928900:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.928902:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.928907:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993fc00/0xad6b7ddc146c87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc0 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.928913:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fc00/0xad6b7ddc146c87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc0 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.928936:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009993fc00/0xad6b7ddc146c87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc0 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.928947:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263154048:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065134.928996:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.930337:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263154048:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065134.930350:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.930413:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263051264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1564us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.930421:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5300 00000100:00100000:0.0:1746065134.931051:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.947243:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.959639:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.959836:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263052032 00000100:00100000:1.0:1746065134.959845:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263052032 00010000:00010000:1.0:1746065134.959877:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fc00/0xad6b7ddc146c87d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc0 expref: 19 pid: 12260 timeout: 830 lvb_type: 0 00000100:00100000:1.0:1746065134.959961:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5301 00000100:00100000:1.0:1746065134.959970:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263052032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.959982:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065134.959996:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065134 -> 1746065135 00002000:00010000:1.0:1746065134.959999:0:8352:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065134 -> 1746065135 00010000:00010000:1.0:1746065134.960004:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009993fc00/0xad6b7ddc146c87d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc0 expref: 19 pid: 12260 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.960015:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009993fc00/0xad6b7ddc146c87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc0 expref: 19 pid: 12260 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.960035:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993fc00/0xad6b7ddc146c87d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2658303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc0 expref: 19 pid: 12260 timeout: 830 lvb_type: 0 00010000:00010000:1.0:1746065134.960051:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.960053:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065134.960059:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b400/0xad6b7ddc146c884 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc7 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.960066:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b400/0xad6b7ddc146c884 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc7 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065134.960108:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b400/0xad6b7ddc146c884 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc7 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065134.960119:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263154304:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065134.960201:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065134.964163:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263154304:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065134.964182:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.964217:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263052032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4247us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.964225:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5301 00000100:00100000:0.0:1746065134.966362:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.967579:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.972983:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065134.973035:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263052544 00000100:00100000:1.0:1746065134.973041:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263052544 00010000:00010000:1.0:1746065134.973065:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc146c44e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931958 expref: 10 pid: 9548 timeout: 830 lvb_type: 1 00000100:00100000:1.0:1746065134.973105:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5302 00000100:00100000:1.0:1746065134.973110:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090019500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263052544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065134.973122:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065134.973136:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc146c44e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931958 expref: 10 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.973144:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc146c44e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931958 expref: 10 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.973161:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc146c44e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931958 expref: 10 pid: 9548 timeout: 830 lvb_type: 1 00010000:00010000:1.0:1746065134.973429:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065134.973830:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090019500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263052544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 719us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065134.973836:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5302 00000100:00100000:0.0:1746065134.975237:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.975265:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.980110:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.984285:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.986474:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.990278:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.990304:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.990322:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.990342:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.997044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065134.999894:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065135.001342:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065135.010023:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.014395:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065135.014888:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065135.066014:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065135.066605:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065135.068513:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.068719:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263055488 00000100:00100000:1.0:1746065135.068725:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263055488 00000100:00100000:1.0:1746065135.068764:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4771 00000100:00100000:1.0:1746065135.068797:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009001bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+27:31622:x1830881263055488:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065135.068936:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009001bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+28:31622:x1830881263055488:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 166us (427us total) trans 8589935670 rc 0/0 00000100:00100000:1.0:1746065135.068941:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4771 00000100:00100000:0.0:1746065135.072170:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.072280:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263055616 00000100:00100000:1.0:1746065135.072286:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263055616 00000100:00100000:1.0:1746065135.072334:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12026 00000100:00100000:1.0:1746065135.072341:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+17:31622:x1830881263055616:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065135.072354:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.072368:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc146c8d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931bf8 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.072391:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b400/0xad6b7ddc146c884 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc7 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.072398:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.072400:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.072403:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc146c8d1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2506752->2543615] (req 2506752->2543615) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bf8 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.072425:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b400/0xad6b7ddc146c884 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc7 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.072435:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b400/0xad6b7ddc146c884 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bc7 expref: 38 pid: 12260 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.072445:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263155456:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065135.072513:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bb40 going to sleep for 11 seconds 00000100:00080000:0.0:1746065135.072732:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065135.075264:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.075363:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263155456:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065135.075386:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc146c8d1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2506752->2543615] (req 2506752->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bf8 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.075400:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0200, rc 0) 00000100:00080000:0.0:1746065135.075679:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065135.075687:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+18:31622:x1830881263055616:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3347us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.075693:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12026 00000100:00100000:0.0:1746065135.078146:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.137410:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.142648:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.142876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.145181:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.145217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.145241:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.145254:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.145288:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.145319:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263056768 00000100:00100000:0.0:1746065135.145325:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263056768 00000100:00100000:0.0:1746065135.145355:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263056896 00000100:00100000:0.0:1746065135.145357:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263056896 00000100:00100000:0.0:1746065135.145366:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057024 00000100:00100000:0.0:1746065135.145368:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057024 00000100:00100000:0.0:1746065135.145376:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057152 00000100:00100000:0.0:1746065135.145378:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057152 00000100:00100000:0.0:1746065135.145386:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057280 00000100:00100000:0.0:1746065135.145387:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057280 00000100:00100000:0.0:1746065135.145398:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12027 00000100:00100000:0.0:1746065135.145404:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:2006:x1830881263056768:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065135.145419:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.145433:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b7600/0xad6b7ddc146c8fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c06 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.145473:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263155712:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065135.145533:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00080000:0.0:1746065135.145545:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065135.145556:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12028 00000100:00100000:0.0:1746065135.145561:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263056896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065135.145567:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.145575:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c902 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c0d expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.145598:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263155840:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065135.145617:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.145631:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12029 00000100:00100000:0.0:1746065135.145635:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263057024:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065135.145641:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.145646:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146c909 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c14 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.145662:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263155968:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065135.145679:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.145693:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12030 00000100:00100000:0.0:1746065135.145697:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+28:2006:x1830881263057152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065135.145703:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.145710:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146c910 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c1b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.145727:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263156096:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065135.145743:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.145756:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12031 00000100:00100000:0.0:1746065135.145761:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+29:2006:x1830881263057280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065135.145766:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.145801:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146c917 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c22 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.145817:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146c917 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c22 expref: 30 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.145826:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146c917 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c22 expref: 30 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.145837:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5800, rc 0) 00000100:00100000:0.0:1746065135.145853:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+29:2006:x1830881263057280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 92us (565us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065135.145858:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12031 00002000:00010000:0.0:1746065135.154298:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065133 -> 1746065135 00002000:00010000:0.0:1746065135.154301:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065130 -> 1746065135 00002000:00010000:0.0:1746065135.154303:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065133 -> 1746065135 00000100:00100000:0.0:1746065135.154312:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263155712:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065135.154335:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b7600/0xad6b7ddc146c8fb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c06 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.154348:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b7600/0xad6b7ddc146c8fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c06 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.154357:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7600, rc 0) 00000100:00100000:0.0:1746065135.154394:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:2006:x1830881263056768:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8989us (9218us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065135.154401:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12027 00002000:00010000:1.0:1746065135.154839:0:1880:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746065134 -> 1746065135 00002000:00010000:1.0:1746065135.154842:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746065134 -> 1746065135 00000100:00100000:1.0:1746065135.154849:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263156096:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065135.154863:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146c910 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c1b expref: 26 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.154870:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146c910 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c1b expref: 26 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.154880:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4200, rc 0) 00000100:00100000:1.0:1746065135.155623:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+25:2006:x1830881263057152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9924us (10366us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065135.155629:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12030 00000100:00100000:0.0:1746065135.158856:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.158924:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057408 00000100:00100000:1.0:1746065135.158932:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057408 00000100:00100000:1.0:1746065135.158973:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12032 00000100:00100000:1.0:1746065135.158979:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+25:31626:x1830881263057408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065135.158995:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.159009:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146c91e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c29 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.159033:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146c88b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 479232->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bce expref: 32 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.159040:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.159042:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.159045:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146c91e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c29 expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.159080:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146c88b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 479232->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bce expref: 32 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.159090:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61200/0xad6b7ddc146c88b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 479232->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bce expref: 32 pid: 12260 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.159101:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263156224:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065135.160384:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.163537:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.163599:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263156224:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065135.163623:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146c91e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c29 expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.163637:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1e00, rc 0) 00000100:00100000:1.0:1746065135.163684:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+26:31626:x1830881263057408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4704us (4834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.163696:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12032 00000100:00100000:0.0:1746065135.177985:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.187375:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.205473:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.205647:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058048 00000100:00100000:1.0:1746065135.205655:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058048 00000100:00100000:0.0:1746065135.213272:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.217671:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.221254:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.221285:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058560 00000100:00100000:0.0:1746065135.221293:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058560 00000100:00080000:1.0:1746065135.224010:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065135.226753:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.226868:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.230286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.230312:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.231285:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.231332:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059072 00000100:00100000:0.0:1746065135.231336:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059072 00010000:00010000:0.0:1746065135.231358:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc146c899 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bdc expref: 40 pid: 12260 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065135.231380:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059200 00000100:00100000:0.0:1746065135.231382:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059200 00010000:00010000:0.0:1746065135.231391:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b26 expref: 32 pid: 9571 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065135.231410:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5310 00000100:00100000:0.0:1746065135.231416:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263059072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065135.231429:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065135.231444:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc146c899 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bdc expref: 40 pid: 12260 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.231452:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc146c899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bdc expref: 40 pid: 12260 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.231467:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc146c899 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bdc expref: 40 pid: 12260 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.231480:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.231482:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.231486:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.231496:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.231515:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.231524:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c36300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263156864:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065135.231545:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.231559:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5311 00000100:00100000:0.0:1746065135.231564:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+32:2007:x1830881263059200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065135.231571:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065135.231576:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b26 expref: 32 pid: 9571 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.231582:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b26 expref: 32 pid: 9571 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.231594:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146c7a4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b26 expref: 32 pid: 9571 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.231602:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065135.231606:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146c964 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.231613:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146c964 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.231617:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146c964 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.231634:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.231651:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+31:2007:x1830881263059200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.231659:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5311 00000100:00100000:0.0:1746065135.234621:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.234710:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c36300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263156864:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065135.234723:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.234742:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263059072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3327us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.234749:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5310 00000100:00100000:0.0:1746065135.236848:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.236881:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.236889:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059712 00000100:00100000:1.0:1746065135.236894:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059712 00002000:00100000:1.0:1746065135.236918:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa8380 x1830881263059712/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.236926:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881263059712 ext(1048576->2097151) 00002000:00010000:1.0:1746065135.236929:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:0.0:1746065135.236942:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.236953:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3166 00000100:00100000:0.0:1746065135.236958:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059840 00000100:00100000:1.0:1746065135.236959:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263059712:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065135.236961:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059840 00000100:00100000:0.0:1746065135.236983:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059968 00000100:00100000:0.0:1746065135.236985:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059968 00000100:00100000:0.0:1746065135.236998:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12035 00000100:00100000:0.0:1746065135.237003:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263059840:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065135.237011:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.237024:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146c972 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c4c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.237040:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.237042:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.237049:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146c972 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c4c expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.237060:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146c972 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c4c expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.237086:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4a00, rc 0) 00000100:00100000:0.0:1746065135.237111:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263059840:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.237116:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12035 00000100:00100000:0.0:1746065135.237129:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12036 00000100:00100000:0.0:1746065135.237134:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2004:x1830881263059968:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065135.237140:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.237147:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c53 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.237157:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.237159:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.237163:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 7 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.237311:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 7 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.237322:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4c00, rc 0) 00000100:00100000:0.0:1746065135.237339:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263059968:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 205us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.237344:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12036 00000100:00100000:0.0:1746065135.238168:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.238422:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.238435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.238449:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.238460:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060096 00000100:00100000:0.0:1746065135.238463:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060096 00000100:00100000:0.0:1746065135.238478:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060224 00000100:00100000:0.0:1746065135.238479:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060224 00000100:00100000:0.0:1746065135.238497:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060352 00000100:00100000:0.0:1746065135.238499:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060352 00000100:00100000:0.0:1746065135.238512:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12037 00000100:00100000:0.0:1746065135.238516:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263060096:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065135.238524:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.238532:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4e00/0xad6b7ddc146c980 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c5a expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.238567:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263156992:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065135.238621:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.238634:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12039 00000100:00100000:0.0:1746065135.238640:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263060352:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065135.238645:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.238651:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146c98e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c68 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.238666:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146c98e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c68 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.238673:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146c98e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c68 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.238681:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4800, rc 0) 00000100:00100000:0.0:1746065135.238695:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263060352:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 55us (245us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065135.238700:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12039 00000100:00100000:0.0:1746065135.238731:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.238742:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060480 00000100:00100000:0.0:1746065135.238745:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060480 00000100:00100000:0.0:1746065135.238767:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12040 00000100:00100000:0.0:1746065135.238791:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263060480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065135.238798:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.238804:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146c9aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c6f expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.238824:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263157248:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065135.238853:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00080000:1.0:1746065135.239049:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065135.239052:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1746065135.241928:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065134 -> 1746065135 00000100:00100000:1.0:1746065135.241938:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263157248:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065135.241953:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146c9aa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c6f expref: 9 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.241966:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146c9aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c6f expref: 9 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.241982:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4200, rc 0) 00000100:00100000:1.0:1746065135.242005:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263060480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3233us (3273us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065135.242012:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12040 00000100:00100000:0.0:1746065135.247334:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.247356:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.247378:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060864 00000100:00100000:1.0:1746065135.247385:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060864 00010000:00010000:1.0:1746065135.247414:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146c7b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b2d expref: 41 pid: 13375 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.247441:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5312 00000100:00100000:1.0:1746065135.247447:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263060864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.247457:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.247470:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146c7b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b2d expref: 41 pid: 13375 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.247480:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146c7b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b2d expref: 41 pid: 13375 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.247496:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc146c7b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b2d expref: 41 pid: 13375 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.247512:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.247514:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.247520:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146c96b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c45 expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.247526:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146c96b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c45 expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.247550:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146c96b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c45 expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.247561:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c34a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263157376:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065135.247610:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.250749:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.250943:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c34a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263157376:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065135.250958:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.250995:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263060864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3547us (3639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.251003:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5312 00000100:00100000:1.0:1746065135.255085:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.255116:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.255142:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.255157:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.255170:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.255182:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.255200:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062016 00000100:00100000:1.0:1746065135.255207:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062016 00000100:00100000:1.0:1746065135.255236:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062144 00000100:00100000:1.0:1746065135.255238:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062144 00000100:00100000:1.0:1746065135.255248:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062272 00000100:00100000:1.0:1746065135.255250:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062272 00000100:00100000:1.0:1746065135.255261:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12041 00000100:00100000:1.0:1746065135.255268:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263062016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065135.255282:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.255295:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c8b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.255313:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.255315:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.255322:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.255334:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.255343:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:1.0:1746065135.255375:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263062016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 107us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.255380:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12041 00000100:00100000:1.0:1746065135.255393:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12042 00000100:00100000:1.0:1746065135.255397:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263062144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065135.255403:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.255411:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc146c9e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c92 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.255425:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.255426:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.255430:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc146c9e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c92 expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.255443:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc146c9e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c92 expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.255449:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1a00, rc 0) 00000100:00100000:1.0:1746065135.255461:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263062144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 64us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.255465:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12042 00000100:00100000:1.0:1746065135.255474:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12043 00000100:00100000:1.0:1746065135.255478:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263062272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065135.255482:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.255488:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146c9f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931c99 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.255516:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263157760:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065135.255989:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.256018:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.256033:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062400 00000100:00100000:1.0:1746065135.256036:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062400 00000100:00100000:1.0:1746065135.256051:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12044 00000100:00100000:1.0:1746065135.256055:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263062400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065135.256064:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.256083:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146c9f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931ca0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.256100:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146c9f7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ca0 expref: 36 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.256108:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146c9f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ca0 expref: 36 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.256116:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b400, rc 0) 00000100:00100000:1.0:1746065135.256131:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263062400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 75us (113us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065135.256136:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12044 00000100:00100000:1.0:1746065135.256190:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.256203:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062528 00000100:00100000:1.0:1746065135.256206:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062528 00000100:00100000:1.0:1746065135.256220:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12045 00000100:00100000:1.0:1746065135.256224:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881263062528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065135.256230:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.256237:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146c9fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931ca7 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.256258:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263157888:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065135.256286:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.256579:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263061760 00000100:00100000:0.0:1746065135.256583:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263061760 00010000:00010000:0.0:1746065135.256601:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146c9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c76 expref: 50 pid: 7203 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065135.256629:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263061888 00000100:00100000:0.0:1746065135.256632:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263061888 00010000:00010000:0.0:1746065135.256641:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146c964 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c3e expref: 11 pid: 7203 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065135.256660:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5313 00000100:00100000:0.0:1746065135.256665:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263061760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065135.256673:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065135.256678:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146c9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c76 expref: 50 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.256686:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146c9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c76 expref: 50 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.256705:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146c9b1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c76 expref: 50 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.256717:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065135.256721:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146c9db lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.256728:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146c9db lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.256733:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.256750:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881263061760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.256756:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5313 00000100:00100000:0.0:1746065135.262182:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263157760:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065135.262210:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146c9f0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c99 expref: 44 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.262224:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146c9f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c99 expref: 44 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.262235:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0600, rc 0) 00000100:00100000:0.0:1746065135.262271:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881263062272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6791us (7087us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065135.262279:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12043 00000100:00100000:0.0:1746065135.269023:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.272859:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.274021:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.274446:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.275809:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063296 00000100:00100000:0.0:1746065135.275813:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063296 00010000:00010000:0.0:1746065135.275830:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146c9db lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c84 expref: 12 pid: 7203 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065135.275854:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5315 00000100:00100000:0.0:1746065135.275858:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263063296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065135.275866:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065135.275870:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146c9db lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c84 expref: 12 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.275880:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146c9db lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c84 expref: 12 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.275896:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146c9db lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c84 expref: 12 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.275914:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065135.275918:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146ca13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.275925:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146ca13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.275932:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146ca13 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.275944:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.275964:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263063296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.275969:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5315 00000100:00100000:0.0:1746065135.276026:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.276656:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.279365:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.279748:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063808 00000100:00100000:1.0:1746065135.279755:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063808 00000100:00100000:1.0:1746065135.279810:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12047 00000100:00100000:1.0:1746065135.279817:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+43:31631:x1830881263063808:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065135.279831:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.279844:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931cbc expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.279867:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.279874:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc146c9e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c92 expref: 44 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.279881:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 6 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.279887:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.279889:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.279892:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1777664->2097151] (req 1777664->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.279916:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 6 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.279925:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 6 pid: 1880 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746065135.279935:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263158272:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065135.279988:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc146c9e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c92 expref: 44 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.279995:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc146c9e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c92 expref: 44 pid: 1880 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746065135.280001:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263158400:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065135.280019:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.280025:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 19 pid: 11461 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.280031:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263158528:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065135.280043:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.281690:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.285016:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.285871:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064064 00000100:00100000:0.0:1746065135.285879:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064064 00000100:00100000:1.0:1746065135.287021:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.287037:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064192 00000100:00100000:1.0:1746065135.287040:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064192 00010000:00010000:1.0:1746065135.287056:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 20 pid: 11461 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.287089:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5316 00000100:00100000:1.0:1746065135.287096:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263064192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.287107:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.287119:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 20 pid: 11461 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.287129:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 20 pid: 11461 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.287154:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.287188:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263064192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.287194:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5316 00010000:00010000:0.0:1746065135.287197:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 7 pid: 1880 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746065135.287224:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5317 00000100:00100000:0.0:1746065135.287230:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263064064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065135.287238:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065135.287245:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 7 pid: 1880 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746065135.287254:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 7 pid: 1880 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746065135.287266:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065135.287280:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263064064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.287286:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5317 00010000:00010000:0.0:1746065135.287321:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146c979 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c53 expref: 6 pid: 1880 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746065135.287606:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263158272:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065135.287623:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263158400:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065135.287632:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc146c925 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c30 expref: 19 pid: 11461 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065135.287641:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263158528:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065135.288292:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1777664->2097151] (req 1777664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.288303:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06c00, rc 0) 00000100:00100000:1.0:1746065135.289299:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.289347:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.289360:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.289371:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.289393:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.289406:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064832 00000100:00100000:1.0:1746065135.289409:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064832 00000100:00100000:1.0:1746065135.289430:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12048 00000100:00100000:1.0:1746065135.289436:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263064320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065135.289448:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.289459:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc146ca28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931cc3 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.289471:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.289477:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc146ca28 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cc3 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.289485:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc146ca28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cc3 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.289499:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06e00, rc 0) 00000100:00100000:0.0:1746065135.289670:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+44:31631:x1830881263063808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9851us (10308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.289677:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12047 00000100:00100000:0.0:1746065135.289692:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12051 00000100:00100000:0.0:1746065135.289697:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263064832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065135.289703:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.289710:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0c00/0xad6b7ddc146ca3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931cdf expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.289730:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263158912:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065135.290546:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263064320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1109us (1246us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065135.290552:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12048 00000100:00100000:0.0:1746065135.291035:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.293373:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.294679:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263063936:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11167us (12992us total) trans 21474840699 rc 0/0 00000100:00100000:1.0:1746065135.294687:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1136 00002000:00100000:1.0:1746065135.294694:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1622015) req@ffff880097fa8700 x1830881263063936/t21474840699(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.294702:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8700 with x1830881263063936 ext(1048576->1622015) 00010000:00010000:1.0:1746065135.294708:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146c7b9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b34 expref: 37 pid: 13375 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.294717:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146c7b9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b34 expref: 37 pid: 13375 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.294722:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa8700 00000100:00100000:0.0:1746065135.298382:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.298457:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.298660:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065088 00000100:00100000:1.0:1746065135.298667:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065088 00010000:00010000:1.0:1746065135.298690:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146c7b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b34 expref: 37 pid: 13375 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.298708:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065216 00000100:00100000:1.0:1746065135.298710:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065216 00010000:00010000:1.0:1746065135.298719:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc146c9e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c92 expref: 43 pid: 1880 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746065135.298733:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5318 00000100:00100000:1.0:1746065135.298738:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263065088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.298748:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.298760:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146c7b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b34 expref: 37 pid: 13375 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.298769:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146c7b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b34 expref: 37 pid: 13375 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.299150:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146c7b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b34 expref: 37 pid: 13375 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.299280:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.299282:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.299287:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc146ca1a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cb5 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.299294:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc146ca1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cb5 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.299312:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc146ca1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cb5 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.299320:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263159296:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065135.300034:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.300078:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.300712:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.300909:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065728 00000100:00100000:1.0:1746065135.300912:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065728 00002000:00100000:1.0:1746065135.300932:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1777664->1781759) req@ffff880097fa8a80 x1830881263065728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.300941:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8a80 with x1830881263065728 ext(1777664->1781759) 00010000:00010000:1.0:1746065135.300946:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 42 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.300956:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 42 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.300962:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa8a80 00000100:00100000:1.0:1746065135.300973:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1137 00000100:00100000:1.0:1746065135.300978:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263065728:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065135.301053:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263065728:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 75us (342us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.301058:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1137 00002000:00100000:1.0:1746065135.301063:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1777664->1781759) req@ffff880097fa8a80 x1830881263065728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.301083:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8a80 with x1830881263065728 ext(1777664->1781759) 00010000:00010000:1.0:1746065135.301087:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 42 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.301096:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 42 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.301107:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa8a80 00000100:00100000:1.0:1746065135.302023:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263159296:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065135.302033:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.302051:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263065088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3312us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.302057:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5318 00000100:00100000:0.0:1746065135.302744:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.302926:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.308296:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.308338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.308363:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263066496 00000100:00100000:1.0:1746065135.308371:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263066496 00002000:00100000:1.0:1746065135.308404:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1777664->2097151) req@ffff88008c528380 x1830881263066496/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.308414:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528380 with x1830881263066496 ext(1777664->2097151) 00010000:00010000:1.0:1746065135.308422:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 43 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.308433:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 43 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.308440:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c528380 00000100:00100000:1.0:1746065135.308452:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1138 00000100:00100000:1.0:1746065135.308457:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263066496:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065135.312360:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.313897:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263066496:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 5437us (5606us total) trans 17179873265 rc 0/0 00000100:00100000:1.0:1746065135.313905:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1138 00002000:00100000:1.0:1746065135.313911:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1777664->2097151) req@ffff88008c528380 x1830881263066496/t17179873265(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.313919:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528380 with x1830881263066496 ext(1777664->2097151) 00010000:00010000:1.0:1746065135.313925:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 45 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.313935:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 45 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.313941:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c528380 00000100:00100000:0.0:1746065135.314307:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.315599:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.315644:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067008 00000100:00100000:1.0:1746065135.315648:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067008 00010000:00010000:1.0:1746065135.315669:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 45 pid: 1880 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.315698:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5320 00000100:00100000:1.0:1746065135.315704:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881263067008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.315713:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.315725:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 45 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.315734:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 45 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.315749:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d06c00/0xad6b7ddc146ca21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cbc expref: 45 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.315930:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.315933:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.315939:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.315946:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.315980:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065135.315991:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263159680:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065135.316023:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.316726:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.316971:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1140 00000100:00100000:1.0:1746065135.316978:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263067136:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065135.317337:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.319864:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881263067136:12345-192.168.202.27@tcp:4:cat.0 Request processed in 2886us (3137us total) trans 21474840700 rc 0/0 00000100:00100000:1.0:1746065135.319871:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1140 00002000:00100000:1.0:1746065135.319878:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2715648->3145727) req@ffff880097c35880 x1830881263067136/t21474840700(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:51/0 lens 488/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.319886:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c35880 with x1830881263067136 ext(2715648->3145727) 00010000:00010000:1.0:1746065135.319893:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146c845 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b88 expref: 30 pid: 9548 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.319903:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146c845 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2715648->3145727] (req 2715648->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b88 expref: 30 pid: 9548 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.319909:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097c35880 00000100:00100000:0.0:1746065135.321555:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.321584:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.321677:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067520 00000100:00100000:1.0:1746065135.321683:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067520 00002000:00100000:1.0:1746065135.321706:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097c34e00 x1830881263067520/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.321720:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c34e00 with x1830881263067520 ext(1048576->2097151) 00002000:00010000:1.0:1746065135.321723:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c34e00 00000100:00100000:1.0:1746065135.321741:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067776 00000100:00100000:1.0:1746065135.321742:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067776 00002000:00100000:1.0:1746065135.321750:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097c35f80 x1830881263067776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.321757:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c35f80 with x1830881263067776 ext(1048576->2097151) 00002000:00010000:1.0:1746065135.321759:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c35f80 00000100:00100000:1.0:1746065135.321792:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3172 00000100:00100000:1.0:1746065135.321796:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881263067776:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065135.322476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.326370:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881263067776:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 4570us (4782us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065135.326377:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3172 00002000:00100000:1.0:1746065135.326385:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097c35f80 x1830881263067776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/440 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.326393:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c35f80 with x1830881263067776 ext(1048576->2097151) 00002000:00010000:1.0:1746065135.326397:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c35f80 00000100:00100000:0.0:1746065135.331523:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.331563:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.331589:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.331813:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263068160 00000100:00100000:1.0:1746065135.331820:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263068160 00002000:00100000:1.0:1746065135.331853:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097c36680 x1830881263068160/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.331863:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c36680 with x1830881263068160 ext(2097152->4194303) 00002000:00010000:1.0:1746065135.331867:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c36680 00000100:00100000:1.0:1746065135.331892:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3173 00000100:00100000:1.0:1746065135.331898:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+29:2005:x1830881263068160:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065135.341958:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.346404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.346506:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263069056 00000100:00100000:1.0:1746065135.346514:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263069056 00002000:00100000:1.0:1746065135.346552:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a4e51f80 x1830881263069056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.346561:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51f80 with x1830881263069056 ext(1048576->2097151) 00002000:00010000:1.0:1746065135.346565:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e51f80 00000100:00100000:0.0:1746065135.347676:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+29:2005:x1830881263068160:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15776us (16159us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065135.347686:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3173 00002000:00100000:0.0:1746065135.347692:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097c36680 x1830881263068160/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:51/0 lens 488/440 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065135.347699:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c36680 with x1830881263068160 ext(2097152->4194303) 00002000:00010000:0.0:1746065135.347702:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c36680 00000100:00100000:0.0:1746065135.347718:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3175 00000100:00100000:0.0:1746065135.347724:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263069056:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065135.362113:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.362150:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.364649:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.371237:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.371281:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.398969:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.400049:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.408402:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.417763:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.434994:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.435265:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.436169:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263070976 00000100:00100000:0.0:1746065135.436174:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263070976 00000100:00100000:0.0:1746065135.436210:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13407 00000100:00100000:0.0:1746065135.436217:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+32:31639:x1830881263070976:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065135.436236:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.436257:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146caa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931d3a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.436561:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436573:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436582:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436592:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436597:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436602:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436677:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146cabb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436686:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146cabb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436691:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146cabb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065135.436698:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065135.436751:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436756:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436765:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436771:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436810:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835ca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065135.436813:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436819:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436828:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065135.436830:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065135.436833:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436838:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146caad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436855:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436859:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436863:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436868:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835de00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065135.436870:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436878:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436883:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098ce5100) 00010000:00010000:0.0:1746065135.436885:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065135.436887:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436891:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc146cab4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.436919:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146caa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d3a expref: 35 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.436933:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146cabb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d3a expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.436939:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065135.436941:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065135.436943:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d000, rc 0) 00000100:00100000:0.0:1746065135.436979:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+34:31639:x1830881263070976:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 763us (1715us total) trans 8589935681 rc 0/0 00000100:00100000:0.0:1746065135.436985:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13407 00000100:00100000:0.0:1746065135.447094:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.447587:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3178 00000100:00100000:0.0:1746065135.447596:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263071232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065135.463434:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263071232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15833us (16339us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065135.463443:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3178 00002000:00100000:1.0:1746065135.463452:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009856c000 x1830881263071232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/440 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.463462:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c000 with x1830881263071232 ext(2097152->4194303) 00002000:00010000:1.0:1746065135.463467:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856c000 00000100:00100000:0.0:1746065135.470998:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.471050:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.473552:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.473834:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263071872 00000100:00100000:1.0:1746065135.473840:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263071872 00002000:00100000:1.0:1746065135.473868:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1236991) req@ffff8800972b3480 x1830881263071872/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.473875:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972b3480 with x1830881263071872 ext(1048576->1236991) 00010000:00010000:1.0:1746065135.473881:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc146ca60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cf4 expref: 47 pid: 3067 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.473947:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc146ca60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cf4 expref: 46 pid: 3067 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.473954:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972b3480 00000100:00100000:1.0:1746065135.474079:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1142 00000100:00100000:1.0:1746065135.474087:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2007:x1830881263071872:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065135.476168:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.479379:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+48:2007:x1830881263071872:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5287us (5825us total) trans 17179873268 rc 0/0 00000100:00100000:0.0:1746065135.479390:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1142 00002000:00100000:0.0:1746065135.479399:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1236991) req@ffff8800972b3480 x1830881263071872/t17179873268(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065135.479407:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972b3480 with x1830881263071872 ext(1048576->1236991) 00010000:00010000:0.0:1746065135.479415:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc146ca60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cf4 expref: 48 pid: 3067 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.479427:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc146ca60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cf4 expref: 48 pid: 3067 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065135.479432:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972b3480 00000100:00100000:0.0:1746065135.482056:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.483869:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.486663:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.486708:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.490877:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.492764:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.498447:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.661338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.674972:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.675006:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.675052:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263074048 00000100:00100000:0.0:1746065135.675061:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263074048 00002000:00100000:0.0:1746065135.675207:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff8800957d8700 x1830881263074048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065135.675215:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8700 with x1830881263074048 ext(1048576->2097151) 00002000:00010000:0.0:1746065135.675219:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8700 00000100:00100000:0.0:1746065135.675245:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3184 00000100:00100000:0.0:1746065135.675251:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263074048:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065135.703294:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.727265:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.731030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.731433:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.731458:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075072 00000100:00100000:0.0:1746065135.731461:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075072 00010000:00010000:0.0:1746065135.731477:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146cade lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d41 expref: 53 pid: 7203 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065135.731493:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5326 00000100:00100000:0.0:1746065135.731497:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881263075072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065135.731505:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065135.731509:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146cade lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d41 expref: 53 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.731518:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146cade lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d41 expref: 53 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.731534:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065135.731683:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.731690:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065135.731695:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.731736:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881263075072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 236us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.731743:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5326 00000100:00100000:1.0:1746065135.735173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.735338:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.735359:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.735374:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075200 00000100:00100000:1.0:1746065135.735380:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075200 00010000:00010000:1.0:1746065135.735404:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146cabb lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d3a expref: 37 pid: 7231 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.735423:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5327 00000100:00100000:1.0:1746065135.735429:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263075200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.735439:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.735444:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146cabb lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d3a expref: 37 pid: 7231 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.735451:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146cabb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d3a expref: 37 pid: 7231 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.735472:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065135.735476:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065135.735482:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065135.735486:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.735518:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263075200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.735523:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5327 00000100:00100000:1.0:1746065135.735568:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.735581:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075456 00000100:00100000:1.0:1746065135.735584:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075456 00010000:00010000:1.0:1746065135.735594:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146ca13 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cae expref: 11 pid: 7203 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.735605:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5328 00000100:00100000:1.0:1746065135.735609:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263075456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.735616:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.735619:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146ca13 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cae expref: 11 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.735625:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146ca13 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cae expref: 11 pid: 7203 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.735635:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065135.735637:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065135.735643:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065135.735648:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065135.735661:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.735677:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263075456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.735681:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5328 00000100:00100000:1.0:1746065135.735801:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263161984:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065135.735819:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc146cb16 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d72 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.735832:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45600, rc 0) 00000100:00100000:1.0:1746065135.735853:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+24:31650:x1830881263074816:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4643us (4823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.735859:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12068 00000100:00100000:1.0:1746065135.735873:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263074944 00000100:00100000:1.0:1746065135.735875:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263074944 00000100:00100000:1.0:1746065135.735890:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12069 00000100:00100000:1.0:1746065135.735895:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+46:31653:x1830881263074944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065135.735906:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.735916:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146cb1d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931d64 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.735937:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc146caf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d4f expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.735943:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.735945:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.735948:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146cb1d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d64 expref: 47 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.735967:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc146caf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d4f expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.735975:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc146caf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d4f expref: 23 pid: 11461 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.735984:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263162112:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065135.736026:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.736240:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075328 00000100:00100000:0.0:1746065135.736245:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075328 00002000:00100000:0.0:1746065135.736267:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2519040->2605055) req@ffff8800957da300 x1830881263075328/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065135.736273:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881263075328 ext(2519040->2605055) 00010000:00010000:0.0:1746065135.736278:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146caec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2519040->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d48 expref: 48 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.736286:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146caec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2519040->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d48 expref: 48 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065135.736291:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957da300 00000100:00100000:0.0:1746065135.736303:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1143 00000100:00100000:0.0:1746065135.736308:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881263075328:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065135.736416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.736430:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075712 00000100:00100000:0.0:1746065135.736432:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075712 00000100:00100000:0.0:1746065135.736451:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13410 00000100:00100000:0.0:1746065135.736455:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+52:31656:x1830881263075712:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065135.736466:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.736473:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146cb2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931d79 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.736526:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146cb32 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.736539:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146cb32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065135.736549:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146cb32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065135.736555:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065135.736594:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc146cb2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d79 expref: 55 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.736884:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146cb32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d79 expref: 54 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.736890:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065135.736892:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065135.736894:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d600, rc 0) 00000100:00100000:0.0:1746065135.736920:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+54:31656:x1830881263075712:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 463us (504us total) trans 8589935686 rc 0/0 00000100:00100000:0.0:1746065135.736925:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13410 00000100:00100000:0.0:1746065135.742826:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263162112:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065135.742851:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146cb1d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d64 expref: 49 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.742863:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71be00, rc 0) 00000100:00100000:0.0:1746065135.742899:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+51:31653:x1830881263074944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7003us (7732us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.742907:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12069 00000100:00100000:0.0:1746065135.751549:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.751601:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075968 00000100:00100000:1.0:1746065135.751608:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075968 00010000:00010000:1.0:1746065135.751638:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146caec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2519040->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d48 expref: 49 pid: 1880 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.751662:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5329 00000100:00100000:1.0:1746065135.751675:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881263075968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.751688:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.751703:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146caec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2519040->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d48 expref: 49 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.751712:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146caec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2519040->2605055) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d48 expref: 49 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.751738:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146caec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2519040->2605055) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d48 expref: 49 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.751765:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.751767:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.751790:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc146cb16 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d72 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.751798:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc146cb16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d72 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.751831:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc146cb16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d72 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.751842:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263162240:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065135.751915:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.755399:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263162240:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065135.755416:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.755450:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+48:2007:x1830881263075968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3775us (3907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.755459:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5329 00000100:00100000:0.0:1746065135.762951:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.763103:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263076096 00000100:00100000:1.0:1746065135.763112:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263076096 00010000:00010000:1.0:1746065135.763141:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc146caf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d4f expref: 26 pid: 11461 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.763178:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5330 00000100:00100000:1.0:1746065135.763185:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+26:2007:x1830881263076096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.763198:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.763212:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc146caf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d4f expref: 26 pid: 11461 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.763221:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc146caf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d4f expref: 26 pid: 11461 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.763242:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc146caf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d4f expref: 26 pid: 11461 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.763256:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.763257:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.763262:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146cb1d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d64 expref: 47 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.763269:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146cb1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d64 expref: 47 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.763295:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146cb1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d64 expref: 47 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.763306:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263162368:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065135.763379:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.765624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.767713:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.767823:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263162368:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065135.767841:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.767869:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263076096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4684us (4926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.767877:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5330 00000100:00100000:0.0:1746065135.775919:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.812179:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.816831:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.828939:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.830563:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.833108:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263077248 00000100:00100000:1.0:1746065135.833118:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263077248 00000100:00100000:1.0:1746065135.833182:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12072 00000100:00100000:1.0:1746065135.833190:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+25:31650:x1830881263077248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065135.833204:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.833218:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931d8e expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.833239:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 51 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.833246:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.833247:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065135.833249:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.833271:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 51 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.833281:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 51 pid: 1880 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.833290:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263162752:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065135.833348:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.833568:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263077120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16424us (16742us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065135.833577:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3186 00002000:00100000:1.0:1746065135.833586:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880136a78e00 x1830881263077120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/440 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.833594:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78e00 with x1830881263077120 ext(2097152->3145727) 00002000:00010000:1.0:1746065135.833598:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78e00 00000100:00100000:0.0:1746065135.837826:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.837951:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263162752:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065135.837980:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.837995:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2d600, rc 0) 00000100:00100000:0.0:1746065135.838032:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+26:31650:x1830881263077248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4843us (9102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065135.838041:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12072 00000100:00100000:1.0:1746065135.838254:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263077632 00000100:00100000:1.0:1746065135.838261:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263077632 00002000:00100000:1.0:1746065135.838292:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3256320->3260415) req@ffff880134b08380 x1830881263077632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.838300:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b08380 with x1830881263077632 ext(3256320->3260415) 00010000:00010000:1.0:1746065135.838306:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 50 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.838318:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 50 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.838324:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134b08380 00000100:00100000:1.0:1746065135.838352:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1146 00000100:00100000:1.0:1746065135.838359:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881263077632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065135.838458:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881263077632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 99us (640us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065135.838464:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1146 00002000:00100000:1.0:1746065135.838469:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3256320->3260415) req@ffff880134b08380 x1830881263077632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.838477:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b08380 with x1830881263077632 ext(3256320->3260415) 00010000:00010000:1.0:1746065135.838481:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 50 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.838490:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 50 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.838496:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134b08380 00000100:00100000:0.0:1746065135.846296:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263077888 00000100:00100000:0.0:1746065135.846304:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263077888 00002000:00100000:0.0:1746065135.846337:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3543040->3547135) req@ffff880097243480 x1830881263077888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065135.846346:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243480 with x1830881263077888 ext(3543040->3547135) 00010000:00010000:0.0:1746065135.846353:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 50 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.846365:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 50 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065135.846376:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097243480 00000100:00100000:0.0:1746065135.846396:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1147 00000100:00100000:0.0:1746065135.846402:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263077888:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065135.846518:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263077888:12345-192.168.202.27@tcp:3:cat.0 Request processed in 115us (295us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065135.846524:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1147 00002000:00100000:0.0:1746065135.846529:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3543040->3547135) req@ffff880097243480 x1830881263077888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065135.846537:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243480 with x1830881263077888 ext(3543040->3547135) 00010000:00010000:0.0:1746065135.846541:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 50 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746065135.846550:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 50 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746065135.846556:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097243480 00000100:00100000:0.0:1746065135.851058:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.852116:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.852127:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263078144 00000100:00100000:1.0:1746065135.854363:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263078144 00002000:00100000:1.0:1746065135.854399:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3256320->3547135) req@ffff880134b08700 x1830881263078144/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.854408:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b08700 with x1830881263078144 ext(3256320->3547135) 00010000:00010000:1.0:1746065135.854415:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 51 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.854427:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 51 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.854433:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134b08700 00000100:00100000:1.0:1746065135.854459:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1148 00000100:00100000:1.0:1746065135.854465:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881263078144:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065135.863301:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881263078144:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8824us (12238us total) trans 17179873271 rc 0/0 00000100:00100000:1.0:1746065135.863317:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1148 00002000:00100000:1.0:1746065135.863330:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3256320->3547135) req@ffff880134b08700 x1830881263078144/t17179873271(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/448 e 0 to 0 dl 1746065146 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.863339:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b08700 with x1830881263078144 ext(3256320->3547135) 00010000:00010000:1.0:1746065135.863350:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 53 pid: 1880 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.863366:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146cb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3256320->18446744073709551615] (req 3256320->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d80 expref: 53 pid: 1880 timeout: 831 lvb_type: 0 00002000:00010000:1.0:1746065135.863373:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134b08700 00000100:00100000:0.0:1746065135.865402:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.872261:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.872446:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263078656 00000100:00100000:1.0:1746065135.872453:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263078656 00002000:00100000:1.0:1746065135.872489:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880134b09180 x1830881263078656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/0 e 0 to 0 dl 1746065146 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.872502:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b09180 with x1830881263078656 ext(3145728->4194303) 00002000:00010000:1.0:1746065135.872506:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b09180 00000100:00100000:1.0:1746065135.872530:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3187 00000100:00100000:1.0:1746065135.872535:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+53:2006:x1830881263078656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065135.875902:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.884097:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263079040 00000100:00100000:0.0:1746065135.884107:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263079040 00000100:00100000:0.0:1746065135.884156:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12074 00000100:00100000:0.0:1746065135.884164:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+29:31657:x1830881263079040:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065135.884182:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065135.884196:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc146cb5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931d9c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.884219:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146c91e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c29 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.884227:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.884233:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146c972 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c4c expref: 9 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.884238:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.884239:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065135.884242:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc146cb5c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [499712->1048575] (req 499712->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d9c expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.884262:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146c972 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c4c expref: 9 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.884271:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146c972 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c4c expref: 9 pid: 1880 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746065135.884280:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263163136:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065135.884361:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065135.884370:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 37 pid: 1880 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746065135.884378:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263163264:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065135.884401:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146c91e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c29 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065135.884409:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146c91e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c29 expref: 30 pid: 1880 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746065135.884416:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263163392:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065135.884432:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.886486:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+52:2006:x1830881263078656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13945us (14228us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065135.886495:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3187 00002000:00100000:1.0:1746065135.886504:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880134b09180 x1830881263078656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:51/0 lens 488/440 e 0 to 0 dl 1746065146 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065135.886518:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b09180 with x1830881263078656 ext(3145728->4194303) 00002000:00010000:1.0:1746065135.886522:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b09180 00000100:00100000:0.0:1746065135.888892:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.888917:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.888966:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263079296 00000100:00100000:1.0:1746065135.888972:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263079296 00010000:00010000:1.0:1746065135.888994:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 38 pid: 1880 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746065135.889012:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5333 00000100:00100000:1.0:1746065135.889017:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263079296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.889027:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.889040:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 38 pid: 1880 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746065135.889267:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 38 pid: 1880 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746065135.889285:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146c9e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931c8b expref: 38 pid: 1880 timeout: 831 lvb_type: 1 00010000:00010000:1.0:1746065135.889312:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.889333:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263079296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 315us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.889338:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5333 00000100:00100000:0.0:1746065135.891539:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.893439:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.894385:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.896730:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.897874:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.900331:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.900441:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263080192 00000100:00100000:1.0:1746065135.900446:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263080192 00000100:00100000:1.0:1746065135.900483:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12078 00000100:00100000:1.0:1746065135.900490:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+26:31657:x1830881263080192:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065135.900501:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065135.900512:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931db8 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.900532:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.900540:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146ca7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d09 expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.900545:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.900546:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.900549:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->1294335] (req 1048576->1294335) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931db8 expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.900567:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146ca7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d09 expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065135.900576:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146ca7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d09 expref: 27 pid: 3067 timeout: 831 lvb_type: 1 00000100:00100000:1.0:1746065135.900584:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263163904:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065135.900639:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.900648:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 51 pid: 9548 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.900656:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263164032:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065135.900677:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065135.902903:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.902944:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065135.903920:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065135.904052:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263080576 00000100:00100000:1.0:1746065135.904055:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263080576 00010000:00010000:1.0:1746065135.904077:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 52 pid: 9548 timeout: 831 lvb_type: 0 00000100:00100000:1.0:1746065135.904102:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5337 00000100:00100000:1.0:1746065135.904107:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+52:2007:x1830881263080576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065135.904115:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065135.904123:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 52 pid: 9548 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.904132:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 52 pid: 9548 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.904145:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc146ca4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ce6 expref: 52 pid: 9548 timeout: 831 lvb_type: 0 00010000:00010000:1.0:1746065135.904164:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.904166:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065135.904171:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931db8 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.904179:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931db8 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065135.904198:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931db8 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065135.904205:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263164288:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065135.904244:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065135.907449:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263164288:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065135.907462:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065135.907496:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881263080576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3388us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065135.907502:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5337 00000100:00100000:0.0:1746065135.908199:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.016971:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.028052:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.029179:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.029629:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263081344 00000100:00100000:1.0:1746065136.029633:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263081344 00010000:00010000:1.0:1746065136.029651:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146cb32 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d79 expref: 54 pid: 7231 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.029677:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5338 00000100:00100000:1.0:1746065136.029682:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881263081344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065136.029691:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065136.029695:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146cb32 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d79 expref: 54 pid: 7231 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.029704:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146cb32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d79 expref: 54 pid: 7231 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.029719:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc146cb32 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d79 expref: 54 pid: 7231 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.031954:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065136.031965:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc146cb9b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065136.031975:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc146cb9b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065136.031979:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc146cb9b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065136.031983:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065136.032032:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881263081344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2347us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.032040:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5338 00000100:00100000:0.0:1746065136.035244:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.035278:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.036460:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.036621:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3191 00000100:00100000:0.0:1746065136.036628:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+29:2007:x1830881263081600:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065136.036991:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.037040:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263081984 00000100:00100000:1.0:1746065136.037044:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263081984 00010000:00010000:1.0:1746065136.037072:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d6b expref: 37 pid: 7203 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.037497:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5339 00000100:00100000:1.0:1746065136.037504:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263081984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065136.037513:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065136.037518:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d6b expref: 37 pid: 7203 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.037528:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d6b expref: 37 pid: 7203 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.037548:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146cb0f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d6b expref: 37 pid: 7203 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.037558:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065136.037561:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc146cb9b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065136.037569:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc146cb9b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065136.037574:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc146cb9b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065136.037593:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065136.037612:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+36:2004:x1830881263081984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.037617:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5339 00000100:00100000:1.0:1746065136.039447:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3192 00000100:00100000:1.0:1746065136.039454:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+27:2007:x1830881263081856:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065136.041579:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.043811:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+29:2007:x1830881263081600:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7182us (8571us total) trans 0 rc 499712/499712 00000100:00100000:0.0:1746065136.043818:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3191 00002000:00100000:0.0:1746065136.043826:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->499711) req@ffff880134b0a680 x1830881263081600/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/440 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 499712/499712 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.043834:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b0a680 with x1830881263081600 ext(0->499711) 00002000:00010000:0.0:1746065136.043837:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b0a680 00000100:00100000:0.0:1746065136.049312:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.051866:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+28:2007:x1830881263081856:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12409us (15403us total) trans 0 rc 802816/802816 00000100:00100000:1.0:1746065136.051874:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3192 00002000:00100000:1.0:1746065136.051883:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1294336->2097151) req@ffff880134b00000 x1830881263081856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/440 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.051891:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00000 with x1830881263081856 ext(1294336->2097151) 00002000:00010000:1.0:1746065136.051894:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00000 00000100:00100000:0.0:1746065136.053503:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.053534:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.053557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.053578:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.053590:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.053605:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263082624 00000100:00100000:0.0:1746065136.053611:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263082624 00000100:00100000:0.0:1746065136.053642:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263082880 00000100:00100000:0.0:1746065136.053643:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263082880 00000100:00100000:0.0:1746065136.053653:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083008 00000100:00100000:0.0:1746065136.053656:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083008 00000100:00100000:0.0:1746065136.053664:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083136 00000100:00100000:0.0:1746065136.053665:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083136 00000100:00100000:0.0:1746065136.053675:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12081 00000100:00100000:0.0:1746065136.053680:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263082624:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065136.053693:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.053706:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146cba9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931dd4 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.053745:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263164928:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065136.053820:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.053836:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12082 00000100:00100000:0.0:1746065136.053841:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263082880:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065136.053847:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.053854:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146cbb0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931de2 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.053865:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.053872:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146cbb0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de2 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.053879:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146cbb0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de2 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.053890:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00000100:00100000:0.0:1746065136.053906:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263082880:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 65us (349us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065136.053913:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12082 00000100:00100000:0.0:1746065136.053924:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12083 00000100:00100000:0.0:1746065136.053928:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263083008:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065136.053933:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.053939:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931de9 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.053948:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.053949:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.053955:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de9 expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.053968:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de9 expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.053974:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dcc00, rc 0) 00000100:00100000:0.0:1746065136.053988:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263083008:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 59us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.053993:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12083 00000100:00100000:0.0:1746065136.054001:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12084 00000100:00100000:0.0:1746065136.054006:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263083136:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065136.054011:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.054017:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146cbbe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931df0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.054026:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.054028:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.054031:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146cbbe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df0 expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.054039:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146cbbe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df0 expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.054045:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc200, rc 0) 00000100:00100000:0.0:1746065136.054057:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263083136:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 51us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.054075:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12084 00000100:00100000:0.0:1746065136.054116:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.054129:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083264 00000100:00100000:0.0:1746065136.054132:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083264 00000100:00100000:0.0:1746065136.054147:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12085 00000100:00100000:0.0:1746065136.054151:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263083264:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065136.054157:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.054164:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931df7 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.054174:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.054175:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.054179:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.054188:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.054199:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dda00, rc 0) 00000100:00100000:0.0:1746065136.054213:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263083264:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 61us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.054218:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12085 00000100:00100000:0.0:1746065136.058102:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.063438:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.063618:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083776 00000100:00100000:0.0:1746065136.063622:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083776 00010000:00010000:0.0:1746065136.063639:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146cb6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931daa expref: 27 pid: 1880 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746065136.063654:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5341 00000100:00100000:0.0:1746065136.063658:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263083776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.063666:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.063679:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146cb6a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931daa expref: 27 pid: 1880 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.063689:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146cb6a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931daa expref: 27 pid: 1880 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.063702:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146cb6a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931daa expref: 27 pid: 1880 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.063716:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.063717:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.063722:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146cba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931dcd expref: 50 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.063729:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146cba2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931dcd expref: 50 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.063755:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146cba2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931dcd expref: 50 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.063762:0:10893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146cba2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931dcd expref: 50 pid: 11461 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.063769:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263165440:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065136.064577:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.069198:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.069514:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.072548:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.079626:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.080258:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263084800 00000100:00100000:0.0:1746065136.080261:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263084800 00000100:00100000:0.0:1746065136.080289:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12088 00000100:00100000:0.0:1746065136.080366:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+37:31663:x1830881263084800:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065136.080376:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.080386:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146cbfd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931e13 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.080404:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc146ca1a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cb5 expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.080415:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de9 expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.080421:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ca6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d02 expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.080427:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.080428:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.080431:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146cbfd lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->1200127] (req 1048576->1200127) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e13 expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.080453:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ca6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d02 expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.080462:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ca6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d02 expref: 38 pid: 3067 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.080471:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263165568:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065136.081656:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de9 expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.081666:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de9 expref: 10 pid: 13375 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746065136.081675:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263165696:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065136.081715:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc146ca1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cb5 expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.081722:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc146ca1a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931cb5 expref: 28 pid: 9548 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.081730:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263165824:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065136.081746:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.090720:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.091172:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.092368:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263085184 00000100:00100000:0.0:1746065136.092376:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263085184 00000100:00100000:0.0:1746065136.092428:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4780 00000100:00100000:0.0:1746065136.092436:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:31666:x1830881263085184:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065136.092585:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:31666:x1830881263085184:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 149us (1871us total) trans 8589935689 rc 0/0 00000100:00100000:0.0:1746065136.092591:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4780 00000100:00100000:0.0:1746065136.093999:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.094132:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263165696:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065136.094140:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263165824:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065136.094162:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146cbfd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1200127] (req 1048576->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e13 expref: 37 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.094177:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd000, rc 0) 00000100:00100000:1.0:1746065136.094198:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+37:31663:x1830881263084800:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 13903us (13988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.094204:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12088 00000100:00100000:0.0:1746065136.094884:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5344 00000100:00100000:0.0:1746065136.094892:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263085312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.094899:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.094907:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de9 expref: 11 pid: 13375 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.094916:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de9 expref: 11 pid: 13375 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.094926:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146cbb7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931de9 expref: 11 pid: 13375 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.094933:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.094949:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263085312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.094953:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5344 00000100:00100000:0.0:1746065136.103251:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.103309:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.106628:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.110862:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.130556:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.130604:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263086464 00000100:00100000:0.0:1746065136.130611:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263086464 00000100:00100000:0.0:1746065136.130655:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12089 00000100:00100000:0.0:1746065136.130662:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263086464:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065136.130677:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.130691:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146cc04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931e1a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.130731:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263166208:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065136.132804:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.135475:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.136168:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.140404:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263166208:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065136.140433:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146cc04 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e1a expref: 38 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.140443:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146cc04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e1a expref: 38 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.140460:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc600, rc 0) 00000100:00100000:0.0:1746065136.140479:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263086464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9818us (9932us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065136.140484:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12089 00000100:00100000:0.0:1746065136.140545:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263166336:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065136.140559:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc146cc0b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e21 expref: 54 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.140567:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc146cc0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e21 expref: 54 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.140574:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538000, rc 0) 00000100:00100000:0.0:1746065136.140589:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881263086592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5912us (7818us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065136.140596:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12090 00000100:00100000:0.0:1746065136.142536:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.144492:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.146748:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.147485:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.147693:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263087360 00000100:00100000:1.0:1746065136.147699:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263087360 00002000:00100000:1.0:1746065136.147727:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8a:0x0] (499712->1048575) req@ffff880134b01880 x1830881263087360/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.147736:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01880 with x1830881263087360 ext(499712->1048575) 00010000:00010000:1.0:1746065136.147742:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc146cb5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d9c expref: 29 pid: 1880 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.147750:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc146cb5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d9c expref: 29 pid: 1880 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065136.147756:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01880 00000100:00100000:1.0:1746065136.147767:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1151 00000100:00100000:1.0:1746065136.147789:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263087360:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065136.153181:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+31:2004:x1830881263087360:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5400us (6428us total) trans 21474840701 rc 0/0 00000100:00100000:1.0:1746065136.153190:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1151 00002000:00100000:1.0:1746065136.153199:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8a:0x0] (499712->1048575) req@ffff880134b01880 x1830881263087360/t21474840701(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.153208:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01880 with x1830881263087360 ext(499712->1048575) 00010000:00010000:1.0:1746065136.153217:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc146cb5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d9c expref: 31 pid: 1880 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.153229:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc146cb5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d9c expref: 31 pid: 1880 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065136.153235:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01880 00000100:00100000:0.0:1746065136.153507:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.159844:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.159893:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.159997:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5348 00000100:00100000:0.0:1746065136.160005:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263087872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.160012:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065136.160019:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065135 -> 1746065136 00002000:00010000:0.0:1746065136.160022:0:8352:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065135 -> 1746065136 00010000:00010000:0.0:1746065136.160026:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146cbfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e13 expref: 40 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.160036:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146cbfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e13 expref: 40 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.160048:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146cbfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e13 expref: 40 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.160057:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.160058:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.160075:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146cc35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e3d expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.160082:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146cc35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e3d expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.160100:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146cc35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e3d expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.160110:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263166976:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065136.160177:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.164390:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.165664:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.165728:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263088384 00000100:00100000:1.0:1746065136.165732:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263088384 00002000:00100000:1.0:1746065136.165751:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880134b01180 x1830881263088384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.165759:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881263088384 ext(0->1048575) 00010000:00010000:1.0:1746065136.165765:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25c00/0xad6b7ddc146cc2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e36 expref: 39 pid: 10219 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.165791:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25c00/0xad6b7ddc146cc2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e36 expref: 39 pid: 10219 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065136.165798:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01180 00000100:00100000:1.0:1746065136.165810:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1153 00000100:00100000:1.0:1746065136.165815:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263088384:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065136.179466:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263088384:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13641us (13794us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065136.179475:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1153 00002000:00100000:1.0:1746065136.179484:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880134b01180 x1830881263088384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/440 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.179499:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881263088384 ext(0->1048575) 00010000:00010000:1.0:1746065136.179508:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25c00/0xad6b7ddc146cc2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e36 expref: 39 pid: 10219 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.179732:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25c00/0xad6b7ddc146cc2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e36 expref: 39 pid: 10219 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065136.179739:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01180 00000100:00100000:0.0:1746065136.186070:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.186127:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263088640 00000100:00100000:1.0:1746065136.186135:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263088640 00002000:00100000:1.0:1746065136.186170:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880091a92300 x1830881263088640/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.186180:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92300 with x1830881263088640 ext(2097152->3145727) 00002000:00010000:1.0:1746065136.186184:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a92300 00000100:00100000:1.0:1746065136.186215:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3197 00000100:00100000:1.0:1746065136.186221:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263088640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065136.200870:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263088640:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14641us (14807us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065136.200880:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3197 00002000:00100000:1.0:1746065136.200889:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880091a92300 x1830881263088640/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/440 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.200898:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92300 with x1830881263088640 ext(2097152->3145727) 00002000:00010000:1.0:1746065136.200903:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a92300 00000100:00100000:0.0:1746065136.203544:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.206514:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.209177:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.210415:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.210428:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089280 00000100:00100000:1.0:1746065136.210432:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089280 00002000:00100000:1.0:1746065136.210453:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8a:0x0] (606208->610303) req@ffff8800957d9f80 x1830881263089280/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.210462:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881263089280 ext(606208->610303) 00002000:00010000:1.0:1746065136.210466:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9f80 00000100:00100000:1.0:1746065136.210478:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3198 00000100:00100000:1.0:1746065136.210483:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+33:2006:x1830881263089280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065136.210565:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+33:2006:x1830881263089280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 82us (151us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.210571:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3198 00002000:00100000:1.0:1746065136.210576:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8a:0x0] (606208->610303) req@ffff8800957d9f80 x1830881263089280/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.210583:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881263089280 ext(606208->610303) 00002000:00010000:1.0:1746065136.210586:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9f80 00000100:00100000:1.0:1746065136.210626:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.210638:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089408 00000100:00100000:1.0:1746065136.210640:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089408 00002000:00100000:1.0:1746065136.210653:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1294335) req@ffff88009856f800 x1830881263089408/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.210660:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f800 with x1830881263089408 ext(1048576->1294335) 00010000:00010000:1.0:1746065136.210666:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931db8 expref: 26 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.210677:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931db8 expref: 26 pid: 3067 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065136.210683:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856f800 00000100:00100000:1.0:1746065136.210694:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1154 00000100:00100000:1.0:1746065136.210699:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263089408:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065136.217994:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.219076:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263089408:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8376us (8448us total) trans 17179873273 rc 0/0 00000100:00100000:1.0:1746065136.219083:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1154 00002000:00100000:1.0:1746065136.219089:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1294335) req@ffff88009856f800 x1830881263089408/t17179873273(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.219095:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f800 with x1830881263089408 ext(1048576->1294335) 00010000:00010000:1.0:1746065136.219101:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931db8 expref: 28 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.219112:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146cb78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931db8 expref: 28 pid: 3067 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065136.219117:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856f800 00000100:00100000:0.0:1746065136.228954:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.229001:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.241700:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.241821:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.253353:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.274632:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.277575:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.280577:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.280641:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.280659:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091072 00000100:00100000:0.0:1746065136.280664:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091072 00010000:00010000:0.0:1746065136.280683:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25800/0xad6b7ddc146cc12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e28 expref: 55 pid: 11461 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746065136.280703:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091200 00000100:00100000:0.0:1746065136.280704:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091200 00010000:00010000:0.0:1746065136.280711:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146cbd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931dfe expref: 28 pid: 11461 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.280722:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5351 00000100:00100000:0.0:1746065136.280727:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881263091072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.280736:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.280750:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25800/0xad6b7ddc146cc12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e28 expref: 55 pid: 11461 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.280758:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25800/0xad6b7ddc146cc12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e28 expref: 55 pid: 11461 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.280793:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25800/0xad6b7ddc146cc12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e28 expref: 55 pid: 11461 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.280805:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.280822:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881263091072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.280827:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5351 00000100:00100000:0.0:1746065136.280838:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5352 00000100:00100000:0.0:1746065136.280842:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263091200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.280849:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.280856:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146cbd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931dfe expref: 28 pid: 11461 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.280864:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146cbd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931dfe expref: 28 pid: 11461 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.280874:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146cbd3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931dfe expref: 28 pid: 11461 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.280881:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.280883:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.280887:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146cc6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1187839) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e67 expref: 53 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.280893:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146cc6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1187839) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e67 expref: 53 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.280916:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146cc6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1187839) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e67 expref: 53 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.280925:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263167872:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065136.280959:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.286275:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.287891:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091712 00000100:00100000:0.0:1746065136.287895:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091712 00002000:00100000:0.0:1746065136.287917:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a50fc850 x1830881263091712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.287924:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50fc850 with x1830881263091712 ext(1048576->2097151) 00002000:00010000:0.0:1746065136.287928:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a50fc850 00000100:00100000:0.0:1746065136.287951:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3203 00000100:00100000:0.0:1746065136.287956:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263091712:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065136.290810:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.300236:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263091712:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12271us (12636us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065136.300245:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3203 00002000:00100000:1.0:1746065136.300254:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800a50fc850 x1830881263091712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/440 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.300262:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50fc850 with x1830881263091712 ext(1048576->2097151) 00002000:00010000:1.0:1746065136.300267:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a50fc850 00000100:00100000:0.0:1746065136.316089:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.333571:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.343675:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.461447:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.467653:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.469036:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.474748:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.475032:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263092992 00000100:00100000:1.0:1746065136.475039:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263092992 00002000:00100000:1.0:1746065136.475084:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1097728->1101823) req@ffff880097c32300 x1830881263092992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.475093:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c32300 with x1830881263092992 ext(1097728->1101823) 00002000:00010000:1.0:1746065136.475097:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c32300 00000100:00100000:1.0:1746065136.475112:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3205 00000100:00100000:1.0:1746065136.475118:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+32:2007:x1830881263092992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065136.475212:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+32:2007:x1830881263092992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 94us (472us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065136.475217:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3205 00002000:00100000:1.0:1746065136.475222:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1097728->1101823) req@ffff880097c32300 x1830881263092992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.475228:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c32300 with x1830881263092992 ext(1097728->1101823) 00002000:00010000:1.0:1746065136.475231:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c32300 00000100:00100000:0.0:1746065136.478551:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.486453:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.488912:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.488953:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.489021:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093632 00000100:00100000:1.0:1746065136.489026:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093632 00000100:00100000:1.0:1746065136.489072:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093504 00000100:00100000:1.0:1746065136.489075:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093504 00000100:00100000:1.0:1746065136.489088:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12105 00000100:00100000:1.0:1746065136.489093:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263093632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065136.489105:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.489115:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc146cc9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931e9f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065136.489152:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263168896:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065136.489200:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b600 going to sleep for 11 seconds 00002000:00010000:1.0:1746065136.494176:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065135 -> 1746065136 00000100:00100000:1.0:1746065136.494199:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263168896:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065136.494229:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc146cc9e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e9f expref: 41 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.494240:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc146cc9e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e9f expref: 41 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.494254:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c800, rc 0) 00000100:00100000:1.0:1746065136.494291:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263093632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5197us (5383us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065136.494298:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12105 00000100:00100000:0.0:1746065136.500039:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.504490:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.505081:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093888 00000100:00100000:1.0:1746065136.505090:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093888 00002000:00100000:1.0:1746065136.505125:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (606208->835583) req@ffff88009077c380 x1830881263093888/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.505132:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c380 with x1830881263093888 ext(606208->835583) 00010000:00010000:1.0:1746065136.505138:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc146cc3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 606208->835583) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e44 expref: 31 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.505149:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc146cc3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 606208->835583) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e44 expref: 31 pid: 3067 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065136.505157:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009077c380 00000100:00100000:1.0:1746065136.505183:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1155 00000100:00100000:1.0:1746065136.505189:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+31:2005:x1830881263093888:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065136.505862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.505903:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.517994:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+35:2005:x1830881263093888:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12796us (13503us total) trans 21474840703 rc 0/0 00000100:00100000:1.0:1746065136.518006:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1155 00002000:00100000:1.0:1746065136.518015:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (606208->835583) req@ffff88009077c380 x1830881263093888/t21474840703(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.518024:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c380 with x1830881263093888 ext(606208->835583) 00010000:00010000:1.0:1746065136.518033:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc146cc3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 606208->835583) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e44 expref: 35 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.518047:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc146cc3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 606208->835583) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e44 expref: 35 pid: 3067 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746065136.518053:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009077c380 00000001:00080000:0.0:1746065136.522599:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840703 is committed 00000001:00080000:0.0:1746065136.522609:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840702 is committed 00000001:00080000:0.0:1746065136.522633:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840694 is committed 00000100:00100000:0.0:1746065136.523110:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263094400:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16485us (17202us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065136.523118:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3207 00002000:00100000:0.0:1746065136.523126:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009077f480 x1830881263094400/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/440 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.523140:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f480 with x1830881263094400 ext(1048576->2097151) 00002000:00010000:0.0:1746065136.523144:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077f480 00000100:00100000:1.0:1746065136.540876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.541402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.550915:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.550934:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263094784 00000100:00100000:0.0:1746065136.550938:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263094784 00002000:00100000:0.0:1746065136.550972:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1064960->1187839) req@ffff88009077ed80 x1830881263094784/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.550979:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ed80 with x1830881263094784 ext(1064960->1187839) 00010000:00010000:0.0:1746065136.550987:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146cc6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e67 expref: 54 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.550998:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146cc6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e67 expref: 54 pid: 3067 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065136.551004:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009077ed80 00000100:00100000:0.0:1746065136.551033:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1157 00000100:00100000:0.0:1746065136.551040:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881263094784:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065136.552114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.565274:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+56:2004:x1830881263094784:12345-192.168.202.27@tcp:4:cat.0 Request processed in 14221us (14346us total) trans 17179873274 rc 0/0 00000100:00100000:0.0:1746065136.565287:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1157 00002000:00100000:0.0:1746065136.565299:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1064960->1187839) req@ffff88009077ed80 x1830881263094784/t17179873274(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.565308:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ed80 with x1830881263094784 ext(1064960->1187839) 00010000:00010000:0.0:1746065136.565320:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146cc6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e67 expref: 56 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.565334:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d47600/0xad6b7ddc146cc6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1187839) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e67 expref: 56 pid: 3067 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065136.565341:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009077ed80 00000100:00100000:0.0:1746065136.567685:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.585375:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.585428:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.585592:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3210 00000100:00100000:0.0:1746065136.585597:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263095680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065136.592448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.600609:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.615478:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.615510:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.615863:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12111 00000100:00100000:1.0:1746065136.615871:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+58:31691:x1830881263096320:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065136.615879:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.615887:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931ec2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.615906:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146cb47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d87 expref: 59 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.615913:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.615920:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 6 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.615926:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cb55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d95 expref: 59 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.615931:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.615933:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.615936:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 7/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 59 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.615960:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cb55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d95 expref: 59 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.615970:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cb55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d95 expref: 59 pid: 3067 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.615980:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263169664:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065136.616049:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 6 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.616077:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 6 pid: 12258 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746065136.616085:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263169792:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065136.616110:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.616117:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 27 pid: 3067 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.616124:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263169920:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065136.616141:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146cb47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d87 expref: 59 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.616148:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146cb47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d87 expref: 59 pid: 1880 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.616154:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263170048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065136.616167:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.618796:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263169664:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065136.618807:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263169792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065136.621898:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.621936:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.621993:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.622015:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096448 00000100:00100000:0.0:1746065136.622021:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096448 00010000:00010000:0.0:1746065136.622052:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cb55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d95 expref: 58 pid: 3067 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.622089:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096576 00000100:00100000:0.0:1746065136.622091:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096576 00010000:00010000:0.0:1746065136.622099:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 7 pid: 12258 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746065136.622113:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096704 00000100:00100000:0.0:1746065136.622115:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096704 00010000:00010000:0.0:1746065136.622121:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146cb47 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d87 expref: 59 pid: 1880 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.622133:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5357 00000100:00100000:0.0:1746065136.622140:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+59:2006:x1830881263096448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.622151:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.622170:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cb55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d95 expref: 59 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.622179:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cb55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d95 expref: 59 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.622199:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cb55 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d95 expref: 59 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.622229:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.622263:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+58:2006:x1830881263096448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 123us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.622269:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5357 00000100:00100000:0.0:1746065136.622307:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5358 00000100:00100000:0.0:1746065136.622311:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2006:x1830881263096576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.622316:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.622323:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 7 pid: 12258 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.622330:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 7 pid: 12258 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.622338:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dda00/0xad6b7ddc146cbc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df7 expref: 7 pid: 12258 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.622346:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.622356:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2006:x1830881263096576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.622361:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5358 00000100:00100000:0.0:1746065136.622368:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5359 00000100:00100000:0.0:1746065136.622372:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881263096704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.622377:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.622381:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146cb47 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d87 expref: 57 pid: 1880 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.622387:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146cb47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d87 expref: 57 pid: 1880 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.622394:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.622403:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881263096704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.622407:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5359 00000100:00100000:0.0:1746065136.622493:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263169920:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065136.622502:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146cb47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d87 expref: 56 pid: 1880 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.622509:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263170048:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065136.622530:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 55 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.622538:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4600, rc 0) 00000100:00100000:0.0:1746065136.622556:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+55:31691:x1830881263096320:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6688us (7046us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.622561:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12111 00000100:00100000:0.0:1746065136.626209:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.626389:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096832 00000100:00100000:1.0:1746065136.626397:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096832 00010000:00010000:1.0:1746065136.626430:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 28 pid: 3067 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.626469:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5360 00000100:00100000:1.0:1746065136.626478:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263096832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065136.626491:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065136.626508:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 28 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.626519:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 28 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.626539:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc146cb4e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931d8e expref: 28 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.626555:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.626557:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.626562:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 54 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.626570:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 54 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.626598:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 54 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065136.626610:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263170176:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065136.626684:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.628862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.630139:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.630163:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263097216 00000100:00100000:0.0:1746065136.630166:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263097216 00002000:00100000:0.0:1746065136.630189:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2772992->2777087) req@ffff88013513b800 x1830881263097216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.630198:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881263097216 ext(2772992->2777087) 00002000:00010000:0.0:1746065136.630201:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513b800 00000100:00100000:0.0:1746065136.630213:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3212 00000100:00100000:0.0:1746065136.630218:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881263097216:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065136.630308:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881263097216:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 89us (169us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065136.630314:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3212 00002000:00100000:0.0:1746065136.630320:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2772992->2777087) req@ffff88013513b800 x1830881263097216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.630327:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881263097216 ext(2772992->2777087) 00002000:00010000:0.0:1746065136.630330:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513b800 00000100:00100000:1.0:1746065136.631087:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263170176:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065136.631099:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065136.631150:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263096832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4672us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.631157:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5360 00000100:00100000:0.0:1746065136.633999:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263097472 00000100:00100000:0.0:1746065136.634004:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263097472 00002000:00100000:0.0:1746065136.634032:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1097728->1323007) req@ffff88012edace00 x1830881263097472/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.634040:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edace00 with x1830881263097472 ext(1097728->1323007) 00010000:00010000:0.0:1746065136.634046:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d46400/0xad6b7ddc146cc90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e8a expref: 9 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.634069:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d46400/0xad6b7ddc146cc90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e8a expref: 9 pid: 3067 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746065136.634076:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012edace00 00000100:00100000:0.0:1746065136.634100:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1158 00000100:00100000:0.0:1746065136.634107:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263097472:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065136.637882:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.637995:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.638380:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12115 00000100:00100000:0.0:1746065136.638385:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263097728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065136.638391:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.638401:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856000/0xad6b7ddc146ccdd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931ede expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.638436:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263170560:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065136.638484:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.638875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.641915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.641944:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.641959:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.641972:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263098240 00000100:00100000:0.0:1746065136.641976:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263098240 00010000:00010000:0.0:1746065136.642006:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc146c876 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bb9 expref: 24 pid: 9549 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.642025:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263097984 00000100:00100000:0.0:1746065136.642027:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263097984 00010000:00010000:0.0:1746065136.642036:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46400/0xad6b7ddc146cc90 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e8a expref: 14 pid: 3067 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.642048:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5361 00000100:00100000:0.0:1746065136.642053:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881263098240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.642075:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.642093:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc146c876 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bb9 expref: 24 pid: 9549 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.642102:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc146c876 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bb9 expref: 24 pid: 9549 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.642118:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc146c876 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bb9 expref: 24 pid: 9549 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.642135:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.642161:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263098240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.642167:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5361 00000100:00100000:0.0:1746065136.642180:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5362 00000100:00100000:0.0:1746065136.642184:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263097984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.642189:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.642195:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46400/0xad6b7ddc146cc90 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1097728->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e8a expref: 14 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.642202:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46400/0xad6b7ddc146cc90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1097728->1323007) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e8a expref: 14 pid: 3067 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.642213:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.642215:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065136.642220:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146ccd6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ed0 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.642226:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146ccd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ed0 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.642246:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146ccd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ed0 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.642255:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263171456:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065136.642291:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.642607:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.642617:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263098368 00000100:00100000:0.0:1746065136.642619:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263098368 00010000:00010000:0.0:1746065136.642629:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146cbbe lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df0 expref: 10 pid: 13375 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746065136.642641:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5363 00000100:00100000:0.0:1746065136.642645:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263098368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.642650:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.642655:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146cbbe lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df0 expref: 10 pid: 13375 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.642662:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146cbbe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931df0 expref: 10 pid: 13375 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746065136.642672:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.642686:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263098368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.642690:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5363 00000100:00100000:0.0:1746065136.644226:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.647698:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.653427:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.659616:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.666542:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3215 00000100:00100000:1.0:1746065136.666551:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881263099392:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065136.676687:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881263099392:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10129us (10350us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065136.676697:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3215 00002000:00100000:1.0:1746065136.676710:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880097fab100 x1830881263099392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/440 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.676719:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab100 with x1830881263099392 ext(2097152->3145727) 00002000:00010000:1.0:1746065136.676724:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab100 00000100:00100000:0.0:1746065136.680304:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.681027:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263099904 00000100:00100000:1.0:1746065136.681036:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263099904 00002000:00100000:1.0:1746065136.681083:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3448832->4194303) req@ffff88011dad6a00 x1830881263099904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.681092:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6a00 with x1830881263099904 ext(3448832->4194303) 00002000:00010000:1.0:1746065136.681098:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad6a00 00000100:00100000:1.0:1746065136.681130:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3217 00000100:00100000:1.0:1746065136.681138:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881263099904:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065136.682288:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.682306:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100160 00000100:00100000:0.0:1746065136.682311:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100160 00002000:00100000:0.0:1746065136.682330:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88011dad4700 x1830881263100160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.682338:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4700 with x1830881263100160 ext(3145728->4194303) 00002000:00010000:0.0:1746065136.682342:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad4700 00000100:00100000:0.0:1746065136.682354:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3218 00000100:00100000:0.0:1746065136.682359:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+55:2006:x1830881263100160:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065136.690432:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881263099904:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9286us (10127us total) trans 0 rc 745472/745472 00000100:00100000:1.0:1746065136.690443:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3217 00002000:00100000:1.0:1746065136.690453:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3448832->4194303) req@ffff88011dad6a00 x1830881263099904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:52/0 lens 488/440 e 0 to 0 dl 1746065147 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.690463:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6a00 with x1830881263099904 ext(3448832->4194303) 00002000:00010000:1.0:1746065136.690470:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad6a00 00000100:00100000:0.0:1746065136.699081:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.808347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.813116:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.820390:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.820629:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100800 00000100:00100000:1.0:1746065136.820635:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100800 00010000:00010000:1.0:1746065136.820655:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc146ccac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ea6 expref: 21 pid: 10219 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.820681:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5368 00000100:00100000:1.0:1746065136.820686:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263100800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065136.820695:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065136.820709:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc146ccac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ea6 expref: 21 pid: 10219 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.820717:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc146ccac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ea6 expref: 21 pid: 10219 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.820732:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc146ccac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ea6 expref: 21 pid: 10219 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.820744:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.820746:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.820751:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146ccf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931eec expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.820762:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146ccf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931eec expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.820816:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146ccf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931eec expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065136.820825:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263171968:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065136.820863:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065136.823028:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263171968:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065136.823424:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065136.823454:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881263100800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2767us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.823462:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5368 00000100:00100000:0.0:1746065136.824583:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.831520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.834450:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.834522:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263101312 00000100:00100000:1.0:1746065136.834529:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263101312 00010000:00010000:1.0:1746065136.834554:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146cc51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e59 expref: 28 pid: 3067 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746065136.834588:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5369 00000100:00100000:1.0:1746065136.834595:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263101312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065136.834606:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065136.834622:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146cc51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e59 expref: 28 pid: 3067 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746065136.834641:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146cc51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e59 expref: 28 pid: 3067 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746065136.834660:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146cc51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e59 expref: 28 pid: 3067 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746065136.834690:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065136.834718:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263101312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.834723:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5369 00000100:00100000:0.0:1746065136.835974:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.842751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.872651:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.874202:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.874731:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.885276:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.885655:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.885748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.886109:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263102848 00000100:00100000:1.0:1746065136.886113:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263102848 00002000:00100000:1.0:1746065136.886128:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c5f2d80 x1830881263102848/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/0 e 0 to 0 dl 1746065147 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065136.886134:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881263102848 ext(1048576->2097151) 00002000:00010000:1.0:1746065136.886137:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f2d80 00000100:00100000:0.0:1746065136.889446:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263102592:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065136.910932:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.919573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.927614:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.927649:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263103488 00000100:00100000:0.0:1746065136.927655:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263103488 00010000:00010000:0.0:1746065136.927686:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146cc20 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e2f expref: 39 pid: 7231 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.927723:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5372 00000100:00100000:0.0:1746065136.927730:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+39:2004:x1830881263103488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065136.927741:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065136.927746:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146cc20 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e2f expref: 39 pid: 7231 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.927756:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146cc20 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e2f expref: 39 pid: 7231 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.927792:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146cc20 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931e2f expref: 39 pid: 7231 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.927812:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065136.927816:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc146cd2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065136.927824:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc146cd2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065136.927830:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc146cd2a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065136.927855:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065136.927888:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+38:2004:x1830881263103488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 158us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.927893:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5372 00000100:00100000:0.0:1746065136.930472:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.930509:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.930531:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.930547:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.930580:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.932215:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.932370:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104256 00000100:00100000:1.0:1746065136.932374:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104256 00000100:00100000:1.0:1746065136.932406:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12127 00000100:00100000:1.0:1746065136.932412:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263104256:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065136.932419:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.932425:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146cd54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931f39 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065136.932459:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263173376:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065136.932496:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00002000:00010000:0.0:1746065136.935440:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065136 -> 1746065137 00002000:00010000:0.0:1746065136.935444:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065136 -> 1746065137 00002000:00010000:0.0:1746065136.935446:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065136 -> 1746065137 00000100:00100000:0.0:1746065136.935456:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263172992:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065136.935472:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc146cd31 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f16 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.935481:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc146cd31 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f16 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.935504:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46200, rc 0) 00000100:00100000:0.0:1746065136.935534:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263103616:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4720us (5066us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065136.935541:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12122 00000100:00100000:0.0:1746065136.937512:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.937538:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.938372:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263173376:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065136.938389:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146cd54 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f39 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.938396:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146cd54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f39 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.938414:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1600, rc 0) 00000100:00100000:1.0:1746065136.938435:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263104256:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 6024us (6220us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065136.938440:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12127 00000100:00100000:0.0:1746065136.943446:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263173632:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065136.943475:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc146cd62 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f47 expref: 28 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.943487:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc146cd62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f47 expref: 28 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065136.943497:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2000, rc 0) 00000100:00100000:0.0:1746065136.943545:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263104512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5706us (6003us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065136.943552:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12129 00000100:00100000:0.0:1746065136.943930:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.948184:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104896 00000100:00100000:0.0:1746065136.948191:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104896 00000100:00100000:0.0:1746065136.948220:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263105024 00000100:00100000:0.0:1746065136.948723:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263105024 00000100:00100000:0.0:1746065136.949252:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263105536 00000100:00100000:1.0:1746065136.949255:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12131 00000100:00100000:0.0:1746065136.949255:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263105536 00000100:00100000:1.0:1746065136.949261:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881263105024:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065136.949269:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.949278:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146cd85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931f5c expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.949282:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12132 00000100:00100000:0.0:1746065136.949287:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+9:31701:x1830881263105536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065136.949292:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065136.949298:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931f63 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065136.949300:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263174016:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065136.949311:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2e00/0xad6b7ddc146cce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ed7 expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.949317:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.949318:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.949321:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f63 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065136.949331:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00010000:00010000:0.0:1746065136.949335:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b2e00/0xad6b7ddc146cce4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ed7 expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.949349:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2e00/0xad6b7ddc146cce4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ed7 expref: 21 pid: 12260 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746065136.949356:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263174144:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065136.949371:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.949382:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263105408 00000100:00100000:0.0:1746065136.949384:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263105408 00000100:00100000:0.0:1746065136.949401:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4783 00000100:00100000:0.0:1746065136.949405:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+55:31703:x1830881263105408:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065136.949887:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+56:31703:x1830881263105408:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 479us (763us total) trans 8589935695 rc 0/0 00000100:00100000:0.0:1746065136.949893:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4783 00000100:00100000:0.0:1746065136.951732:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.951820:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263174144:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065136.951834:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f63 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.951844:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174000, rc 0) 00000100:00100000:0.0:1746065136.951861:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:31701:x1830881263105536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2574us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065136.951867:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12132 00000100:00100000:0.0:1746065136.951912:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.952381:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263174016:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065136.952396:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146cd85 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f5c expref: 55 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.952405:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146cd85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f5c expref: 55 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065136.952427:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:1.0:1746065136.952448:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881263105024:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3187us (4334us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065136.952453:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12131 00000100:00100000:1.0:1746065136.954571:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.957172:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065136.957331:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263106176 00000100:00100000:1.0:1746065136.957337:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263106176 00000100:00100000:1.0:1746065136.957368:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12133 00000100:00100000:1.0:1746065136.957374:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:31708:x1830881263106176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065136.957385:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065136.957395:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146cdaf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931f78 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.957414:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146ccf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931eec expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.957422:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.957424:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065136.957427:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146cdaf lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f78 expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.957450:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146ccf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931eec expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.957464:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146ccf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931eec expref: 9 pid: 10219 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.957475:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263174272:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065136.957524:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065136.960199:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.960222:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.960423:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.960578:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.961346:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.961366:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.961383:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12137 00000100:00100000:0.0:1746065136.961388:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263106304:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065136.961401:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.961408:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.961411:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146cdaf lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f78 expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.961416:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065136.961418:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.961433:0:13375:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146cdaf lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f78 expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.961441:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065136.961456:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12139 00000100:00100000:0.0:1746065136.961460:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263106816:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065136.961471:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.961478:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065136.961481:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f63 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.961486:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065136.961488:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.961500:0:12258:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f63 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065136.961506:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065136.965899:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263174272:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065136.965913:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146cdaf lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f78 expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.965923:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0a00, rc 0) 00000100:00100000:1.0:1746065136.965942:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+23:31708:x1830881263106176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8568us (8772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.965949:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12133 00000100:00100000:1.0:1746065136.975163:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107968 00000100:00100000:1.0:1746065136.975167:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107968 00010000:00010000:1.0:1746065136.975180:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146cd3f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f24 expref: 10 pid: 3067 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746065136.975189:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263108224 00000100:00100000:1.0:1746065136.975191:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263108224 00010000:00010000:1.0:1746065136.975196:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc146ccb3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ead expref: 29 pid: 10219 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746065136.975204:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5379 00000100:00100000:1.0:1746065136.975208:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263107968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065136.975214:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065136.975220:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146cd3f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f24 expref: 10 pid: 3067 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746065136.975227:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146cd3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f24 expref: 10 pid: 3067 timeout: 832 lvb_type: 1 00010000:00010000:1.0:1746065136.975236:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065136.975248:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263107968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.975253:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5379 00000100:00100000:1.0:1746065136.975261:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5380 00000100:00100000:1.0:1746065136.975265:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263108224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065136.975269:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065136.975273:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc146ccb3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ead expref: 29 pid: 10219 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.975280:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b2400/0xad6b7ddc146ccb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ead expref: 29 pid: 10219 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746065136.975287:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.975288:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065136.975290:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc146cdcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.975296:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc146cdcb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065136.975309:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065136.975320:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263108224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065136.975324:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5380 00000100:00100000:1.0:1746065136.985693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.985921:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263107840:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12216us (12336us total) trans 17179873275 rc 0/0 00000100:00100000:0.0:1746065136.985929:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1161 00002000:00100000:0.0:1746065136.985935:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1339391) req@ffff880097faa680 x1830881263107840/t17179873275(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:52/0 lens 488/448 e 0 to 0 dl 1746065147 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065136.985941:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa680 with x1830881263107840 ext(1048576->1339391) 00010000:00010000:0.0:1746065136.985946:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc146ccf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ef3 expref: 28 pid: 10219 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746065136.985953:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc146ccf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ef3 expref: 28 pid: 10219 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065136.985962:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097faa680 00000100:00100000:0.0:1746065136.986272:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.995447:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065136.996294:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.001542:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.001600:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263109120 00000100:00100000:1.0:1746065137.001606:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263109120 00010000:00010000:1.0:1746065137.002610:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 55 pid: 12260 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.003760:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5383 00000100:00100000:1.0:1746065137.003783:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+55:2006:x1830881263109120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.003796:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065137.003811:0:9565:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065136 -> 1746065137 00002000:00010000:1.0:1746065137.003813:0:9565:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065136 -> 1746065137 00010000:00010000:1.0:1746065137.003819:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 55 pid: 12260 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.003830:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 55 pid: 12260 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.003849:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc146ccc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ec2 expref: 55 pid: 12260 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.004748:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.004751:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.004755:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146cdc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.004763:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146cdc4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.004926:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.004971:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2006:x1830881263109120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1201us (3431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.004978:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5383 00000100:00100000:0.0:1746065137.006609:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.007541:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263109376 00000100:00100000:1.0:1746065137.007545:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263109376 00010000:00010000:1.0:1746065137.007572:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f63 expref: 10 pid: 3068 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.007598:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5384 00000100:00100000:1.0:1746065137.007604:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263109376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.007612:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.007623:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f63 expref: 10 pid: 3068 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.007630:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f63 expref: 10 pid: 3068 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.007643:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc146cd8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f63 expref: 10 pid: 3068 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.007656:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.007657:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.007660:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.007665:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.007689:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.007706:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263109376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.007711:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5384 00010000:00010000:0.0:1746065137.008463:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.008471:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.008485:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.008491:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.008497:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.008503:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065137.008506:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.008512:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.008521:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.008527:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146cdd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065137.008567:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263106816:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 47105us (47199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.008573:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12139 00000100:00100000:0.0:1746065137.011366:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.016725:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.017386:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065137.017688:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746065137.018071:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.018078:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.018092:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.018098:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.018104:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.018109:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065137.018112:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.018118:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.018126:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.018131:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146cdd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065137.018177:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263106304:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 56789us (57598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.018182:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12137 00000100:00100000:0.0:1746065137.020681:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065137.020812:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065137.022084:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.023396:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.024026:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110528 00000100:00100000:1.0:1746065137.024030:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110528 00000100:00100000:1.0:1746065137.024066:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12142 00000100:00100000:1.0:1746065137.024072:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+9:31701:x1830881263110528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.024080:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.024092:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146cdf5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931f8d expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065137.026468:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.026513:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065137.026695:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 4813376, mtime: 0x6812d6f1, atime: 0x6812d6f0, ctime: 0x6812d6f0, blocks: 0x14c0 00000100:00100000:0.0:1746065137.026988:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.027004:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.027018:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.027033:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110784 00000100:00100000:0.0:1746065137.027037:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110784 00010000:00010000:0.0:1746065137.027849:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc146c788 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b18 expref: 38 pid: 9571 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065137.027871:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110912 00000100:00100000:0.0:1746065137.027874:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110912 00010000:00010000:0.0:1746065137.028310:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131055600/0xad6b7ddc146c504 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319dd expref: 40 pid: 7231 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065137.029090:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5388 00000100:00100000:0.0:1746065137.029094:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+39:2006:x1830881263111168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065137.029100:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065137.029103:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c4ef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319c8 expref: 39 pid: 7204 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029172:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c4ef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319c8 expref: 38 pid: 7204 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029183:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146c4ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319c8 expref: 38 pid: 7204 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029192:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.029196:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.029201:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.029216:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+37:2006:x1830881263111168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 121us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.029221:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5388 00000100:00100000:0.0:1746065137.029232:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5390 00000100:00100000:0.0:1746065137.029236:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+36:2006:x1830881263110912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065137.029241:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065137.029245:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131055600/0xad6b7ddc146c504 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319dd expref: 36 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029252:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131055600/0xad6b7ddc146c504 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319dd expref: 36 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029260:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131055600/0xad6b7ddc146c504 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9319dd expref: 36 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029268:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.029271:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.029275:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.029286:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+35:2006:x1830881263110912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.029291:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5390 00000100:00080000:0.0:1746065137.029308:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065137.029368:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.029379:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111296 00000100:00100000:0.0:1746065137.029382:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111296 00010000:00010000:0.0:1746065137.029392:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146c8c3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bf1 expref: 35 pid: 7203 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065137.029404:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5391 00000100:00100000:0.0:1746065137.029409:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+35:2007:x1830881263111296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065137.029414:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065137.029418:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146c8c3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bf1 expref: 35 pid: 7203 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029424:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146c8c3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931bf1 expref: 35 pid: 7203 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029431:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.029434:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.029438:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.029450:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+35:2007:x1830881263111296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.029456:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5391 00000100:00100000:0.0:1746065137.029508:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.029561:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111424 00000100:00100000:0.0:1746065137.029564:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111424 00010000:00010000:0.0:1746065137.029573:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c7dc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b42 expref: 57 pid: 9571 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065137.029585:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5392 00000100:00100000:0.0:1746065137.029589:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+57:2006:x1830881263111424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065137.029594:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065137.029597:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c7dc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b42 expref: 57 pid: 9571 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029603:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc146c7dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931b42 expref: 57 pid: 9571 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.029612:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.029615:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.029619:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.029635:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+57:2006:x1830881263111424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.029639:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5392 00010000:00010000:1.0:1746065137.029803:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.029806:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.029813:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146cdf5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f8d expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.029878:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146cdf5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f8d expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.029887:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a600, rc 0) 00000100:00100000:1.0:1746065137.029904:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+10:31701:x1830881263110528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5834us (6510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.029909:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12142 00000100:00100000:0.0:1746065137.033633:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111552 00000100:00100000:0.0:1746065137.033639:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111552 00000100:00100000:0.0:1746065137.034013:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13421 00000100:00100000:0.0:1746065137.034020:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+34:31701:x1830881263111552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065137.034035:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.034049:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc146cdfc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931f94 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.034099:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.034106:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc146cdfc lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f94 expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.034119:0:9571:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.034127:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc146cdfc lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f94 expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.034142:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.034144:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065137.034147:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc146cdfc lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f94 expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.034153:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47000, rc 0) 00000100:00100000:0.0:1746065137.034167:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+35:31701:x1830881263111552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 148us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.034172:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13421 00000100:00100000:0.0:1746065137.036605:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263176960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065137.036648:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.036681:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065137.036686:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263177088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065137.036702:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065137.036835:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263177216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065137.036856:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.036871:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176960 00000100:00100000:1.0:1746065137.036872:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263177728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.036875:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176960 00000100:00100000:1.0:1746065137.036887:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065137.036899:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1746065137.036903:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263176832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.036905:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177088 00000100:00100000:0.0:1746065137.036907:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177088 00000100:00100000:0.0:1746065137.036915:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177216 00000100:00100000:1.0:1746065137.036916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.036917:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177216 00000100:00100000:1.0:1746065137.036924:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263177344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.036924:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177728 00000100:00100000:0.0:1746065137.036926:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177728 00000100:00100000:1.0:1746065137.036935:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.036936:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176832 00000100:00100000:0.0:1746065137.036937:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176832 00000100:00100000:1.0:1746065137.036944:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263177856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.036945:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177344 00000100:00100000:0.0:1746065137.036947:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177344 00000100:00100000:1.0:1746065137.036955:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.036955:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12143 00000100:00100000:0.0:1746065137.036961:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3761:x1830881263176960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065137.036969:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177856 00000100:00100000:1.0:1746065137.036971:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177856 00000100:00100000:1.0:1746065137.036982:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12144 00000100:00100000:1.0:1746065137.036985:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3761:x1830881263177088:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746065137.037034:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065137.037036:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065137.037043:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263177472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037073:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065137.037077:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3761:x1830881263177088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (374us total) trans 21474840707 rc 0/0 00000100:00100000:0.0:1746065137.037081:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263177984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065137.037082:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12144 00000100:00100000:0.0:1746065137.037092:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065137.037093:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177472 00000100:00100000:1.0:1746065137.037095:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177472 00000100:00100000:1.0:1746065137.037103:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177984 00000100:00100000:1.0:1746065137.037105:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177984 00000100:00100000:0.0:1746065137.037109:0:3761:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840694 gen 2 00000100:00100000:1.0:1746065137.037112:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12145 00000004:00080000:0.0:1746065137.037113:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc0a80, transno 21474840651 00000100:00100000:1.0:1746065137.037115:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263177216:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065137.037116:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1500, transno 21474840652 00000004:00080000:0.0:1746065137.037118:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1880, transno 21474840653 00000004:00080000:0.0:1746065137.037120:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3b80, transno 21474840654 00000004:00080000:0.0:1746065137.037122:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3800, transno 21474840655 00000004:00080000:0.0:1746065137.037124:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc2680, transno 21474840656 00000004:00080000:0.0:1746065137.037126:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3100, transno 21474840657 00000004:00080000:0.0:1746065137.037128:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc0e00, transno 21474840658 00000004:00080000:0.0:1746065137.037130:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077dc00, transno 21474840659 00000004:00080000:0.0:1746065137.037132:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458a80, transno 21474840660 00000004:00080000:0.0:1746065137.037134:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45b800, transno 21474840661 00000004:00080000:0.0:1746065137.037136:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c459c00, transno 21474840662 00000004:00080000:0.0:1746065137.037138:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458000, transno 21474840663 00000004:00080000:0.0:1746065137.037140:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45aa00, transno 21474840664 00000004:00080000:0.0:1746065137.037141:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c459f80, transno 21474840665 00000004:00080000:0.0:1746065137.037143:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c000, transno 21474840666 00000004:00080000:0.0:1746065137.037145:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458380, transno 21474840667 00000004:00080000:0.0:1746065137.037147:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513bb80, transno 21474840668 00000004:00080000:0.0:1746065137.037149:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aced180, transno 21474840677 00002000:00010000:1.0:1746065137.037151:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 4813376 -> 4813376 00000004:00080000:0.0:1746065137.037151:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aced880, transno 21474840678 00000004:00080000:0.0:1746065137.037152:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138700, transno 21474840679 00002000:00010000:1.0:1746065137.037154:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065137 -> 1746065137 00000004:00080000:0.0:1746065137.037155:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139c00, transno 21474840680 00002000:00010000:1.0:1746065137.037156:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065136 -> 1746065136 00000004:00080000:0.0:1746065137.037156:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513a300, transno 21474840681 00002000:00010000:1.0:1746065137.037157:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065136 -> 1746065136 00000004:00080000:0.0:1746065137.037158:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138000, transno 21474840682 00002000:00010000:1.0:1746065137.037159:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5312 -> 5312 00000004:00080000:0.0:1746065137.037160:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acedc00, transno 21474840683 00000004:00080000:0.0:1746065137.037161:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139180, transno 21474840684 00000004:00080000:0.0:1746065137.037163:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2300, transno 21474840685 00000004:00080000:0.0:1746065137.037165:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf5500, transno 21474840686 00000004:00080000:0.0:1746065137.037167:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4380, transno 21474840687 00000004:00080000:0.0:1746065137.037169:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd6a00, transno 21474840688 00000004:00080000:0.0:1746065137.037170:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf5880, transno 21474840689 00000004:00080000:0.0:1746065137.037173:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4700, transno 21474840690 00000004:00080000:0.0:1746065137.037174:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954bf800, transno 21474840691 00000004:00080000:0.0:1746065137.037176:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4000, transno 21474840692 00000100:00100000:1.0:1746065137.037178:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263177216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (321us total) trans 21474840709 rc 0/0 00000004:00080000:0.0:1746065137.037178:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f2d80, transno 21474840693 00000004:00080000:0.0:1746065137.037180:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972b1880, transno 21474840694 00000100:00100000:1.0:1746065137.037181:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12145 00000100:00100000:0.0:1746065137.037184:0:3761:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012edaf800 x1830881263177088/t21474840707(21474840707) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065153 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:1.0:1746065137.037189:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12146 00000004:00080000:0.0:1746065137.037192:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaf800/2, rc 0, transno 21474840707 00000100:00100000:1.0:1746065137.037193:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3759:x1830881263177728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037195:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263177088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065137.037200:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065137.037204:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263177600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037218:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065137.037226:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263178112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037238:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065137.037244:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3759:x1830881263177728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (356us total) trans 17179873277 rc 0/0 00000100:00100000:1.0:1746065137.037249:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12146 00000100:00100000:1.0:1746065137.037257:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177600 00000100:00100000:1.0:1746065137.037259:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177600 00000100:00100000:1.0:1746065137.037267:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178112 00000100:00100000:1.0:1746065137.037269:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178112 00000100:00100000:0.0:1746065137.037269:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263176960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 309us (622us total) trans 21474840708 rc 0/0 00000100:00100000:0.0:1746065137.037274:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12143 00000100:00100000:1.0:1746065137.037276:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12147 00000100:00100000:1.0:1746065137.037279:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3759:x1830881263176832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037281:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12148 00000100:00100000:0.0:1746065137.037285:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3759:x1830881263177344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065137.037312:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12149 00000100:00100000:1.0:1746065137.037316:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881263177856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037325:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881263177344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (389us total) trans 17179873278 rc 0/0 00000100:00100000:0.0:1746065137.037329:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12148 00000100:00100000:0.0:1746065137.037336:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12150 00000100:00100000:0.0:1746065137.037340:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263177472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065137.037357:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065137.037359:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065137 -> 1746065137 00002000:00010000:0.0:1746065137.037360:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065137 -> 1746065137 00000100:00100000:1.0:1746065137.037361:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881263177856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (405us total) trans 17179873280 rc 0/0 00002000:00010000:0.0:1746065137.037362:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065137 -> 1746065137 00002000:00010000:0.0:1746065137.037364:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065137.037366:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12149 00000100:00100000:1.0:1746065137.037375:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12151 00000100:00100000:0.0:1746065137.037376:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263176832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (459us total) trans 17179873279 rc 0/0 00000100:00100000:1.0:1746065137.037379:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263177984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037380:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12147 00000100:00100000:0.0:1746065137.037386:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12152 00000100:00100000:0.0:1746065137.037390:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881263177600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065137.037416:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065137.037418:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065137.037419:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746065137.037420:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881263177984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (327us total) trans 17179873281 rc 0/0 00002000:00010000:0.0:1746065137.037421:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065137.037423:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:1.0:1746065137.037424:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12151 00000100:00100000:1.0:1746065137.037432:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12153 00000100:00100000:0.0:1746065137.037434:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263177600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (216us total) trans 17179873282 rc 0/0 00000100:00100000:1.0:1746065137.037436:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263178112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037438:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12152 00000004:00080000:0.0:1746065137.037471:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856c380/2, rc 0, transno 17179873282 00000100:00100000:0.0:1746065137.037475:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263177600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065137.037480:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881263178112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (241us total) trans 17179873283 rc 0/0 00000004:00080000:0.0:1746065137.037481:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856d880/2, rc 0, transno 17179873283 00000100:00100000:0.0:1746065137.037483:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263178112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065137.037485:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12153 00000004:00080000:0.0:1746065137.037488:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856ca80/2, rc 0, transno 17179873281 00000100:00100000:0.0:1746065137.037490:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263177984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065137.037496:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edac380/2, rc 0, transno 21474840708 00000004:00080000:1.0:1746065137.037499:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856e680/2, rc 0, transno 17179873279 00000100:00100000:0.0:1746065137.037499:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263176960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065137.037502:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263176832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065137.037507:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856df80/2, rc 0, transno 17179873278 00000100:00100000:1.0:1746065137.037509:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263177344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065137.037514:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856ed80/2, rc 0, transno 17179873280 00002000:00010000:0.0:1746065137.037515:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746065137.037516:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263177856:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065137.037517:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065137 -> 1746065137 00002000:00010000:0.0:1746065137.037519:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065136 -> 1746065136 00002000:00010000:0.0:1746065137.037521:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065137 -> 1746065137 00000004:00080000:1.0:1746065137.037522:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edac000/2, rc 0, transno 21474840709 00002000:00010000:0.0:1746065137.037522:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746065137.037524:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263177216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065137.037529:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856f480/2, rc 0, transno 17179873277 00000100:00100000:1.0:1746065137.037531:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263177728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.037538:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263177472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (465us total) trans 17179873284 rc 0/0 00000100:00100000:0.0:1746065137.037543:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12150 00000004:00080000:0.0:1746065137.037557:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856f800/2, rc 0, transno 17179873284 00000100:00100000:0.0:1746065137.037560:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263177472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.038278:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178752 00000100:00100000:0.0:1746065137.038281:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178752 00000100:00100000:0.0:1746065137.038296:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178624 00000100:00100000:0.0:1746065137.038297:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178624 00000100:00100000:0.0:1746065137.038306:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12154 00000100:00100000:0.0:1746065137.038310:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263178752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065137.038353:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065137.038356:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065137.038358:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065137.038360:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065137.038361:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:0.0:1746065137.038381:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881263178752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (175us total) trans 21474840710 rc 0/0 00000100:00100000:0.0:1746065137.038385:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12154 00000100:00100000:0.0:1746065137.038394:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12155 00000100:00100000:0.0:1746065137.038398:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263178624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065137.038448:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881263178624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (211us total) trans 21474840711 rc 0/0 00000100:00100000:0.0:1746065137.038452:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12155 00000100:00100000:0.0:1746065137.040186:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.040457:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111680 00000100:00100000:1.0:1746065137.040462:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111680 00000100:00100000:1.0:1746065137.040538:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4784 00000100:00100000:1.0:1746065137.040543:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+8:31701:x1830881263111680:12345-192.168.202.27@tcp:49:cat.0 00010000:00010000:0.0:1746065137.040670:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.040677:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.040682:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.040687:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065137.040690:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.040696:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.040706:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.040709:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065137.040712:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.040717:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146cdee lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065137.040720:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+8:31701:x1830881263111680:12345-192.168.202.27@tcp:49:cat.0 Request processed in 176us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.040725:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4784 00000100:00100000:0.0:1746065137.041832:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.041959:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111808 00000100:00100000:1.0:1746065137.041963:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111808 00000100:00100000:1.0:1746065137.041992:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12160 00000100:00100000:1.0:1746065137.041998:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+55:31708:x1830881263111808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.042007:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.042020:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146ce03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931f9b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065137.042036:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6f0, atime: 0x6812d6ef, ctime: 0x6812d6f0, blocks: 0x800 00010000:00010000:1.0:1746065137.042049:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.042065:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.042072:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146ce03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f9b expref: 56 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.042084:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146ce03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f9b expref: 56 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.042091:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1600, rc 0) 00000100:00100000:1.0:1746065137.042120:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+56:31708:x1830881263111808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 122us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.042125:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12160 00000100:00100000:0.0:1746065137.042433:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.044704:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.044797:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.047601:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.047651:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263112448 00000100:00100000:1.0:1746065137.047657:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263112448 00000100:00100000:0.0:1746065137.047676:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.047695:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4785 00000100:00100000:1.0:1746065137.047702:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31705:x1830881263112448:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065137.047875:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31705:x1830881263112448:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 173us (278us total) trans 8589935698 rc 0/0 00000100:00100000:1.0:1746065137.047881:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4785 00000100:00100000:0.0:1746065137.055425:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.055470:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.056224:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3229 00000100:00100000:1.0:1746065137.056231:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2007:x1830881263113216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.069567:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.072540:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.072565:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.072590:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.072602:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.072621:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263113856 00000100:00100000:1.0:1746065137.072628:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263113856 00000100:00100000:1.0:1746065137.072654:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263114112 00000100:00100000:1.0:1746065137.072655:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263114112 00000100:00100000:0.0:1746065137.072660:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263113984 00000100:00100000:0.0:1746065137.072662:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263113984 00000100:00100000:1.0:1746065137.072666:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263114240 00000100:00100000:1.0:1746065137.072667:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263114240 00000100:00100000:0.0:1746065137.072677:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12161 00000100:00100000:0.0:1746065137.072682:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263113856:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065137.072688:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12162 00000100:00100000:1.0:1746065137.072692:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2007:x1830881263114112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.072706:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.072717:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc146ce3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931fc5 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.072735:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.072736:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.072743:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc146ce3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fc5 expref: 30 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.072756:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc146ce3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fc5 expref: 30 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.072770:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4000, rc 0) 00000100:00100000:1.0:1746065137.072818:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+30:2007:x1830881263114112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.072822:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12162 00000100:00100000:1.0:1746065137.072833:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12164 00000100:00100000:1.0:1746065137.072837:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263114240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.072843:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.072851:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5600/0xad6b7ddc146ce49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931fcc expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065137.072866:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6f0, atime: 0x6812d6f0, ctime: 0x6812d6f0, blocks: 0x808 00010000:00010000:1.0:1746065137.072874:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.072875:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.072878:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5600/0xad6b7ddc146ce49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fcc expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.072886:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5600/0xad6b7ddc146ce49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fcc expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.072892:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5600, rc 0) 00000100:00100000:1.0:1746065137.072905:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263114240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.072910:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12164 00000100:00100000:1.0:1746065137.072973:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2007:x1830881263113216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16742us (17502us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065137.072982:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3229 00002000:00100000:1.0:1746065137.072988:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800954bc380 x1830881263113216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/440 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.072995:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bc380 with x1830881263113216 ext(1048576->2097151) 00002000:00010000:1.0:1746065137.072999:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954bc380 00010000:00010000:0.0:1746065137.073050:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.073066:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146ce50 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931fb7 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065137.073076:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6f1, atime: 0x6812d6f1, ctime: 0x6812d6f1, blocks: 0x7f0 00010000:00010000:0.0:1746065137.073152:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.073155:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.073160:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146ce50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fb7 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065137.073169:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146ce50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fb7 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065137.073175:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:0.0:1746065137.073189:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263113856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 506us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.073193:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12161 00000100:00100000:0.0:1746065137.076585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.076622:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.076805:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263114496 00000100:00100000:1.0:1746065137.076814:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263114496 00002000:00100000:1.0:1746065137.076856:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff880099cf2a00 x1830881263114496/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.076864:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2a00 with x1830881263114496 ext(4194304->4816895) 00002000:00010000:1.0:1746065137.076869:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf2a00 00000100:00100000:1.0:1746065137.076950:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3230 00000100:00100000:1.0:1746065137.076958:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263114496:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.083187:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.083930:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263114496:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6971us (7350us total) trans 0 rc 622592/622592 00000100:00100000:1.0:1746065137.083937:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3230 00002000:00100000:1.0:1746065137.083944:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff880099cf2a00 x1830881263114496/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:53/0 lens 488/440 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.083950:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2a00 with x1830881263114496 ext(4194304->4816895) 00002000:00010000:1.0:1746065137.083954:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf2a00 00000100:00100000:0.0:1746065137.089936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.090036:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263115136 00000100:00100000:1.0:1746065137.090046:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263115136 00000100:00100000:1.0:1746065137.090120:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4787 00000100:00100000:1.0:1746065137.090127:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4299450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+10:31701:x1830881263115136:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065137.090535:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4299450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+11:31701:x1830881263115136:12345-192.168.202.27@tcp:35:cat.0 Request processed in 407us (604us total) trans 8589935701 rc 0/0 00000100:00100000:1.0:1746065137.090540:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4787 00000100:00100000:0.0:1746065137.094804:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.094839:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.094908:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.094937:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12166 00000100:00100000:0.0:1746065137.094945:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881263115264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065137.094959:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.094972:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146ce5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931fda expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.094988:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.094990:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.094996:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146ce5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fda expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065137.095010:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146ce5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fda expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065137.095022:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:0.0:1746065137.095395:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263115264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 449us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.095401:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12166 00000100:00100000:0.0:1746065137.105984:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.107526:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.107566:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.107619:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116288 00000100:00100000:0.0:1746065137.107621:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116288 00002000:00100000:0.0:1746065137.107638:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099cf3100 x1830881263116288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065137.107646:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3100 with x1830881263116288 ext(2097152->4194303) 00002000:00010000:0.0:1746065137.107649:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf3100 00000100:00100000:1.0:1746065137.107805:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3233 00000100:00100000:1.0:1746065137.107812:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263116032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.108678:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.108701:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.108720:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116544 00000100:00100000:0.0:1746065137.108723:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116544 00010000:00010000:0.0:1746065137.108738:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc146ce0a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fa2 expref: 9 pid: 7231 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065137.108754:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116416 00000100:00100000:0.0:1746065137.108756:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116416 00010000:00010000:0.0:1746065137.108763:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61a00/0xad6b7ddc146ce11 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fa9 expref: 27 pid: 7231 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065137.108792:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5394 00000100:00100000:0.0:1746065137.108797:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263116416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065137.108804:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065137.108808:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61a00/0xad6b7ddc146ce11 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fa9 expref: 27 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.108929:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61a00/0xad6b7ddc146ce11 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fa9 expref: 27 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.108945:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61a00/0xad6b7ddc146ce11 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fa9 expref: 27 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.108965:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.108969:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc146ce7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065137.108976:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc146ce7a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065137.108980:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.109001:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263116416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 203us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.109007:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5394 00000100:00100000:0.0:1746065137.123295:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12180 00000100:00100000:0.0:1746065137.123301:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3759:x1830881263180672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065137.123340:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065137.123342:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065136 -> 1746065136 00002000:00010000:0.0:1746065137.123345:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065135 -> 1746065135 00002000:00010000:0.0:1746065137.123346:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065136 -> 1746065136 00002000:00010000:0.0:1746065137.123348:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065137.123370:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263180672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (679us total) trans 17179873287 rc 0/0 00000100:00100000:0.0:1746065137.123375:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12180 00000100:00100000:0.0:1746065137.123384:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12181 00000100:00100000:0.0:1746065137.123388:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3759:x1830881263181184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.123435:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263181184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (724us total) trans 17179873288 rc 0/0 00000100:00100000:0.0:1746065137.123440:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12181 00000100:00100000:0.0:1746065137.123448:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12182 00000100:00100000:0.0:1746065137.123451:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3759:x1830881263180800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065137.123483:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065137.123485:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065137 -> 1746065137 00002000:00010000:0.0:1746065137.123487:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065136 -> 1746065136 00002000:00010000:0.0:1746065137.123488:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065137 -> 1746065137 00002000:00010000:0.0:1746065137.123490:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746065137.123505:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263180800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (769us total) trans 17179873289 rc 0/0 00000100:00100000:0.0:1746065137.123509:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12182 00000100:00100000:0.0:1746065137.123518:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12183 00000100:00100000:0.0:1746065137.123521:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3759:x1830881263181312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065137.123565:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263181312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (810us total) trans 17179873290 rc 0/0 00000100:00100000:0.0:1746065137.123572:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12183 00000100:00100000:1.0:1746065137.125637:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12184 00000100:00100000:1.0:1746065137.125646:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3761:x1830881263180928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065137.125719:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065137.125723:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065137.125725:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065137.125726:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065137.125728:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:1.0:1746065137.125766:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3761:x1830881263180928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (2112us total) trans 17179873292 rc 0/0 00000100:00100000:1.0:1746065137.125786:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12184 00000100:00100000:1.0:1746065137.125822:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3761:x1830881263181440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (835us total) trans 17179873291 rc 0/0 00000100:00100000:1.0:1746065137.125827:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12185 00000100:00100000:1.0:1746065137.135158:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263116032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27336us (27623us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065137.135168:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3233 00002000:00100000:1.0:1746065137.135178:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099cf0e00 x1830881263116032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/440 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.135186:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0e00 with x1830881263116032 ext(2097152->4194303) 00002000:00010000:1.0:1746065137.135192:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0e00 00000100:00100000:0.0:1746065137.140852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.140954:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.140976:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116672 00000100:00100000:1.0:1746065137.140985:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116672 00000100:00100000:1.0:1746065137.141024:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12186 00000100:00100000:1.0:1746065137.141030:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+30:31711:x1830881263116672:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065137.141046:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.141144:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd931ff6 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.141169:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc146cde0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f7f expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.141176:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c284a00/0xad6b7ddc146ce6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fe8 expref: 56 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.141182:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.141183:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.141186:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2736128->3145727] (req 2736128->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.141210:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c284a00/0xad6b7ddc146ce6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fe8 expref: 56 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.141220:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c284a00/0xad6b7ddc146ce6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fe8 expref: 56 pid: 3068 timeout: 833 lvb_type: 1 00000100:00100000:1.0:1746065137.141230:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263181568:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065137.141300:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc146cde0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f7f expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.141307:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc146cde0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f7f expref: 31 pid: 3067 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.141315:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263181696:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065137.141331:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.143072:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263181568:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065137.143112:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263181696:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065137.143132:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2736128->3145727] (req 2736128->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.143144:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:1.0:1746065137.143220:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+31:31711:x1830881263116672:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2187us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.143228:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12186 00000100:00100000:0.0:1746065137.143941:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.146251:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.150599:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.151502:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.151689:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263117440 00000100:00100000:1.0:1746065137.151695:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263117440 00000100:00100000:1.0:1746065137.151731:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12187 00000100:00100000:1.0:1746065137.151738:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+56:31708:x1830881263117440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.151753:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.151765:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146ce8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932004 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.151809:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.151816:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.151817:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.151821:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146ce8f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932004 expref: 57 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.151841:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.151852:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 29 pid: 9550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.151861:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263181952:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065137.151907:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.151921:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263117312 00000100:00100000:1.0:1746065137.151924:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263117312 00002000:00100000:1.0:1746065137.151946:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2736128->2740223) req@ffff880099bd4700 x1830881263117312/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.151954:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4700 with x1830881263117312 ext(2736128->2740223) 00010000:00010000:1.0:1746065137.151959:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 30 pid: 9550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.151968:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 30 pid: 9550 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746065137.152764:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd4700 00000100:00100000:1.0:1746065137.153740:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263181952:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065137.153760:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146ce8f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932004 expref: 57 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.153787:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4c00, rc 0) 00000100:00100000:1.0:1746065137.153822:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+57:31708:x1830881263117440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2083us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.153828:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12187 00000100:00100000:0.0:1746065137.167297:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.167376:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.167449:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263117824 00000100:00100000:1.0:1746065137.167453:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263117824 00000100:00100000:1.0:1746065137.167477:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12188 00000100:00100000:1.0:1746065137.167482:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+12:31711:x1830881263117824:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065137.167493:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.167505:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146ce96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93200b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.167526:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146cdf5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f8d expref: 13 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.167534:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc146ce65 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fe1 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.167539:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.167541:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.167544:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146ce96 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->3211263] (req 3145728->3211263) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93200b expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.167568:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc146ce65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fe1 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.167576:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc146ce65 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fe1 expref: 22 pid: 3068 timeout: 833 lvb_type: 1 00000100:00100000:1.0:1746065137.167586:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263182080:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065137.167645:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146cdf5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f8d expref: 13 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.167652:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146cdf5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f8d expref: 13 pid: 13375 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.167659:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263182208:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065137.167674:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.171422:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263182080:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065137.172576:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146cdf5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f8d expref: 14 pid: 13375 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.172588:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263182208:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065137.174606:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146ce96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93200b expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.174620:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4400, rc 0) 00000100:00100000:1.0:1746065137.174659:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+13:31711:x1830881263117824:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7176us (7368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.174666:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12188 00000100:00100000:0.0:1746065137.178675:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.178794:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.178848:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263118208 00000100:00100000:1.0:1746065137.178851:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263118208 00010000:00010000:1.0:1746065137.178866:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 32 pid: 9550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.178887:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5399 00000100:00100000:1.0:1746065137.178893:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+32:2007:x1830881263118208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.178902:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.178917:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 32 pid: 9550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.179301:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 32 pid: 9550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.179322:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146ce81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2736128->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ff6 expref: 32 pid: 9550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.179333:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.179335:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.179341:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146ce8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932004 expref: 56 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.179351:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146ce8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932004 expref: 56 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.179374:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146ce8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932004 expref: 56 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.179382:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263182464:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065137.179419:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.185910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.186146:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263182464:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065137.186160:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.186646:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+31:2007:x1830881263118208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7751us (7974us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.186654:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5399 00000100:00100000:0.0:1746065137.186765:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.186927:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263119232 00000100:00100000:1.0:1746065137.186930:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263119232 00000100:00100000:1.0:1746065137.186957:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4788 00000100:00100000:1.0:1746065137.186962:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+8:31711:x1830881263119232:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065137.187109:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+9:31711:x1830881263119232:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 145us (343us total) trans 8589935703 rc 0/0 00000100:00100000:1.0:1746065137.187114:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4788 00000100:00100000:0.0:1746065137.211270:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.211368:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263119360 00000100:00100000:1.0:1746065137.211378:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263119360 00000100:00100000:0.0:1746065137.212198:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12189 00000100:00100000:0.0:1746065137.212209:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+22:31708:x1830881263119360:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065137.212225:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.212240:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146cec0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932019 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.212266:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146ce96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93200b expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.212273:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065137.212274:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065137.212277:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146cec0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932019 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.212306:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146ce96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93200b expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.212317:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146ce96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93200b expref: 11 pid: 9550 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065137.212327:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263182592:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065137.216220:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.222031:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.226155:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.231289:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.231464:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.231481:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120000 00000100:00100000:1.0:1746065137.231485:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120000 00000100:00100000:1.0:1746065137.231506:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12191 00000100:00100000:1.0:1746065137.231511:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+31:2004:x1830881263120000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.231518:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.231526:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cef1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93202e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.231537:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.231539:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.231545:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cef1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93202e expref: 32 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.231555:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146cef1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93202e expref: 32 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.231563:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4a00, rc 0) 00000100:00100000:1.0:1746065137.231576:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+32:2004:x1830881263120000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.231581:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12191 00000100:00100000:0.0:1746065137.234486:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.234690:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120128 00000100:00100000:1.0:1746065137.234696:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120128 00010000:00010000:1.0:1746065137.234721:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146ce96 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93200b expref: 16 pid: 9550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.234924:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5400 00000100:00100000:1.0:1746065137.234932:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263120128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.234942:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.234945:0:8352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc146ce96) 00010000:00010000:1.0:1746065137.234947:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.234977:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263120128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (499us total) trans 0 rc 116/116 00000100:00100000:1.0:1746065137.234983:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5400 00000100:00100000:0.0:1746065137.246560:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120640 00000100:00100000:0.0:1746065137.246568:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120640 00002000:00100000:0.0:1746065137.246604:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097faa300 x1830881263120640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065137.246612:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa300 with x1830881263120640 ext(3145728->4194303) 00002000:00010000:0.0:1746065137.246616:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097faa300 00000100:00100000:0.0:1746065137.246636:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3237 00000100:00100000:0.0:1746065137.246643:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+57:2007:x1830881263120640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.267710:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.268609:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.270010:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3239 00000100:00100000:1.0:1746065137.270019:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+32:2006:x1830881263121152:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.273662:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.273700:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.273767:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263121664 00000100:00100000:1.0:1746065137.273782:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263121664 00002000:00100000:1.0:1746065137.273801:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880090ddb100 x1830881263121664/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.273810:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb100 with x1830881263121664 ext(1048576->2097151) 00002000:00010000:1.0:1746065137.273815:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddb100 00000100:00100000:1.0:1746065137.273994:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3240 00000100:00100000:1.0:1746065137.274000:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+34:2006:x1830881263121408:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.281740:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.293969:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+32:2006:x1830881263121408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19960us (20303us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065137.293980:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3240 00002000:00100000:1.0:1746065137.293989:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880090dda300 x1830881263121408/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:53/0 lens 488/440 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.293997:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda300 with x1830881263121408 ext(1048576->2097151) 00002000:00010000:1.0:1746065137.294002:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dda300 00000100:00100000:1.0:1746065137.310093:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.320959:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.340657:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5401 00000100:00100000:1.0:1746065137.340668:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263123200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.340681:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.340686:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146cedc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932020 expref: 13 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.340704:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146cedc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932020 expref: 13 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.340813:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146cedc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932020 expref: 13 pid: 7231 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.340830:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065137.340834:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146cf06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065137.340841:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146cf06 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065137.340847:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.340881:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263123200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 216us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.340888:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5401 00000100:00100000:0.0:1746065137.377766:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.402935:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.411318:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263123968 00000100:00100000:1.0:1746065137.411326:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263123968 00000100:00100000:1.0:1746065137.411365:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4790 00000100:00100000:1.0:1746065137.411370:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+12:31719:x1830881263123968:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065137.411479:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+13:31719:x1830881263123968:12345-192.168.202.27@tcp:35:cat.0 Request processed in 109us (216us total) trans 8589935708 rc 0/0 00000100:00100000:1.0:1746065137.411483:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4790 00000100:00100000:1.0:1746065137.412347:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263124096 00000100:00100000:1.0:1746065137.412351:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263124096 00010000:00010000:1.0:1746065137.412365:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146cec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932019 expref: 24 pid: 1880 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.412393:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5404 00000100:00100000:1.0:1746065137.412399:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881263124096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.412406:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.412414:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146cec0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932019 expref: 24 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.412422:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146cec0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932019 expref: 24 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.412433:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146cec0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932019 expref: 24 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.412441:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.412443:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.412448:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc146cf14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932043 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.412455:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc146cf14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932043 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.412479:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc146cf14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932043 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.412493:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263183488:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065137.413683:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.413698:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263183488:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065137.413707:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.413735:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263124096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1336us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.413741:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5404 00000100:00100000:0.0:1746065137.415237:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.418872:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.419007:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263124480 00000100:00100000:0.0:1746065137.419012:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263124480 00000100:00100000:0.0:1746065137.420066:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.420950:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.430853:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.432199:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.442401:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.538270:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.539211:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13430 00000100:00100000:0.0:1746065137.539221:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:31728:x1830881263126016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065137.539242:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.539257:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932058 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.539316:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539328:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539336:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539347:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539352:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539357:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539432:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146cf3e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539622:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146cf3e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539629:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146cf3e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065137.539637:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065137.539693:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539698:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539703:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539708:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539712:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993f800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065137.539715:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.539720:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540064:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065137.540067:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065137.540070:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540075:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540299:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540305:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540309:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540312:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065137.540315:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540319:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540326:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800928a2c00) 00010000:00010000:0.0:1746065137.540328:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065137.540330:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540334:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.540365:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932058 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.540375:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146cf3e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932058 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.540381:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.540382:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065137.540384:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fa00, rc 0) 00000100:00100000:0.0:1746065137.541181:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+32:31728:x1830881263126016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1959us (2914us total) trans 8589935710 rc 0/0 00000100:00100000:0.0:1746065137.541187:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13430 00000100:00100000:0.0:1746065137.547380:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.548523:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263126144 00000100:00100000:1.0:1746065137.548532:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263126144 00000100:00100000:1.0:1746065137.548584:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12196 00000100:00100000:1.0:1746065137.548591:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881263126144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.548609:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.548623:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146cf4c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93205f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.548669:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263184128:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065137.548760:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b240 going to sleep for 11 seconds 00002000:00010000:1.0:1746065137.551663:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065136 -> 1746065137 00000100:00100000:1.0:1746065137.551688:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263184128:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065137.551713:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146cf4c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93205f expref: 58 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.551727:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5c00/0xad6b7ddc146cf4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93205f expref: 58 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.551753:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:1.0:1746065137.551820:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881263126144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3227us (4443us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065137.551828:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12196 00000100:00100000:0.0:1746065137.564390:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263126400 00000100:00100000:0.0:1746065137.564398:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263126400 00000100:00100000:0.0:1746065137.564453:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13431 00000100:00100000:0.0:1746065137.564461:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+32:31730:x1830881263126400:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065137.564482:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065137.564498:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc146cf53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932066 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.564563:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564575:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564584:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564595:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564602:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564607:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564680:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564688:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564694:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065137.564702:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065137.564758:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564920:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564926:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564932:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564937:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993fe00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065137.564940:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564945:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564957:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065137.564960:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065137.564963:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564968:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146cf5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564988:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564993:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.564997:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.565000:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065137.565002:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.565007:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.565013:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800928a2e00) 00010000:00010000:0.0:1746065137.565015:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065137.565161:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.565167:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146cf61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065137.565198:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc146cf53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932066 expref: 35 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.565209:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932066 expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.565214:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.565216:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065137.565218:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:0.0:1746065137.565263:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+34:31730:x1830881263126400:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 802us (1982us total) trans 8589935711 rc 0/0 00000100:00100000:0.0:1746065137.565268:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13431 00000100:00100000:1.0:1746065137.565565:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.565602:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.565635:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.565757:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3251 00000100:00100000:1.0:1746065137.565764:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263127168:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.568974:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.576482:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.578283:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263127552 00000100:00100000:0.0:1746065137.578291:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263127552 00000100:00100000:0.0:1746065137.578333:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 691 00000100:00100000:0.0:1746065137.578340:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263127552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065137.578351:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065137.578369:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146cf68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932066 expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.578383:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.578387:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.578420:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263127552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.578426:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 691 00000100:00100000:0.0:1746065137.578593:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881263126784:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12894us (12990us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065137.578600:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3250 00002000:00100000:0.0:1746065137.578607:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009856f100 x1830881263126784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/440 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065137.578616:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f100 with x1830881263126784 ext(1048576->2097151) 00002000:00010000:0.0:1746065137.578619:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856f100 00000100:00100000:0.0:1746065137.623468:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.623514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.638547:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.641199:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.641748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.641790:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128448 00000100:00100000:1.0:1746065137.641796:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128448 00000100:00100000:1.0:1746065137.641829:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128576 00000100:00100000:1.0:1746065137.641831:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128576 00000100:00100000:1.0:1746065137.641846:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12197 00000100:00100000:1.0:1746065137.641852:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263128448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.641865:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.641877:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc146cf99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932074 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.641916:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263184256:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065137.642139:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b240 going to sleep for 11 seconds 00002000:00010000:1.0:1746065137.643237:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065136 -> 1746065137 00000100:00100000:1.0:1746065137.643248:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263184256:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065137.643264:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc146cf99 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932074 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.643278:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc146cf99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932074 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.643605:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5400, rc 0) 00000100:00100000:1.0:1746065137.643631:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263128448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1778us (2435us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065137.643637:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12197 00000100:00100000:0.0:1746065137.644683:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.644722:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128704 00000100:00100000:1.0:1746065137.644726:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128704 00000100:00100000:1.0:1746065137.644756:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12199 00000100:00100000:1.0:1746065137.644761:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+57:31728:x1830881263128704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.644790:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.644800:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932082 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.644818:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 58 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.644825:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146cf22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932051 expref: 31 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.644831:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065137.644833:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065137.644836:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 58 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.644858:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146cf22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932051 expref: 31 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.644868:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146cf22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932051 expref: 31 pid: 1880 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.644877:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263184640:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065137.644923:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 58 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.644931:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 58 pid: 1880 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.644938:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263184768:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065137.644955:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.645011:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263184512 00000100:00100000:1.0:1746065137.645014:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263184512 00000100:00080000:0.0:1746065137.645105:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065137.645426:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1746065137.645432:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263184512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746065137.645444:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1040384 granted 1142954304 pending 9613312 free 3910807552 avail 3679285248 00000100:00100000:1.0:1746065137.645512:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263184512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.645517:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1746065137.647179:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.647203:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263184640:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065137.647213:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263184768:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065137.647219:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065137.647234:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 58 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.647248:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5000, rc 0) 00000100:00100000:1.0:1746065137.647277:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+58:31728:x1830881263128704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2515us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.647283:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12199 00000100:00100000:1.0:1746065137.647483:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1169 00000100:00100000:1.0:1746065137.647488:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+32:2007:x1830881263128832:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065137.653981:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:1.0:1746065137.654875:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873294 is committed 00000001:00080000:1.0:1746065137.654886:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873292 is committed 00000001:00080000:1.0:1746065137.654904:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873276 is committed 00000100:00100000:0.0:1746065137.655249:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.655489:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129344 00000100:00100000:1.0:1746065137.655493:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129344 00010000:00010000:1.0:1746065137.655565:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146cf22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932051 expref: 8 pid: 1880 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.655583:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5407 00000100:00100000:1.0:1746065137.655588:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263129344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.655596:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.655748:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146cf22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3559424->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932051 expref: 8 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.655757:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146cf22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3559424->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932051 expref: 8 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.655789:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146cf22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3559424->18446744073709551615] (req 3559424->4153343) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932051 expref: 8 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.655802:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.655823:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263129344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 235us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.655828:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5407 00000100:00100000:0.0:1746065137.657488:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263128960:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10016us (10266us total) trans 17179873295 rc 0/0 00000100:00100000:0.0:1746065137.657495:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1168 00002000:00100000:0.0:1746065137.657500:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3112959) req@ffff88008c528e00 x1830881263128960/t17179873295(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/448 e 0 to 0 dl 1746065148 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065137.657506:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528e00 with x1830881263128960 ext(2097152->3112959) 00010000:00010000:0.0:1746065137.657512:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 30 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.657523:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 30 pid: 1880 timeout: 833 lvb_type: 0 00002000:00010000:0.0:1746065137.657528:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c528e00 00000100:00100000:0.0:1746065137.660372:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.660432:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129728 00000100:00100000:1.0:1746065137.660435:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129728 00010000:00010000:1.0:1746065137.660460:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc146cf14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932043 expref: 25 pid: 1880 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.660483:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5408 00000100:00100000:1.0:1746065137.660489:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263129728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.660499:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.660514:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc146cf14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932043 expref: 25 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.660523:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc146cf14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932043 expref: 25 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.660542:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc146cf14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932043 expref: 25 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.660567:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.660569:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.660577:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146cfae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932089 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.660584:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146cfae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932089 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.660611:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146cfae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932089 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.660621:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263185024:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065137.660679:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.661886:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263185024:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065137.661897:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.661928:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881263129728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1438us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.661934:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5408 00000100:00100000:0.0:1746065137.662861:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.663178:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.663245:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129856 00000100:00100000:1.0:1746065137.663248:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129856 00000100:00100000:1.0:1746065137.663274:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 692 00000100:00100000:1.0:1746065137.663281:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263129856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.663291:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.663305:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46800/0xad6b7ddc146cfca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932090 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.663316:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065137.663319:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.663340:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263129856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 61us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.663345:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 692 00000100:00100000:0.0:1746065137.664699:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.664731:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.664762:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130496 00000100:00100000:1.0:1746065137.664831:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130496 00010000:00010000:1.0:1746065137.664844:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 30 pid: 1880 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.664861:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5409 00000100:00100000:1.0:1746065137.664867:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263130496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.664875:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.664887:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 30 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.664960:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 30 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.664974:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc146cf1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3538943] (req 2097152->3112959) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93204a expref: 30 pid: 1880 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.664984:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.664985:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.664991:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.664998:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.665025:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.665035:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263185152:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065137.665105:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.673407:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263185152:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065137.673547:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.673588:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263130496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8719us (8855us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.673597:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5409 00000100:00100000:0.0:1746065137.675425:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.682515:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.687159:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.698190:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.705637:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.707833:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.724742:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.737537:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.738259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.755504:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.755669:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.755914:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132800 00000100:00100000:1.0:1746065137.755921:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132800 00010000:00010000:1.0:1746065137.755948:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc146cfdf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93209e expref: 26 pid: 9550 timeout: 833 lvb_type: 1 00000100:00100000:1.0:1746065137.755971:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5410 00000100:00100000:1.0:1746065137.755977:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263132800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.755987:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.756002:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc146cfdf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93209e expref: 26 pid: 9550 timeout: 833 lvb_type: 1 00010000:00010000:1.0:1746065137.756011:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc146cfdf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93209e expref: 26 pid: 9550 timeout: 833 lvb_type: 1 00010000:00010000:1.0:1746065137.757285:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baf200/0xad6b7ddc146cfdf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93209e expref: 26 pid: 9550 timeout: 833 lvb_type: 1 00010000:00010000:1.0:1746065137.757314:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.757317:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.757323:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.757331:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.757367:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065137.757625:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263185536:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065137.757728:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.764096:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.765386:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263185536:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065137.765401:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.765812:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263132800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9834us (10313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.765819:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5410 00000100:00100000:0.0:1746065137.768547:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.780479:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.780542:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263133440 00000100:00100000:1.0:1746065137.780551:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263133440 00010000:00010000:1.0:1746065137.780582:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 30 pid: 11461 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.780625:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5412 00000100:00100000:1.0:1746065137.780632:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263133440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.780642:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.780657:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 30 pid: 11461 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.780665:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 30 pid: 11461 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.780684:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5000/0xad6b7ddc146cfa7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932082 expref: 30 pid: 11461 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.780712:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.780746:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263133440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.780752:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5412 00000100:00100000:0.0:1746065137.786452:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065137.789328:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065137.801139:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.801173:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263133824 00000100:00100000:0.0:1746065137.801181:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263133824 00002000:00100000:0.0:1746065137.801220:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2998272->3002367) req@ffff8800a4e53b80 x1830881263133824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065137.801229:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53b80 with x1830881263133824 ext(2998272->3002367) 00002000:00010000:0.0:1746065137.801234:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e53b80 00000100:00100000:0.0:1746065137.801252:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3262 00000100:00100000:0.0:1746065137.801259:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263133824:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065137.801369:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263133824:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 110us (236us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065137.801374:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3262 00002000:00100000:0.0:1746065137.801380:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2998272->3002367) req@ffff8800a4e53b80 x1830881263133824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065137.801387:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53b80 with x1830881263133824 ext(2998272->3002367) 00002000:00010000:0.0:1746065137.801389:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e53b80 00000100:00100000:0.0:1746065137.808822:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.854017:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.860926:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.865861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.865917:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263134848 00000100:00100000:1.0:1746065137.865925:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263134848 00000100:00100000:1.0:1746065137.865977:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 694 00000100:00100000:1.0:1746065137.865983:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263134848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.865995:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.866014:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc146d02c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320ba expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.866051:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065137.866055:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.866089:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263134848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.866096:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 694 00000100:00100000:0.0:1746065137.869215:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.869299:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.871910:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263135360 00000100:00100000:0.0:1746065137.871915:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263135360 00000100:00100000:1.0:1746065137.871971:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263135616 00000100:00100000:1.0:1746065137.871975:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263135616 00002000:00100000:1.0:1746065137.871993:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3002368->4194303) req@ffff880134b01f80 x1830881263135616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.872002:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01f80 with x1830881263135616 ext(3002368->4194303) 00002000:00010000:1.0:1746065137.872005:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01f80 00000100:00100000:1.0:1746065137.872019:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3263 00000100:00100000:1.0:1746065137.872025:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263135616:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:0.0:1746065137.872216:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880134b01c00 x1830881263135360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 504/0 e 0 to 0 dl 1746065148 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065137.872222:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01c00 with x1830881263135360 ext(2097152->4194303) 00002000:00010000:0.0:1746065137.872226:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b01c00 00000100:00100000:0.0:1746065137.872245:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3264 00000100:00100000:0.0:1746065137.872250:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263135360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.877693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.879154:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263135616:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7123us (7224us total) trans 0 rc 1191936/1191936 00000100:00100000:1.0:1746065137.879163:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3263 00002000:00100000:1.0:1746065137.879171:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3002368->4194303) req@ffff880134b01f80 x1830881263135616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:53/0 lens 488/440 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 1191936/1191936 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065137.879179:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01f80 with x1830881263135616 ext(3002368->4194303) 00002000:00010000:1.0:1746065137.879183:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01f80 00000100:00100000:0.0:1746065137.882953:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.882975:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.883426:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.883815:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263136000 00000100:00100000:1.0:1746065137.883819:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263136000 00000100:00100000:1.0:1746065137.883858:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12208 00000100:00100000:1.0:1746065137.883866:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263135872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.883882:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.883895:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7aca00/0xad6b7ddc146d04f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9320d6 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.883913:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.883921:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7aca00/0xad6b7ddc146d04f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320d6 expref: 16 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.883930:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7aca00/0xad6b7ddc146d04f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320d6 expref: 16 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065137.883943:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7aca00, rc 0) 00000100:00100000:1.0:1746065137.883979:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263135872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 114us (1031us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065137.884878:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12208 00000100:00100000:0.0:1746065137.885103:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263136384 00000100:00100000:0.0:1746065137.885107:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263136384 00010000:00010000:0.0:1746065137.885120:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc146ce57 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fd3 expref: 25 pid: 3068 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746065137.885143:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5415 00000100:00100000:0.0:1746065137.885148:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263136384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065137.885154:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065137.885162:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc146ce57 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fd3 expref: 25 pid: 3068 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.885170:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc146ce57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fd3 expref: 25 pid: 3068 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.885181:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc146ce57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fd3 expref: 25 pid: 3068 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746065137.885192:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.885193:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065137.885199:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146d048 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320cf expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.885206:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146d048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320cf expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.885226:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146d048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320cf expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065137.885234:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263186944:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065137.886243:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.886647:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263186944:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065137.886659:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.886674:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263136384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1526us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.886681:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5415 00000100:00100000:0.0:1746065137.886771:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263186688:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065137.886933:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146d056 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320dd expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065137.886942:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146d056 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320dd expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065137.886949:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b400, rc 0) 00000100:00100000:1.0:1746065137.887037:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263136000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2974us (4059us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065137.887043:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12209 00000100:00100000:0.0:1746065137.887433:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.888088:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263136512 00000100:00100000:1.0:1746065137.888093:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263136512 00000100:00100000:1.0:1746065137.888134:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12211 00000100:00100000:1.0:1746065137.888141:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+13:31736:x1830881263136512:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065137.888154:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.888165:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146d064 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9320eb expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.888183:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.888190:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.888191:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.888194:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146d064 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3035135] (req 2097152->3035135) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320eb expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.888214:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.888225:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 23 pid: 9550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.888235:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263187072:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065137.888296:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065137.888464:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.888508:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.890213:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263187072:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065137.890225:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146d064 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3035135] (req 2097152->3035135) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320eb expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.890234:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac400, rc 0) 00000100:00100000:1.0:1746065137.890260:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+15:31736:x1830881263136512:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2118us (2827us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.890266:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12211 00000100:00100000:0.0:1746065137.892511:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.892950:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.893391:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263137152 00000100:00100000:1.0:1746065137.893396:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263137152 00000100:00100000:1.0:1746065137.893429:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12213 00000100:00100000:1.0:1746065137.893435:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:31745:x1830881263137152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065137.893444:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065137.893456:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7acc00/0xad6b7ddc146d072 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9320f9 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.893474:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.893476:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065137.893479:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7acc00/0xad6b7ddc146d072 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f9 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.893489:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7acc00/0xad6b7ddc146d072 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f9 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.893497:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7acc00, rc 0) 00000100:00100000:1.0:1746065137.893530:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:31745:x1830881263137152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 95us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.893535:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12213 00000100:00100000:0.0:1746065137.905268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.905371:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263137280 00000100:00100000:1.0:1746065137.905379:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263137280 00010000:00010000:1.0:1746065137.905410:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 27 pid: 9550 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.905447:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5416 00000100:00100000:1.0:1746065137.905455:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263137280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065137.905468:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065137.905484:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 27 pid: 9550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.905494:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 27 pid: 9550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.905515:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146cfe6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3121152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320a5 expref: 27 pid: 9550 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746065137.905540:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.905544:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065137.905550:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146d064 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3035135) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320eb expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.905556:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146d064 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3035135) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320eb expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.905706:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146d064 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3035135) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320eb expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065137.905717:0:9565:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146d064 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3035135) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320eb expref: 14 pid: 11461 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746065137.905727:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263187328:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065137.906964:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065137.909013:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263187328:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065137.909030:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065137.909084:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263137280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3628us (3821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065137.909092:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5416 00000100:00100000:1.0:1746065137.919409:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.927833:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.935165:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065137.939083:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.939420:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263138176 00000100:00100000:0.0:1746065137.939427:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263138176 00000100:00100000:0.0:1746065137.939478:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 695 00000100:00100000:0.0:1746065137.939485:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263138176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065137.939589:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065137.939609:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45600/0xad6b7ddc146d08e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932100 expref: 38 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065137.939624:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065137.939627:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065137.939674:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263138176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 189us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.939679:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 695 00000100:00100000:0.0:1746065137.941889:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.950835:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.950874:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.951555:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3266 00000100:00100000:0.0:1746065137.951563:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263138560:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065137.961391:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961432:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961461:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961490:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961511:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139456 00000100:00100000:0.0:1746065137.961518:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139456 00000100:00100000:0.0:1746065137.961558:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139712 00000100:00100000:0.0:1746065137.961561:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139712 00000100:00100000:0.0:1746065137.961575:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 984 00000100:00100000:0.0:1746065137.961581:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263139456:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065137.961631:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263139456:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.961637:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 984 00000100:00100000:0.0:1746065137.961650:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 985 00000100:00100000:0.0:1746065137.961654:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2005:x1830881263139712:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065137.961678:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2005:x1830881263139712:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 23us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.961683:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 985 00000100:00100000:0.0:1746065137.961714:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961749:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961760:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139072 00000100:00100000:0.0:1746065137.961763:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139072 00000100:00100000:0.0:1746065137.961801:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 986 00000100:00100000:0.0:1746065137.961806:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2005:x1830881263139072:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065137.961826:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2005:x1830881263139072:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 20us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.961831:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 986 00000100:00100000:0.0:1746065137.961860:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961870:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139328 00000100:00100000:0.0:1746065137.961873:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139328 00000100:00100000:0.0:1746065137.961888:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 987 00000100:00100000:0.0:1746065137.961892:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263139328:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065137.961913:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263139328:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 21us (53us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.961918:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 987 00000100:00100000:0.0:1746065137.961946:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961977:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.961985:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139840 00000100:00100000:0.0:1746065137.961987:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139840 00000100:00100000:0.0:1746065137.962002:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 988 00000100:00100000:0.0:1746065137.962006:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881263139840:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065137.962027:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881263139840:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 21us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.962031:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 988 00000100:00100000:0.0:1746065137.962073:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065137.962114:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065137.962126:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139200 00000100:00100000:0.0:1746065137.962129:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139200 00000100:00100000:0.0:1746065137.962146:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139968 00000100:00100000:0.0:1746065137.962147:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139968 00000100:00100000:0.0:1746065137.962160:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139584 00000100:00100000:0.0:1746065137.962162:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139584 00000100:00100000:0.0:1746065137.962170:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140096 00000100:00100000:0.0:1746065137.962171:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140096 00000100:00100000:0.0:1746065137.962184:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 611 00000100:00100000:0.0:1746065137.962189:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263139200:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065137.962213:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263139200:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 23us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065137.962217:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 611 00000100:00100000:0.0:1746065137.972030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.975024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.976602:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.989901:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.993736:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.998532:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.998560:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065137.998871:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3268 00000100:00100000:0.0:1746065137.998879:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263141120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065138.004021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.017340:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.019412:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263141120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20527us (20879us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065138.019421:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3268 00002000:00100000:1.0:1746065138.019429:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880091a92680 x1830881263141120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:53/0 lens 488/440 e 0 to 0 dl 1746065148 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.019437:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92680 with x1830881263141120 ext(2097152->4194303) 00002000:00010000:1.0:1746065138.019441:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a92680 00000100:00100000:0.0:1746065138.033378:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.035684:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.051878:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.055942:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.066041:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.067428:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.070142:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.076112:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.076614:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.076753:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143552 00000100:00100000:1.0:1746065138.076757:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143552 00000100:00100000:1.0:1746065138.076793:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4798 00000100:00100000:1.0:1746065138.076798:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+21:31751:x1830881263143552:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065138.076931:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+22:31751:x1830881263143552:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 133us (317us total) trans 8589935724 rc 0/0 00000100:00100000:1.0:1746065138.076937:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4798 00000100:00100000:0.0:1746065138.077446:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.082731:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143808 00000100:00100000:1.0:1746065138.082738:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143808 00010000:00010000:1.0:1746065138.082764:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc146d09c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932107 expref: 8 pid: 11461 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.082813:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5420 00000100:00100000:1.0:1746065138.082820:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263143808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.082832:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.082848:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc146d09c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932107 expref: 8 pid: 11461 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.082858:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc146d09c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932107 expref: 8 pid: 11461 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.082876:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc146d09c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932107 expref: 8 pid: 11461 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.082887:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.082889:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.082894:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146d0bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3076095) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93212a expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.082900:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146d0bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3076095) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93212a expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.082928:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146d0bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3076095) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93212a expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.082937:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263188736:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065138.083002:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.086812:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.086916:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263188736:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065138.086932:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.086978:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263143808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4158us (5336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.086986:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5420 00000100:00100000:0.0:1746065138.092798:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.095864:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.098860:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.099258:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263144576 00000100:00100000:1.0:1746065138.099264:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263144576 00010000:00010000:1.0:1746065138.099288:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146ce5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fda expref: 26 pid: 12260 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746065138.099321:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5421 00000100:00100000:1.0:1746065138.099328:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263144576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.099339:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.099355:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146ce5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fda expref: 26 pid: 12260 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.099364:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146ce5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fda expref: 26 pid: 12260 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.099383:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146ce5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fda expref: 26 pid: 12260 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.099396:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.099414:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263144576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.099419:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5421 00000100:00100000:0.0:1746065138.099604:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.104238:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.105438:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.116683:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263145472 00000100:00100000:0.0:1746065138.116693:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263145472 00002000:00100000:0.0:1746065138.116729:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (348160->352255) req@ffff880134b03b80 x1830881263145472/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.116744:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03b80 with x1830881263145472 ext(348160->352255) 00002000:00010000:0.0:1746065138.116749:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b03b80 00000100:00100000:0.0:1746065138.116766:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3275 00000100:00100000:0.0:1746065138.116797:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263145472:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065138.116917:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263145472:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 144us (298us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065138.116923:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3275 00002000:00100000:0.0:1746065138.116928:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (348160->352255) req@ffff880134b03b80 x1830881263145472/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.116935:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03b80 with x1830881263145472 ext(348160->352255) 00002000:00010000:0.0:1746065138.116937:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b03b80 00000100:00100000:0.0:1746065138.128158:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.136946:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.137005:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263145856 00000100:00100000:1.0:1746065138.137013:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263145856 00000100:00100000:1.0:1746065138.137068:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4800 00000100:00100000:1.0:1746065138.137075:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+22:8522:x1830881263145856:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065138.138204:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+23:8522:x1830881263145856:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1125us (1259us total) trans 8589935726 rc 0/0 00000100:00100000:1.0:1746065138.138213:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4800 00000100:00100000:0.0:1746065138.145518:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.145553:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.145577:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.145592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.145602:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.145877:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263146368 00000100:00100000:1.0:1746065138.145884:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263146368 00000100:00100000:0.0:1746065138.145888:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.145904:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263146496 00000100:00100000:0.0:1746065138.145907:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263146496 00000100:00100000:1.0:1746065138.145926:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12221 00000100:00100000:1.0:1746065138.145933:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263146112:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065138.145933:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12222 00000100:00100000:0.0:1746065138.145938:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263146240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065138.145946:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.145951:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.145959:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc146d10c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932146 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.145961:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93214d expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.145976:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.145978:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.145985:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.145996:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065138.145997:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263189504:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065138.146005:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00200, rc 0) 00000100:00100000:0.0:1746065138.146036:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263146240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 98us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.146062:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12222 00000100:00100000:1.0:1746065138.146064:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065138.148253:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065137 -> 1746065138 00002000:00010000:1.0:1746065138.148257:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065137 -> 1746065138 00002000:00010000:1.0:1746065138.148259:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065137 -> 1746065138 00000100:00100000:1.0:1746065138.148266:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263189504:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065138.148279:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc146d10c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932146 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.148289:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc146d10c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932146 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.148303:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:1.0:1746065138.148319:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263146112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2387us (2809us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065138.148325:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12221 00000100:00100000:0.0:1746065138.151914:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.154964:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.155244:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147136 00000100:00100000:1.0:1746065138.155250:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147136 00010000:00010000:1.0:1746065138.155276:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45400/0xad6b7ddc146d105 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93213f expref: 9 pid: 9571 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.155316:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5424 00000100:00100000:1.0:1746065138.155323:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263147136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.155335:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.155340:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45400/0xad6b7ddc146d105 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93213f expref: 9 pid: 9571 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.155349:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45400/0xad6b7ddc146d105 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93213f expref: 9 pid: 9571 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.155366:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45400/0xad6b7ddc146d105 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93213f expref: 9 pid: 9571 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.155476:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.155480:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.155489:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.155498:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.155524:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.155565:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263147136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 241us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.155571:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5424 00010000:00010000:0.0:1746065138.155624:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065138.155630:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065138.155646:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065138.155745:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c000/0xad6b7ddc146d136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.155879:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.155891:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065138.155893:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065138.155896:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6da00, rc 0) 00000100:00100000:1.0:1746065138.156101:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31756:x1830881263147008:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3912us (4193us total) trans 8589935727 rc 0/0 00000100:00100000:1.0:1746065138.156107:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13439 00000100:00100000:0.0:1746065138.157613:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.157891:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147264 00000100:00100000:1.0:1746065138.157896:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147264 00000100:00100000:1.0:1746065138.157931:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13440 00000100:00100000:1.0:1746065138.157938:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31756:x1830881263147264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065138.157954:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.157968:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc146d14b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932177 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.158117:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.158132:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.158138:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.158159:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.158172:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 9 pid: 9571 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.158181:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263189888:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.158459:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.159694:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263189888:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.159711:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065138.159943:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.160132:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147392 00000100:00100000:1.0:1746065138.160137:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147392 00010000:00010000:1.0:1746065138.160156:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 10 pid: 9571 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.160188:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5425 00000100:00100000:1.0:1746065138.160194:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263147392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.160204:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.160208:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 10 pid: 9571 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.160218:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 10 pid: 9571 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.160232:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146d13d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932170 expref: 10 pid: 9571 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.160243:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.160247:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.160254:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.160261:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.160286:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.160326:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263147392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 132us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.160332:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5425 00010000:00010000:0.0:1746065138.160424:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065138.160430:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065138.160465:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00000004:00200000:0.0:1746065138.160469:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065138.160484:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065138.160509:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc146d14b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932177 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.160518:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146d152 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932177 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.160524:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065138.160526:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065138.160528:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:0.0:1746065138.160556:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31756:x1830881263147264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2619us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.160562:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13440 00000100:00100000:0.0:1746065138.163543:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.163577:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.163648:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147648 00000100:00100000:1.0:1746065138.163655:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147648 00000100:00100000:1.0:1746065138.163700:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147520 00000100:00100000:1.0:1746065138.163703:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147520 00000100:00100000:1.0:1746065138.163719:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12227 00000100:00100000:1.0:1746065138.163726:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263147648:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065138.163739:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065138.163742:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.163756:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146d159 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932185 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.163918:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263190144:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065138.163960:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.167158:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263190144:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065138.167173:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146d159 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932185 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.167187:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc146d159 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932185 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.167193:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:1.0:1746065138.167232:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263147648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3505us (3695us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065138.167240:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12227 00000100:00100000:0.0:1746065138.171220:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.173389:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.173415:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.173433:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.173451:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.173465:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148288 00000100:00100000:0.0:1746065138.173470:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148288 00000100:00100000:1.0:1746065138.173472:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148544 00000100:00100000:1.0:1746065138.173477:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148544 00000100:00100000:1.0:1746065138.173500:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148160 00000100:00100000:0.0:1746065138.173500:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148800 00000100:00100000:0.0:1746065138.173501:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148800 00000100:00100000:1.0:1746065138.173502:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148160 00000100:00100000:0.0:1746065138.173513:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12230 00000100:00100000:1.0:1746065138.173519:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12231 00000100:00100000:0.0:1746065138.173519:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263148288:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:1.0:1746065138.173524:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263148544:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065138.173544:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.173544:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146d18a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.173557:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146d048 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320cf expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.173558:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f60c00/0xad6b7ddc146cde7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f86 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.173565:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065138.173565:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.173566:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.173569:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.173572:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146ce42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fbe expref: 6 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.173577:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.173578:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.173580:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146d18a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.173592:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146d048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320cf expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.173594:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146ce42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fbe expref: 6 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.173603:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146ce42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fbe expref: 6 pid: 1880 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.173605:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146d048 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320cf expref: 15 pid: 11461 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.173614:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263190528:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.173615:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263190400:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065138.174173:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.174181:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 9 pid: 10219 timeout: 834 lvb_type: 1 00000100:00100000:0.0:1746065138.174188:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263190912:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.174522:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.175319:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.175373:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065138.175604:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f60c00/0xad6b7ddc146cde7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f86 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.175615:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f60c00/0xad6b7ddc146cde7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f86 expref: 30 pid: 12258 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.175624:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263191040:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065138.175645:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.190307:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.190322:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.190338:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148928 00000100:00100000:0.0:1746065138.190344:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148928 00002000:00100000:0.0:1746065138.190378:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1998848->2097151) req@ffff88009a6dea00 x1830881263148928/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.190386:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dea00 with x1830881263148928 ext(1998848->2097151) 00010000:00010000:0.0:1746065138.190394:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146d048 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320cf expref: 16 pid: 11461 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.190404:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146d048 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320cf expref: 16 pid: 11461 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065138.190410:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6dea00 00000100:00100000:1.0:1746065138.190453:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263190400:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.190469:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.190856:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149056 00000100:00100000:0.0:1746065138.190859:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149056 00002000:00100000:0.0:1746065138.190873:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2211840->3076095) req@ffff88009a6de300 x1830881263149056/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.190879:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6de300 with x1830881263149056 ext(2211840->3076095) 00010000:00010000:0.0:1746065138.190883:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146d0bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3076095) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93212a expref: 31 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.190890:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146d0bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3076095) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93212a expref: 31 pid: 12260 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065138.190895:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6de300 00000100:00100000:0.0:1746065138.191788:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1177 00000100:00100000:0.0:1746065138.191795:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263149056:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065138.193993:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149184 00000100:00100000:0.0:1746065138.193999:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149184 00010000:00010000:0.0:1746065138.194022:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146ce42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fbe expref: 7 pid: 1880 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746065138.194062:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149312 00000100:00100000:1.0:1746065138.194066:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149312 00000100:00100000:0.0:1746065138.194066:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5426 00000100:00100000:0.0:1746065138.194072:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263149184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.194081:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 11 pid: 10219 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746065138.194083:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065138.194097:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146ce42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fbe expref: 7 pid: 1880 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746065138.194104:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5427 00010000:00010000:0.0:1746065138.194106:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146ce42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fbe expref: 7 pid: 1880 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746065138.194109:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263149312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.194115:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.194124:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 11 pid: 10219 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746065138.194124:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc146ce42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fbe expref: 7 pid: 1880 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.194133:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 11 pid: 10219 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746065138.194141:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065138.194146:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc146d113 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93214d expref: 11 pid: 10219 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.194158:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065138.194208:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+6:2007:x1830881263149184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 135us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.194214:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5426 00000100:00100000:1.0:1746065138.194435:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263149312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 325us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.194441:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5427 00000100:00100000:1.0:1746065138.195273:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.195298:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.195311:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149568 00000100:00100000:1.0:1746065138.195314:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149568 00002000:00100000:1.0:1746065138.195335:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (4096->352255) req@ffff88009856d180 x1830881263149568/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.195343:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881263149568 ext(4096->352255) 00010000:00010000:1.0:1746065138.195349:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146d0e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->352255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932138 expref: 18 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.195358:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146d0e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->352255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932138 expref: 18 pid: 12260 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065138.195363:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856d180 00000100:00100000:1.0:1746065138.195376:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1178 00000100:00100000:1.0:1746065138.195381:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263149568:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065138.195929:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149440 00000100:00100000:0.0:1746065138.195934:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149440 00010000:00010000:0.0:1746065138.195949:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc146ce3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fc5 expref: 6 pid: 9548 timeout: 834 lvb_type: 1 00000100:00100000:0.0:1746065138.195969:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5428 00000100:00100000:0.0:1746065138.195979:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+6:2005:x1830881263149440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065138.196040:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.196119:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.196133:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149696 00000100:00100000:1.0:1746065138.196135:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149696 00010000:00010000:1.0:1746065138.196149:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e26200/0xad6b7ddc146d12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932154 expref: 10 pid: 13375 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746065138.196164:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149824 00000100:00100000:1.0:1746065138.196166:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149824 00010000:00010000:1.0:1746065138.196175:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60c00/0xad6b7ddc146cde7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f86 expref: 33 pid: 12258 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.196194:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5429 00000100:00100000:1.0:1746065138.196200:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263149696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.196207:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.196218:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e26200/0xad6b7ddc146d12f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932154 expref: 10 pid: 13375 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.196226:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e26200/0xad6b7ddc146d12f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932154 expref: 10 pid: 13375 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.196241:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e26200/0xad6b7ddc146d12f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932154 expref: 10 pid: 13375 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.196252:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.196269:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263149696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.196274:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5429 00000100:00100000:1.0:1746065138.196286:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5430 00000100:00100000:1.0:1746065138.196290:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263149824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.196297:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.196304:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f60c00/0xad6b7ddc146cde7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f86 expref: 33 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.196312:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f60c00/0xad6b7ddc146cde7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f86 expref: 33 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.196322:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60c00/0xad6b7ddc146cde7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f86 expref: 33 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.196330:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.196331:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.196335:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146d18a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.196343:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146d18a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.196359:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.196373:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263149824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.196378:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5430 00000100:00100000:1.0:1746065138.196403:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.196438:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.196461:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149952 00000100:00100000:1.0:1746065138.196463:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149952 00010000:00010000:1.0:1746065138.196473:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146d121 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932162 expref: 13 pid: 1880 timeout: 834 lvb_type: 1 00000100:00100000:1.0:1746065138.196482:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150080 00000100:00100000:1.0:1746065138.196484:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150080 00010000:00010000:1.0:1746065138.196491:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146d06b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f2 expref: 22 pid: 1880 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.196500:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5431 00000100:00100000:1.0:1746065138.196505:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263149952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.196511:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.196519:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146d121 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932162 expref: 13 pid: 1880 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.196526:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146d121 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932162 expref: 13 pid: 1880 timeout: 834 lvb_type: 1 00010000:00010000:1.0:1746065138.196537:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146d121 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932162 expref: 13 pid: 1880 timeout: 834 lvb_type: 1 00000100:00100000:0.0:1746065138.196561:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5432 00000100:00100000:0.0:1746065138.196567:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263150080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065138.196574:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.197216:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.197234:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263149952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 728us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.197240:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5431 00000100:00100000:1.0:1746065138.197265:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.197301:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.197320:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150208 00000100:00100000:1.0:1746065138.197323:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150208 00010000:00010000:1.0:1746065138.197333:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146ce03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f9b expref: 32 pid: 13375 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.197346:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150336 00000100:00100000:1.0:1746065138.197348:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150336 00010000:00010000:0.0:1746065138.197351:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146d06b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f2 expref: 22 pid: 1880 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.197356:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7acc00/0xad6b7ddc146d072 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f9 expref: 25 pid: 11461 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.197361:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146d06b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f2 expref: 22 pid: 1880 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.197365:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5433 00000100:00100000:1.0:1746065138.197370:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263150208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065138.197373:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146d06b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f2 expref: 22 pid: 1880 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.197376:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065138.197383:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065138.197384:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146ce03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f9b expref: 32 pid: 13375 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.197391:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146ce03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f9b expref: 32 pid: 13375 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.197398:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263150080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 831us (959us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065138.197401:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146ce03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931f9b expref: 32 pid: 13375 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.197404:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5432 00010000:00010000:1.0:1746065138.197409:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065138.197414:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5434 00000100:00100000:0.0:1746065138.197419:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263150336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065138.197423:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263150208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065138.197425:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065138.197427:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5433 00010000:00010000:0.0:1746065138.197431:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7acc00/0xad6b7ddc146d072 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f9 expref: 25 pid: 11461 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.197443:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7acc00/0xad6b7ddc146d072 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f9 expref: 25 pid: 11461 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.197452:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7acc00/0xad6b7ddc146d072 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9320f9 expref: 25 pid: 11461 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.197458:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.197460:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.197462:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146d1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197469:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146d1a6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197478:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065138.197487:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263150336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.197492:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5434 00010000:00010000:0.0:1746065138.197505:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065138.197512:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc146ce3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fc5 expref: 6 pid: 9548 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746065138.197519:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc146ce3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fc5 expref: 6 pid: 9548 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746065138.197528:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4000/0xad6b7ddc146ce3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fc5 expref: 6 pid: 9548 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746065138.197539:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.197540:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.197542:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197548:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197557:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065138.197563:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197569:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197579:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197585:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197591:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197596:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065138.197599:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197609:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197616:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.197622:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc146d19f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.197643:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263148416:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 22009us (22326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.197648:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12234 00000100:00100000:0.0:1746065138.197664:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263149440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1690us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.197668:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5428 00000100:00100000:0.0:1746065138.201840:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263149056:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 10037us (11508us total) trans 17179873297 rc 0/0 00000100:00100000:0.0:1746065138.201850:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1177 00002000:00100000:0.0:1746065138.201859:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2211840->3076095) req@ffff88009a6de300 x1830881263149056/t17179873297(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.201867:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6de300 with x1830881263149056 ext(2211840->3076095) 00010000:00010000:0.0:1746065138.201875:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146d0bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3076095) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93212a expref: 31 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.201892:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc146d0bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3076095) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93212a expref: 31 pid: 12260 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065138.201898:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6de300 00000100:00100000:0.0:1746065138.202204:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065138.202646:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.202655:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.202667:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.202673:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.202680:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.202685:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835ce00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065138.202689:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.202695:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.202708:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.202714:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835ce00/0xad6b7ddc146d183 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.202749:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263148544:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 29224us (29332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.202786:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12231 00000100:00100000:0.0:1746065138.204070:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.204654:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263149568:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 9272us (9354us total) trans 21474840731 rc 0/0 00000100:00100000:1.0:1746065138.204662:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1178 00002000:00100000:1.0:1746065138.204669:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (4096->352255) req@ffff88009856d180 x1830881263149568/t21474840731(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.204677:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881263149568 ext(4096->352255) 00010000:00010000:1.0:1746065138.204684:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146d0e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->352255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932138 expref: 19 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.204700:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146d0e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->352255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932138 expref: 19 pid: 12260 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065138.204705:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856d180 00010000:00010000:0.0:1746065138.205058:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.205066:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.205080:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.205086:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.205092:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.205097:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580f600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065138.205101:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.205107:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.205116:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.205121:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009580f600/0xad6b7ddc146d191 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.205171:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2005:x1830881263148800:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 31489us (31736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.205178:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12232 00000100:00100000:0.0:1746065138.206130:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065138.206441:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.206448:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.206459:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.206465:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.206475:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.206479:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065138.206482:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.206487:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.206495:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.206499:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc146d198 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.206529:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263148160:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 32726us (33077us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.206535:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12233 00000100:00100000:0.0:1746065138.208911:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.217012:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151104 00000100:00100000:1.0:1746065138.217017:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151104 00010000:00010000:1.0:1746065138.217032:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146ce88 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ffd expref: 39 pid: 7203 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.217059:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5439 00000100:00100000:1.0:1746065138.217066:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263151104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.217073:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.217076:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146ce88 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ffd expref: 39 pid: 7203 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.217084:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146ce88 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ffd expref: 39 pid: 7203 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.217094:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.217097:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc146d1ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065138.217102:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.217118:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263151104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.217123:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5439 00000100:00100000:1.0:1746065138.217152:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151360 00000100:00100000:1.0:1746065138.217155:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151360 00010000:00010000:1.0:1746065138.217163:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc146cf8b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93206d expref: 22 pid: 7231 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.217183:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5440 00000100:00100000:1.0:1746065138.217187:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263151360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.217192:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.217195:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc146cf8b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93206d expref: 22 pid: 7231 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.217201:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc146cf8b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93206d expref: 22 pid: 7231 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.217209:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.217211:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc146d1ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065138.217216:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.217229:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263151360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.217234:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5440 00010000:00010000:0.0:1746065138.217977:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146ce88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931ffd expref: 38 pid: 7203 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.218005:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263191936:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065138.218015:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc146ce7a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd931fef expref: 21 pid: 7203 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.218027:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263192064:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065138.218033:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc146cf8b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93206d expref: 20 pid: 7231 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.218039:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263192192:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065138.218058:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146cf3e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932058 expref: 37 pid: 7231 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.218065:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263192320:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065138.218082:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc146d1ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065138.218092:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc146d1ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065138.218096:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc146d1ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000040:00080000:0.0:1746065138.218280:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].440, 88 off46768 00000004:00080000:0.0:1746065138.218286:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734236512286ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219584:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].396, 88 off42896 00000004:00080000:0.0:1746065138.219593:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734237819564ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065138.219619:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].397, 88 off42984 00000004:00080000:0.0:1746065138.219622:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734237848035ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065138.219633:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].441, 88 off46856 00000004:00080000:0.0:1746065138.219635:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734237861686ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219642:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].442, 88 off46944 00000004:00080000:0.0:1746065138.219645:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734237871254ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219653:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].398, 88 off43072 00000004:00080000:0.0:1746065138.219655:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734237881409ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065138.219664:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].399, 88 off43160 00000004:00080000:0.0:1746065138.219666:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734237892481ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065138.219674:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].400, 88 off43248 00000004:00080000:0.0:1746065138.219677:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734237903161ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065138.219685:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].443, 88 off47032 00000004:00080000:0.0:1746065138.219687:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734237913831ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219695:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].401, 88 off43336 00000004:00080000:0.0:1746065138.219697:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734237923624ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065138.219706:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].444, 88 off47120 00000004:00080000:0.0:1746065138.219708:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734237934149ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219714:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].402, 88 off43424 00000004:00080000:0.0:1746065138.219717:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734237943248ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065138.219725:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].445, 88 off47208 00000004:00080000:0.0:1746065138.219727:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734237953310ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219733:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].446, 88 off47296 00000004:00080000:0.0:1746065138.219735:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734237961936ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219742:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].447, 88 off47384 00000004:00080000:0.0:1746065138.219744:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734237971026ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219751:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].448, 88 off47472 00000004:00080000:0.0:1746065138.219753:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734237979446ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065138.219760:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].403, 88 off43512 00000004:00080000:0.0:1746065138.219762:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734237988924ns, next at 615601404258ns, rc = 0 00000100:00100000:1.0:1746065138.226969:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263192576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.226980:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263192448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.227113:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.227231:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.227266:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263193088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.227281:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.227294:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746065138.227298:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263192704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.227311:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.227319:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263193216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.227330:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.227352:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192448 00000100:00100000:1.0:1746065138.227358:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192448 00000100:00100000:1.0:1746065138.227385:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192576 00000100:00100000:1.0:1746065138.227386:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192576 00000100:00100000:1.0:1746065138.227395:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193088 00000100:00100000:1.0:1746065138.227397:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193088 00000100:00100000:1.0:1746065138.227405:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192704 00000100:00100000:1.0:1746065138.227406:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192704 00000100:00100000:1.0:1746065138.227413:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193216 00000100:00100000:1.0:1746065138.227414:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193216 00000100:00100000:1.0:1746065138.227425:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12236 00000100:00100000:1.0:1746065138.227431:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3760:x1830881263192448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.227592:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263192960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.227610:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.227633:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192960 00000100:00100000:0.0:1746065138.227636:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192960 00000100:00100000:0.0:1746065138.227649:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12237 00000100:00100000:0.0:1746065138.227653:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3761:x1830881263192576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.227725:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3761:x1830881263192576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (494us total) trans 17179873298 rc 0/0 00000100:00100000:0.0:1746065138.227731:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12237 00000100:00100000:0.0:1746065138.227745:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12238 00000100:00100000:0.0:1746065138.227748:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3761:x1830881263193088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.227816:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3761:x1830881263193088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (535us total) trans 17179873299 rc 0/0 00000100:00100000:0.0:1746065138.227821:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12238 00000100:00100000:0.0:1746065138.227829:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12239 00000100:00100000:0.0:1746065138.227832:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3761:x1830881263192704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.227874:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3761:x1830881263192704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (562us total) trans 17179873300 rc 0/0 00000100:00100000:0.0:1746065138.227879:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12239 00000100:00100000:0.0:1746065138.227887:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12240 00000100:00100000:0.0:1746065138.227891:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3761:x1830881263193216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.227935:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3761:x1830881263193216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (603us total) trans 17179873301 rc 0/0 00000100:00100000:0.0:1746065138.227940:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12240 00000100:00100000:0.0:1746065138.227948:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12241 00000100:00100000:0.0:1746065138.227953:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263192960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.228057:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3760:x1830881263192960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (446us total) trans 17179873302 rc 0/0 00000100:00100000:0.0:1746065138.228063:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12241 00000100:00100000:0.0:1746065138.228091:0:3761:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873292 gen 2 00000004:00080000:0.0:1746065138.228095:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf5c00, transno 17179873240 00000004:00080000:0.0:1746065138.228098:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf6300, transno 17179873241 00000004:00080000:0.0:1746065138.228100:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf5180, transno 17179873242 00000004:00080000:0.0:1746065138.228102:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1c00, transno 17179873243 00000004:00080000:0.0:1746065138.228104:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e10380, transno 17179873244 00000004:00080000:0.0:1746065138.228106:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf4a80, transno 17179873245 00000004:00080000:0.0:1746065138.228108:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954bf480, transno 17179873246 00000004:00080000:0.0:1746065138.228111:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc0700, transno 17179873247 00000004:00080000:0.0:1746065138.228113:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c30380, transno 17179873248 00000004:00080000:0.0:1746065138.228115:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c31180, transno 17179873249 00000004:00080000:0.0:1746065138.228117:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c30000, transno 17179873250 00000004:00080000:0.0:1746065138.228119:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c30e00, transno 17179873251 00000004:00080000:0.0:1746065138.228120:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd500, transno 17179873252 00000004:00080000:0.0:1746065138.228122:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c30a80, transno 17179873253 00000004:00080000:0.0:1746065138.228124:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd180, transno 17179873254 00000004:00080000:0.0:1746065138.228126:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c30700, transno 17179873255 00000004:00080000:0.0:1746065138.228129:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f480, transno 17179873277 00000004:00080000:0.0:1746065138.228131:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856df80, transno 17179873278 00000004:00080000:0.0:1746065138.228133:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856e680, transno 17179873279 00000004:00080000:0.0:1746065138.228135:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856ed80, transno 17179873280 00000004:00080000:0.0:1746065138.228137:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856ca80, transno 17179873281 00000004:00080000:0.0:1746065138.228139:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856c380, transno 17179873282 00000004:00080000:0.0:1746065138.228141:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856d880, transno 17179873283 00000004:00080000:0.0:1746065138.228143:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f800, transno 17179873284 00000004:00080000:0.0:1746065138.228145:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf1500, transno 17179873285 00000004:00080000:0.0:1746065138.228147:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2680, transno 17179873286 00000004:00080000:0.0:1746065138.228149:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf3480, transno 17179873287 00000004:00080000:0.0:1746065138.228151:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf1c00, transno 17179873288 00000004:00080000:0.0:1746065138.228153:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf0a80, transno 17179873289 00000004:00080000:0.0:1746065138.228155:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf1880, transno 17179873290 00000004:00080000:0.0:1746065138.228156:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2d80, transno 17179873291 00000004:00080000:0.0:1746065138.228158:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2300, transno 17179873292 00000100:00100000:0.0:1746065138.228163:0:3761:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012dc3d500 x1830881263192704/t17179873300(17179873300) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065154 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065138.228172:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d500/2, rc 0, transno 17179873300 00000100:00100000:0.0:1746065138.228176:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263192704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065138.228185:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3c000/2, rc 0, transno 17179873301 00000100:00100000:0.0:1746065138.228188:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263193216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065138.228199:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ce00/2, rc 0, transno 17179873298 00000100:00100000:0.0:1746065138.228202:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263192576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065138.228209:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d880/2, rc 0, transno 17179873299 00000100:00100000:0.0:1746065138.228212:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263193088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065138.228226:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d180/2, rc 0, transno 17179873302 00000100:00100000:0.0:1746065138.228229:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263192960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.228334:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3760:x1830881263192448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 902us (1222us total) trans 17179873303 rc 0/0 00000100:00100000:1.0:1746065138.228340:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12236 00000004:00080000:0.0:1746065138.228605:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ed80/2, rc 0, transno 17179873303 00000100:00100000:0.0:1746065138.228609:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263192448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.228636:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192832 00000100:00100000:0.0:1746065138.228639:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192832 00000100:00100000:0.0:1746065138.228655:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12242 00000100:00100000:0.0:1746065138.228659:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263192832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065138.228703:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065138.228706:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065138.228708:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065138.228709:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065138.228711:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:0.0:1746065138.228732:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263192832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (154us total) trans 17179873304 rc 0/0 00000100:00100000:0.0:1746065138.228738:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12242 00000100:00100000:0.0:1746065138.228785:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263193472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.228805:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.228822:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263193984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.228833:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.228840:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065138.228844:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263193856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.228854:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.228863:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263194368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.228876:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.228895:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193984 00000100:00100000:0.0:1746065138.228897:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193984 00000100:00100000:0.0:1746065138.228909:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193856 00000100:00100000:0.0:1746065138.228911:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193856 00000100:00100000:0.0:1746065138.228918:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194368 00000100:00100000:0.0:1746065138.228920:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194368 00000100:00100000:0.0:1746065138.228930:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12246 00000100:00100000:0.0:1746065138.228934:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3760:x1830881263193856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065138.228980:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065138.228982:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065138.228984:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065138.228986:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065138.228988:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746065138.229006:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263193856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (150us total) trans 21474840734 rc 0/0 00000100:00100000:0.0:1746065138.229011:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12246 00000100:00100000:0.0:1746065138.229024:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263193600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.229039:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.229063:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263194112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.229079:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.229090:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065138.229094:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263193728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.229105:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.229111:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263194240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.229124:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.229139:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194240 00000100:00100000:0.0:1746065138.229142:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194240 00000100:00100000:0.0:1746065138.229152:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12249 00000100:00100000:0.0:1746065138.229156:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263194112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.229205:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263194112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (124us total) trans 21474840737 rc 0/0 00000100:00100000:0.0:1746065138.229209:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12249 00000100:00100000:0.0:1746065138.229217:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12251 00000100:00100000:0.0:1746065138.229220:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263194240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065138.229247:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065138.229248:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065138.229250:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065138.229251:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065138.229252:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:0.0:1746065138.229263:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263194240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (138us total) trans 21474840739 rc 0/0 00000100:00100000:0.0:1746065138.229266:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12251 00000004:00080000:0.0:1746065138.229357:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135139c00/2, rc 0, transno 21474840738 00000100:00100000:0.0:1746065138.229361:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263193728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.229366:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138000/2, rc 0, transno 21474840739 00000100:00100000:0.0:1746065138.229368:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263194240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.229371:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513a300/2, rc 0, transno 21474840736 00000100:00100000:0.0:1746065138.229373:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263193600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.229376:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135139f80/2, rc 0, transno 21474840737 00000100:00100000:0.0:1746065138.229377:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263194112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.229384:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138e00/2, rc 0, transno 21474840734 00000100:00100000:0.0:1746065138.229386:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263193856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.229389:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138380/2, rc 0, transno 21474840735 00000100:00100000:0.0:1746065138.229390:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263194368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.229393:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513aa00/2, rc 0, transno 21474840733 00000100:00100000:0.0:1746065138.229394:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263193984:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.229398:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513ad80/2, rc 0, transno 21474840732 00000100:00100000:0.0:1746065138.229400:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263193472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.230062:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194496 00000100:00100000:1.0:1746065138.230066:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194496 00000100:00100000:1.0:1746065138.230082:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12252 00000100:00100000:1.0:1746065138.230086:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881263194496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.230168:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263194496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (140us total) trans 21474840740 rc 0/0 00000100:00100000:1.0:1746065138.230174:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12252 00000100:00100000:1.0:1746065138.234825:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.237643:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.245036:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.245082:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.245108:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.245130:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151872 00000100:00100000:0.0:1746065138.245136:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151872 00000100:00100000:0.0:1746065138.245166:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152128 00000100:00100000:0.0:1746065138.245168:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152128 00000100:00100000:0.0:1746065138.245177:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152384 00000100:00100000:0.0:1746065138.245179:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152384 00000100:00100000:0.0:1746065138.245191:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12253 00000100:00100000:0.0:1746065138.245197:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263151872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065138.245211:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.245227:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc146d1c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9321a8 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065138.245247:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6f2, atime: 0x6812d6f1, ctime: 0x6812d6f2, blocks: 0x7f8 00010000:00010000:0.0:1746065138.245262:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.245264:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.245271:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc146d1c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321a8 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.245284:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc146d1c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321a8 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.245293:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad000, rc 0) 00000100:00100000:0.0:1746065138.245330:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263151872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 133us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.245336:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12253 00000100:00100000:0.0:1746065138.245349:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12254 00000100:00100000:0.0:1746065138.245353:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2004:x1830881263152128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065138.245360:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.245368:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9321b6 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065138.245379:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6f0, atime: 0x6812d6ef, ctime: 0x6812d6f0, blocks: 0x800 00010000:00010000:0.0:1746065138.245386:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.245388:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.245392:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 7 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.245400:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 7 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.245406:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:0.0:1746065138.245419:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263152128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 66us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.245424:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12254 00000100:00100000:0.0:1746065138.245433:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12255 00000100:00100000:0.0:1746065138.245438:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263152384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065138.245443:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.245449:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146d1d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9321c4 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065138.245462:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 4813376, mtime: 0x6812d6f2, atime: 0x6812d6f2, ctime: 0x6812d6f2, blocks: 0x14c0 00010000:00010000:0.0:1746065138.245468:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.245469:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.245472:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146d1d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321c4 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.245480:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146d1d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321c4 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.245485:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00000100:00100000:0.0:1746065138.245496:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263152384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 59us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.245501:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12255 00000100:00100000:0.0:1746065138.245533:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.245546:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152000 00000100:00100000:0.0:1746065138.245548:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152000 00000100:00100000:0.0:1746065138.245561:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12256 00000100:00100000:0.0:1746065138.245565:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263152000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065138.245570:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.245577:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146d1de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9321af expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065138.245587:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6f1, atime: 0x6812d6f1, ctime: 0x6812d6f1, blocks: 0x808 00010000:00010000:0.0:1746065138.245593:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.245595:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.245598:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146d1de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321af expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.246409:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146d1de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321af expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.246417:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abade00, rc 0) 00000100:00100000:0.0:1746065138.246438:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263152000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 872us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.246443:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12256 00000100:00100000:0.0:1746065138.246494:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.247327:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.251365:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.251399:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.251424:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.251440:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152768 00000100:00100000:0.0:1746065138.251446:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152768 00000100:00100000:0.0:1746065138.251554:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12259 00000100:00100000:0.0:1746065138.251562:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263153024:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065138.251758:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263153024:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 196us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.251764:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12259 00000100:00100000:0.0:1746065138.256406:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.256441:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.256468:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153408 00000100:00100000:0.0:1746065138.256469:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.256475:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153408 00000100:00100000:0.0:1746065138.256483:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153664 00000100:00100000:0.0:1746065138.256485:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153664 00000100:00100000:1.0:1746065138.256537:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153920 00000100:00100000:1.0:1746065138.256540:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153920 00000100:00100000:0.0:1746065138.256594:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12265 00000100:00100000:0.0:1746065138.256602:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263153408:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065138.256683:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263153408:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 82us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.256689:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12265 00000100:00100000:0.0:1746065138.256703:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12267 00000100:00100000:0.0:1746065138.256708:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263153920:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065138.256735:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263153920:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 27us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.256740:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12267 00000100:00100000:0.0:1746065138.256819:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.256987:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.257056:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12270 00000100:00100000:1.0:1746065138.257061:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263154048:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065138.257112:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263154048:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.257118:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12270 00000100:00100000:0.0:1746065138.260527:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.260817:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263154176 00000100:00100000:1.0:1746065138.260824:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263154176 00000100:00100000:1.0:1746065138.260867:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12271 00000100:00100000:1.0:1746065138.260875:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263154176:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:1.0:1746065138.261031:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065138.261034:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065138.261036:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065138.261037:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065138.261039:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:1.0:1746065138.261116:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263154176:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 242us (595us total) trans 17179873306 rc 0/0 00000100:00100000:1.0:1746065138.261122:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12271 00000100:00100000:0.0:1746065138.264911:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.265015:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263154304 00000100:00100000:1.0:1746065138.265022:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263154304 00000100:00100000:1.0:1746065138.265080:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12272 00000100:00100000:1.0:1746065138.265087:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263154304:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:1.0:1746065138.265242:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065138.265245:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065138.265247:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065138.265249:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065138.265251:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:1.0:1746065138.265288:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263154304:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 201us (385us total) trans 21474840741 rc 0/0 00000100:00100000:1.0:1746065138.265307:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12272 00000100:00100000:0.0:1746065138.271325:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.271388:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263154560 00000100:00100000:1.0:1746065138.271397:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263154560 00000100:00100000:1.0:1746065138.271458:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3276 00000100:00100000:1.0:1746065138.271467:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263154560:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065138.271502:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.271514:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.271516:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.271520:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.271531:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.272106:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.282762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065138.282894:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.282905:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.282911:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.282922:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065138.282926:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.282932:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.282947:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.282953:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc146d1f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.283007:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263154560:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 11541us (11691us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746065138.283015:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3276 00000100:00100000:1.0:1746065138.283034:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263155584 00000100:00100000:1.0:1746065138.283052:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263155584 00000100:00100000:1.0:1746065138.283104:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3280 00000100:00100000:1.0:1746065138.283111:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263155584:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065138.283137:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.283146:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.283148:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.283153:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.284096:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.291591:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.291629:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.293961:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.296838:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3282 00000100:00100000:1.0:1746065138.296846:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263156096:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065138.296863:0:20324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.296870:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.296871:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.296873:0:20324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.296880:0:20324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.309945:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.309959:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.310030:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.310037:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065138.310048:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.310056:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.310072:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.310078:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc146d20f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.310928:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263155584:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 27816us (28171us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065138.310934:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3280 00010000:00010000:1.0:1746065138.315716:0:20324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.315730:0:20324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.315737:0:20324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.315743:0:20324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065138.315747:0:20324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.315755:0:20324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.315801:0:20324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.315807:0:20324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146d21d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.315867:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263156096:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 19019us (24234us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065138.315875:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3282 00010000:00010000:0.0:1746065138.318053:0:29489:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146d224 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.318069:0:29489:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146d224 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.318075:0:29489:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146d224 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.318081:0:29489:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065138.318085:0:29489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146d224 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.318091:0:29489:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146d224 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.318104:0:29489:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146d224 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.318109:0:29489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146d224 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.318176:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263156352:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 20826us (24217us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065138.318184:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3283 00000100:00100000:0.0:1746065138.327227:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.329988:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.330022:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.330063:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.330090:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.330103:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.330122:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263156736 00000100:00100000:0.0:1746065138.330128:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263156736 00000100:00100000:0.0:1746065138.330157:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263156992 00000100:00100000:0.0:1746065138.330159:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263156992 00000100:00100000:0.0:1746065138.330170:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157248 00000100:00100000:0.0:1746065138.330172:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157248 00000100:00100000:0.0:1746065138.330180:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263156864 00000100:00100000:0.0:1746065138.330181:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263156864 00000100:00100000:0.0:1746065138.330189:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157120 00000100:00100000:0.0:1746065138.330190:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157120 00000100:00100000:0.0:1746065138.330202:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12273 00000100:00100000:0.0:1746065138.330209:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263156736:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:1.0:1746065138.330231:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12274 00000100:00100000:1.0:1746065138.330239:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263156992:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065138.330299:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065138.330300:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065138.330302:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065136 -> 1746065138 00002000:00010000:0.0:1746065138.330303:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.330304:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065135 -> 1746065138 00002000:00010000:0.0:1746065138.330305:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065137 -> 1746065138 00002000:00010000:1.0:1746065138.330306:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065136 -> 1746065138 00002000:00010000:0.0:1746065138.330306:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.330307:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1746065138.330308:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:0.0:1746065138.330336:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263156736:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 128us (353us total) trans 21474840742 rc 0/0 00000100:00100000:0.0:1746065138.330343:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12273 00000100:00100000:0.0:1746065138.330355:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12275 00000100:00100000:0.0:1746065138.330360:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263157248:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065138.330399:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 4813376 -> 4813376 00002000:00010000:0.0:1746065138.330401:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:0.0:1746065138.330403:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:0.0:1746065138.330405:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:0.0:1746065138.330406:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5312 -> 5312 00000100:00100000:1.0:1746065138.330482:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263156992:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 243us (458us total) trans 17179873307 rc 0/0 00000100:00100000:0.0:1746065138.330486:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263157248:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 124us (422us total) trans 21474840743 rc 0/0 00000100:00100000:1.0:1746065138.330488:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12274 00000100:00100000:0.0:1746065138.330493:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12275 00000100:00100000:1.0:1746065138.330498:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12276 00000100:00100000:1.0:1746065138.330502:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263156864:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:0.0:1746065138.330505:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12277 00000100:00100000:0.0:1746065138.330510:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263157120:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065138.330537:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065138.330539:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065137 -> 1746065138 00002000:00010000:1.0:1746065138.330541:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065137 -> 1746065138 00002000:00010000:1.0:1746065138.330543:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065137 -> 1746065138 00002000:00010000:1.0:1746065138.330544:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746065138.330547:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065138.330549:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:0.0:1746065138.330551:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065136 -> 1746065138 00002000:00010000:0.0:1746065138.330552:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:0.0:1746065138.330554:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065138.330558:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263156864:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 56us (468us total) trans 17179873308 rc 0/0 00000100:00100000:1.0:1746065138.330563:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12276 00000100:00100000:0.0:1746065138.330570:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263157120:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 60us (466us total) trans 21474840744 rc 0/0 00000100:00100000:1.0:1746065138.330571:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157376 00000100:00100000:1.0:1746065138.330573:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157376 00000100:00100000:0.0:1746065138.330576:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12277 00000100:00100000:0.0:1746065138.330586:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12278 00000100:00100000:0.0:1746065138.330590:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263157376:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065138.330626:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065138.330628:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:0.0:1746065138.330629:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:0.0:1746065138.330631:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:0.0:1746065138.330633:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746065138.330650:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263157376:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 60us (86us total) trans 17179873309 rc 0/0 00000100:00100000:0.0:1746065138.330655:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12278 00000100:00100000:0.0:1746065138.331815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.332013:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157632 00000100:00100000:1.0:1746065138.332017:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157632 00000100:00100000:1.0:1746065138.332056:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4801 00000100:00100000:1.0:1746065138.332061:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:31756:x1830881263157632:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065138.332099:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146d175 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932193 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.332128:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065138.332137:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d1b4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93219a expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.332143:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065138.332164:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93219a expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.332173:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d1b4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93219a expref: 10 pid: 7231 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.332184:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7206:1830881263194624:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.332252:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.335486:0:7206:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7206:1830881263194624:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.335505:0:7206:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00000100:00100000:0.0:1746065138.335556:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065138.336194:0:7206:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065138.336200:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00000040:00080000:1.0:1746065138.336404:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].449, 88 off47560 00000004:00080000:1.0:1746065138.336409:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354634829ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336442:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].404, 88 off43600 00000004:00080000:1.0:1746065138.336446:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734354672095ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065138.336457:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].405, 88 off43688 00000004:00080000:1.0:1746065138.336459:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734354685557ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065138.336467:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].450, 88 off47648 00000004:00080000:1.0:1746065138.336469:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354695469ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336476:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].451, 88 off47736 00000004:00080000:1.0:1746065138.336478:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354704480ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336485:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].406, 88 off43776 00000004:00080000:1.0:1746065138.336487:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734354713330ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065138.336493:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].407, 88 off43864 00000004:00080000:1.0:1746065138.336496:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734354722457ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065138.336503:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].408, 88 off43952 00000004:00080000:1.0:1746065138.336505:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734354731260ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065138.336512:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].452, 88 off47824 00000004:00080000:1.0:1746065138.336514:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354740844ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336521:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].409, 88 off44040 00000004:00080000:1.0:1746065138.336523:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734354749670ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065138.336530:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].453, 88 off47912 00000004:00080000:1.0:1746065138.336533:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354759092ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336540:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].410, 88 off44128 00000004:00080000:1.0:1746065138.336542:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734354768600ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065138.336549:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].454, 88 off48000 00000004:00080000:1.0:1746065138.336551:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354777917ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336558:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].455, 88 off48088 00000004:00080000:1.0:1746065138.336560:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354786380ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336566:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].456, 88 off48176 00000004:00080000:1.0:1746065138.336568:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354794545ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336574:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].457, 88 off48264 00000004:00080000:1.0:1746065138.336577:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 734354803147ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065138.336583:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].411, 88 off44216 00000004:00080000:1.0:1746065138.336585:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734354811784ns, next at 615601404258ns, rc = 0 00000001:00080000:0.0:1746065138.340303:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935731 is committed 00000004:00080000:0.0:1746065138.340313:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 406 committed 00000004:00080000:0.0:1746065138.340330:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 451 committed 00000004:00080000:0.0:1746065138.340335:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 450 committed 00000004:00080000:0.0:1746065138.340337:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 449 committed 00000004:00080000:0.0:1746065138.340339:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 448 committed 00000004:00080000:0.0:1746065138.340340:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 405 committed 00000004:00080000:0.0:1746065138.340341:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 447 committed 00000004:00080000:0.0:1746065138.340343:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 404 committed 00000004:00080000:0.0:1746065138.340344:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 446 committed 00000004:00080000:0.0:1746065138.340345:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 403 committed 00000004:00080000:0.0:1746065138.340347:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 402 committed 00000004:00080000:0.0:1746065138.340348:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 401 committed 00000004:00080000:0.0:1746065138.340349:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 445 committed 00000004:00080000:0.0:1746065138.340351:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 444 committed 00000004:00080000:0.0:1746065138.340352:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 400 committed 00000004:00080000:0.0:1746065138.340353:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 399 committed 00000004:00080000:0.0:1746065138.340354:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 443 committed 00000004:00010000:1.0:1746065138.340499:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009856dc00 reply state ffff8801316e9400 transno 8589935731 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065138.340513:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065138.340519:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.340521:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065138.340524:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065138.340529:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.340531:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065138.340535:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc146d175 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932193 expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746065138.340599:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065138.340608:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31756:x1830881263157632:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 8546us (8793us total) trans 8589935731 rc 0/0 00000100:00100000:1.0:1746065138.340616:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4801 00000100:00100000:1.0:1746065138.340637:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12280 00000100:00100000:1.0:1746065138.340641:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3759:x1830881263195008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065138.340729:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 4813376 -> 4813376 00002000:00010000:1.0:1746065138.340731:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.340733:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.340734:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.340736:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5312 -> 5312 00000100:00100000:1.0:1746065138.340758:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263195008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (226us total) trans 21474840745 rc 0/0 00000100:00100000:1.0:1746065138.340788:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12280 00000100:00100000:1.0:1746065138.340797:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12283 00000100:00100000:1.0:1746065138.340800:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3760:x1830881263196160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065138.340848:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065138.340851:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065138.340853:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065138.340854:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065138.340856:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:1.0:1746065138.340875:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3760:x1830881263196160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (225us total) trans 17179873310 rc 0/0 00000100:00100000:1.0:1746065138.340880:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12283 00000100:00100000:1.0:1746065138.340890:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12285 00000100:00100000:1.0:1746065138.340894:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881263196032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065138.340926:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065138.340928:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.340929:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.340931:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.340932:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746065138.340948:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881263196032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (252us total) trans 17179873312 rc 0/0 00000100:00100000:1.0:1746065138.340952:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12285 00000100:00100000:0.0:1746065138.341132:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263194752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.341154:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.341177:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263195264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.341194:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.341204:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263195776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.341216:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.341232:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263196288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.341245:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.341248:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194752 00000100:00100000:1.0:1746065138.341252:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194752 00000100:00100000:0.0:1746065138.341255:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746065138.341258:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263194880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.341265:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195264 00000100:00100000:1.0:1746065138.341267:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195264 00000100:00100000:0.0:1746065138.341269:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.341275:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195776 00000100:00100000:1.0:1746065138.341277:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195776 00000100:00100000:0.0:1746065138.341277:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263195392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.341284:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196288 00000100:00100000:1.0:1746065138.341286:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196288 00000100:00100000:0.0:1746065138.341287:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.341292:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194880 00000100:00100000:1.0:1746065138.341293:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194880 00000100:00100000:0.0:1746065138.341294:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263195904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.341299:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195392 00000100:00100000:1.0:1746065138.341300:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195392 00000100:00100000:0.0:1746065138.341306:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.341307:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12287 00000100:00100000:1.0:1746065138.341311:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3761:x1830881263194752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.341312:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263196416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.341321:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065138.341339:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065138.341345:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065138.341349:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT0 00002000:00010000:1.0:1746065138.341351:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065138.341353:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00010000:00010000:0.0:1746065138.341353:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683bc00 already unused, calling callback (ffffffffa0f21690) 00002000:00010000:1.0:1746065138.341355:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341356:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00010000:00010000:0.0:1746065138.341356:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT0 00002000:00010000:1.0:1746065138.341358:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00010000:00010000:0.0:1746065138.341360:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065138.341367:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065138.341369:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065138.341371:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT0 00010000:00010000:0.0:1746065138.341375:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146d232 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT0 00000100:00100000:1.0:1746065138.341382:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3761:x1830881263194752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (227us total) trans 21474840748 rc 0/0 00000100:00100000:1.0:1746065138.341387:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12287 00000100:00100000:1.0:1746065138.341400:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195904 00000100:00100000:1.0:1746065138.341402:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195904 00000004:00080000:0.0:1746065138.341405:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b02680/2, rc 0, transno 21474840748 00000100:00100000:1.0:1746065138.341410:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196416 00000100:00100000:1.0:1746065138.341411:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196416 00000100:00100000:0.0:1746065138.341412:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263194752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.341417:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12288 00000100:00100000:1.0:1746065138.341421:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3761:x1830881263195264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.341431:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065138.341436:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263196800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.341454:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065138.341457:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:1.0:1746065138.341460:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065138.341461:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065138.341463:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065138.341465:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:1.0:1746065138.341484:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3761:x1830881263195264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (290us total) trans 21474840749 rc 0/0 00000100:00100000:1.0:1746065138.341489:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12288 00000100:00100000:1.0:1746065138.341497:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196800 00000100:00100000:1.0:1746065138.341499:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196800 00000100:00100000:1.0:1746065138.341508:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12289 00000100:00100000:1.0:1746065138.341511:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881263195776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065138.341546:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065138.341548:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341550:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341552:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341553:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065138.341573:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263195776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (355us total) trans 17179873314 rc 0/0 00000100:00100000:1.0:1746065138.341579:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12289 00000100:00100000:1.0:1746065138.341688:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12290 00000100:00100000:1.0:1746065138.341693:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881263196288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.341739:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263196288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (493us total) trans 17179873315 rc 0/0 00000100:00100000:1.0:1746065138.341743:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12290 00000100:00100000:1.0:1746065138.341751:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12291 00000100:00100000:1.0:1746065138.341755:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3761:x1830881263194880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065138.341804:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065138.341806:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341808:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341809:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341811:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065138.341827:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3761:x1830881263194880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (556us total) trans 21474840751 rc 0/0 00000100:00100000:1.0:1746065138.341831:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12291 00000100:00100000:1.0:1746065138.341839:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12292 00000100:00100000:1.0:1746065138.341843:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3761:x1830881263195392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.341883:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3761:x1830881263195392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (594us total) trans 21474840752 rc 0/0 00000100:00100000:1.0:1746065138.341887:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12292 00000100:00100000:1.0:1746065138.341895:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12293 00000100:00100000:1.0:1746065138.341898:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881263195904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065138.341930:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065138.341933:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341935:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341936:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.341938:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065138.341954:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263195904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (647us total) trans 17179873316 rc 0/0 00000100:00100000:1.0:1746065138.341959:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12293 00000100:00100000:1.0:1746065138.341967:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12294 00000100:00100000:1.0:1746065138.341971:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881263196416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.342018:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263196416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (695us total) trans 17179873317 rc 0/0 00000100:00100000:1.0:1746065138.342031:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12294 00000004:00080000:1.0:1746065138.342165:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221500/2, rc 0, transno 21474840753 00000100:00100000:1.0:1746065138.342169:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263196800:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.342233:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b02300/2, rc 0, transno 21474840751 00000100:00100000:0.0:1746065138.342236:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263194880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.342241:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b00700/2, rc 0, transno 21474840752 00000100:00100000:0.0:1746065138.342244:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263195392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.342250:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6300/2, rc 0, transno 17179873316 00000100:00100000:0.0:1746065138.342252:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263195904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065138.342257:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e5500/2, rc 0, transno 17179873317 00000100:00100000:0.0:1746065138.342259:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263196416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065138.342265:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b00000/2, rc 0, transno 21474840749 00000100:00100000:0.0:1746065138.342267:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263195264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.342273:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6a00/2, rc 0, transno 17179873314 00000100:00100000:0.0:1746065138.342275:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263195776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065138.342280:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e4380/2, rc 0, transno 17179873315 00000100:00100000:0.0:1746065138.342282:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263196288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.344848:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.351381:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158144 00000100:00100000:1.0:1746065138.351388:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158144 00000100:00100000:1.0:1746065138.352083:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4802 00000100:00100000:1.0:1746065138.352092:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31756:x1830881263158144:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065138.353577:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31756:x1830881263158144:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1483us (2222us total) trans 8589935732 rc 0/0 00000100:00100000:1.0:1746065138.353585:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4802 00000100:00100000:0.0:1746065138.370709:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.370848:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158400 00000100:00100000:1.0:1746065138.370856:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158400 00000100:00100000:1.0:1746065138.371155:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13447 00000100:00100000:1.0:1746065138.371162:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+7:31764:x1830881263158400:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065138.371180:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.371195:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146d240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9321d9 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.371250:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371260:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371269:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371279:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371284:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371289:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371366:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d255 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371372:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d255 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371377:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d255 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065138.371384:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065138.371431:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371439:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371445:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371450:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371455:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065138.371458:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371463:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371472:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065138.371474:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065138.371476:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371481:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d247 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371508:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371513:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371518:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371522:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065138.371525:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371529:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371534:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c7abc00) 00010000:00010000:1.0:1746065138.371536:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065138.371538:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371542:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146d24e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.371568:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146d240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321d9 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.371578:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d255 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321d9 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.371584:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.371585:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065138.371587:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d200, rc 0) 00000100:00100000:1.0:1746065138.371622:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+9:31764:x1830881263158400:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 461us (922us total) trans 8589935733 rc 0/0 00000100:00100000:1.0:1746065138.371628:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13447 00000100:00100000:0.0:1746065138.372351:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.375526:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158912 00000100:00100000:1.0:1746065138.375532:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158912 00000100:00100000:1.0:1746065138.375566:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13449 00000100:00100000:1.0:1746065138.375573:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+9:31769:x1830881263158912:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065138.375591:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.375605:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9321e7 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.375679:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146d28d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.375691:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146d28d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.375699:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146d28d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065138.375708:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065138.375802:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c800/0xad6b7ddc146d286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321e7 expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.375825:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146d28d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321e7 expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.375832:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.375834:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065138.375836:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:1.0:1746065138.375943:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+11:31769:x1830881263158912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 369us (488us total) trans 8589935735 rc 0/0 00000100:00100000:1.0:1746065138.375948:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13449 00000100:00100000:0.0:1746065138.378173:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263159040 00000100:00100000:0.0:1746065138.378180:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263159040 00000100:00100000:1.0:1746065138.378204:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263159296 00000100:00100000:1.0:1746065138.378208:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263159296 00000100:00100000:0.0:1746065138.378223:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12296 00000100:00100000:0.0:1746065138.378230:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+18:31769:x1830881263159040:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065138.378235:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13450 00000100:00100000:1.0:1746065138.378240:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+28:31768:x1830881263159296:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065138.378256:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.378267:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146d29b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9321f5 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.378328:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146d2a2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.378337:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146d2a2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.378346:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146d2a2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065138.378353:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:1.0:1746065138.378420:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146d29b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321f5 expref: 31 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.378429:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.378436:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146d2a2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321f5 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.378440:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc146d2b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9321ee expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.378443:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065138.378445:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065138.378447:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30400, rc 0) 00010000:00010000:0.0:1746065138.378460:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.378461:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.378468:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc146d2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321ee expref: 19 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.378478:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc146d2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321ee expref: 19 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.378485:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1bc00, rc 0) 00000100:00100000:1.0:1746065138.378522:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+30:31768:x1830881263159296:12345-192.168.202.27@tcp:101:cat.0 Request processed in 280us (422us total) trans 8589935736 rc 0/0 00000100:00100000:1.0:1746065138.378528:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13450 00000100:00100000:0.0:1746065138.378905:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+19:31769:x1830881263159040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 675us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.378911:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12296 00000100:00100000:0.0:1746065138.382392:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.385751:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.389874:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263159936 00000100:00100000:1.0:1746065138.389884:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263159936 00002000:00100000:1.0:1746065138.389919:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880090dd9880 x1830881263159936/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.389934:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9880 with x1830881263159936 ext(0->1048575) 00002000:00010000:1.0:1746065138.389939:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9880 00000100:00100000:1.0:1746065138.389958:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3285 00000100:00100000:1.0:1746065138.389965:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+19:2007:x1830881263159936:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065138.402341:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.402657:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+19:2007:x1830881263159936:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12691us (13929us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065138.402665:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3285 00002000:00100000:1.0:1746065138.402673:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880090dd9880 x1830881263159936/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/440 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.402682:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9880 with x1830881263159936 ext(0->1048575) 00002000:00010000:1.0:1746065138.402686:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9880 00000100:00100000:0.0:1746065138.409017:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.409089:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263160320 00000100:00100000:1.0:1746065138.409097:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263160320 00002000:00100000:1.0:1746065138.409134:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880135220700 x1830881263160320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.409143:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220700 with x1830881263160320 ext(1048576->2097151) 00002000:00010000:1.0:1746065138.409149:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220700 00000100:00100000:1.0:1746065138.409181:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3286 00000100:00100000:1.0:1746065138.409189:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263160320:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065138.419295:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.425744:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.429609:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263160320:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20410us (20591us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065138.429620:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3286 00002000:00100000:1.0:1746065138.429632:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880135220700 x1830881263160320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/440 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.429641:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220700 with x1830881263160320 ext(1048576->2097151) 00002000:00010000:1.0:1746065138.429647:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220700 00000100:00100000:1.0:1746065138.429672:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263160704 00000100:00100000:1.0:1746065138.429680:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263160704 00002000:00100000:1.0:1746065138.429712:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880135223100 x1830881263160704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.429719:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223100 with x1830881263160704 ext(1048576->2097151) 00002000:00010000:1.0:1746065138.429723:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135223100 00000100:00100000:0.0:1746065138.440001:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.443909:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.447342:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.456855:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.459301:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263161472 00000100:00100000:1.0:1746065138.459311:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263161472 00002000:00100000:1.0:1746065138.459349:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880091a91c00 x1830881263161472/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.459358:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91c00 with x1830881263161472 ext(1048576->2097151) 00002000:00010000:1.0:1746065138.459364:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91c00 00000100:00100000:1.0:1746065138.459394:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3289 00000100:00100000:1.0:1746065138.459403:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263161472:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065138.468477:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.469859:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263161472:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10453us (13008us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065138.469866:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3289 00002000:00100000:1.0:1746065138.469874:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880091a91c00 x1830881263161472/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/440 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.469881:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91c00 with x1830881263161472 ext(1048576->2097151) 00002000:00010000:1.0:1746065138.469886:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91c00 00000100:00100000:0.0:1746065138.472678:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.474690:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.474769:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263161984 00000100:00100000:1.0:1746065138.474798:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263161984 00002000:00100000:1.0:1746065138.474833:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091a92d80 x1830881263161984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.474841:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92d80 with x1830881263161984 ext(1048576->2097151) 00002000:00010000:1.0:1746065138.474846:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a92d80 00000100:00100000:1.0:1746065138.474873:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3290 00000100:00100000:1.0:1746065138.474880:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263161984:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065138.485376:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263161984:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10485us (10679us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065138.485387:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3290 00002000:00100000:1.0:1746065138.485398:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091a92d80 x1830881263161984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/440 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.485406:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92d80 with x1830881263161984 ext(1048576->2097151) 00002000:00010000:1.0:1746065138.485410:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a92d80 00000100:00100000:0.0:1746065138.487711:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263162496 00000100:00100000:0.0:1746065138.487719:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263162496 00000100:00100000:0.0:1746065138.487763:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13451 00000100:00100000:0.0:1746065138.487770:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+11:31764:x1830881263162496:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065138.487805:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.487808:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746065138.487829:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146d28d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321e7 expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.487850:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d255 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321d9 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.487859:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065138.487863:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065138.487876:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146d2e8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93222d expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.488142:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146d2ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.488154:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146d278 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321e0 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.488160:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96a00/0xad6b7ddc146d239 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321d2 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.488165:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146d2a2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321f5 expref: 29 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.488171:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146d2ef lrc: 6/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065138.488194:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146d2a2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321f5 expref: 29 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.488205:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146d2a2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321f5 expref: 29 pid: 9571 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.488215:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263196928:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.488290:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96a00/0xad6b7ddc146d239 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321d2 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.488297:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96a00/0xad6b7ddc146d239 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321d2 expref: 7 pid: 7231 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.488305:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263197056:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.488378:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146d278 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321e0 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.488385:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146d278 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321e0 expref: 29 pid: 7231 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.488393:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263197184:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.488410:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.491272:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.491354:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263196928:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.491365:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263197056:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.491371:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263197184:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.491392:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146d2ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065138.493238:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.493270:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.493299:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.493327:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.493371:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163008 00000100:00100000:0.0:1746065138.493376:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163008 00000100:00100000:0.0:1746065138.493401:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163136 00000100:00100000:0.0:1746065138.493403:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163136 00000100:00100000:0.0:1746065138.493416:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13452 00000100:00100000:0.0:1746065138.493422:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+11:31769:x1830881263163008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065138.493436:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.493448:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146d2f6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93223b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.493487:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146d2ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065138.493495:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146d2f6 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93223b expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.493509:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146d2ef lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065138.493518:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146d2f6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93223b expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.493527:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065138.493530:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065138.493532:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146d2ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065138.493537:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c400, rc 0) 00000100:00100000:0.0:1746065138.493564:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+12:31769:x1830881263163008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 142us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.493570:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13452 00000100:00100000:0.0:1746065138.493582:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13453 00000100:00100000:0.0:1746065138.493587:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:31768:x1830881263163136:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065138.493597:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.493603:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146d2fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932234 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.493620:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146d2fd lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932234 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.493628:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146d2fd lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932234 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.493634:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065138.493635:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065138.493637:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146d2ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065138.493642:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c800, rc 0) 00000100:00100000:0.0:1746065138.493655:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+31:31768:x1830881263163136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.493660:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13453 00000100:00100000:1.0:1746065138.496261:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263197312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.496303:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.496335:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263197312 00000100:00100000:1.0:1746065138.496338:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263197312 00000100:00100000:0.0:1746065138.496822:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263197696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.496881:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263197824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.496987:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263197568 00000100:00100000:1.0:1746065138.496990:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263197568 00000100:00100000:1.0:1746065138.497008:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12305 00000100:00100000:1.0:1746065138.497013:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881263197568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065138.497120:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065138.497123:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497125:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497127:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497129:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746065138.497149:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3760:x1830881263197568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (334us total) trans 17179873319 rc 0/0 00000100:00100000:1.0:1746065138.497155:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12305 00000100:00100000:1.0:1746065138.497171:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12307 00000100:00100000:1.0:1746065138.497176:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3759:x1830881263197952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065138.497224:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065138.497226:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497228:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497230:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497232:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065138.497248:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263197312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 239us (945us total) trans 17179873318 rc 0/0 00000100:00100000:1.0:1746065138.497259:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12304 00000100:00100000:1.0:1746065138.497287:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3759:x1830881263197952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (183us total) trans 17179873321 rc 0/0 00000100:00100000:1.0:1746065138.497292:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12307 00000100:00100000:1.0:1746065138.497298:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198720 00000100:00100000:1.0:1746065138.497300:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198720 00000100:00100000:1.0:1746065138.497311:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198592 00000100:00100000:1.0:1746065138.497313:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198592 00000100:00100000:1.0:1746065138.497322:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12309 00000100:00100000:1.0:1746065138.497325:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263198720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065138.497370:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 4813376 -> 4813376 00002000:00010000:1.0:1746065138.497372:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497374:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497375:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497377:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5312 -> 5312 00000100:00100000:1.0:1746065138.497395:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263198720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (107us total) trans 21474840754 rc 0/0 00000100:00100000:1.0:1746065138.497399:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12309 00000100:00100000:1.0:1746065138.497407:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12312 00000100:00100000:1.0:1746065138.497410:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3759:x1830881263199104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.497453:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3759:x1830881263199104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (117us total) trans 21474840757 rc 0/0 00000100:00100000:1.0:1746065138.497457:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12312 00000100:00100000:0.0:1746065138.497529:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.497564:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263197696 00000100:00100000:1.0:1746065138.497568:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263197696 00000100:00100000:0.0:1746065138.497573:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263198208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.497590:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.497593:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12313 00000100:00100000:1.0:1746065138.497597:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3761:x1830881263197696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065138.497609:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263198848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.497623:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065138.497633:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065138.497635:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065138.497637:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746065138.497637:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263199360:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065138.497638:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065138.497640:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:0.0:1746065138.497649:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.497654:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881263197696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (125us total) trans 17179873323 rc 0/0 00000100:00100000:1.0:1746065138.497658:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12313 00000004:00080000:0.0:1746065138.497662:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f0380/2, rc 0, transno 17179873323 00000100:00100000:0.0:1746065138.497665:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263197696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.497666:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198848 00000100:00100000:1.0:1746065138.497668:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198848 00000100:00100000:0.0:1746065138.497670:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746065138.497674:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263198464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.497677:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263199360 00000100:00100000:1.0:1746065138.497678:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263199360 00000100:00100000:1.0:1746065138.497686:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12315 00000100:00100000:0.0:1746065138.497686:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.497690:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3761:x1830881263198848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.497694:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263198976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.497706:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065138.497720:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263199488:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065138.497724:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065138.497725:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065138.497727:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065138.497729:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065138.497730:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746065138.497734:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065138.497744:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3761:x1830881263198848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (121us total) trans 21474840758 rc 0/0 00000004:00080000:0.0:1746065138.497745:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e52a00/2, rc 0, transno 17179873324 00000100:00100000:0.0:1746065138.497747:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263198208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065138.497749:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12315 00000004:00080000:0.0:1746065138.497754:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513a680/2, rc 0, transno 21474840758 00000100:00100000:0.0:1746065138.497756:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263198848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.497758:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12317 00000100:00100000:1.0:1746065138.497763:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3761:x1830881263198464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065138.497766:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065138.497794:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f2d80/2, rc 0, transno 17179873318 00000100:00100000:0.0:1746065138.497797:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263197312:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065138.497812:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746065138.497813:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12320 00002000:00010000:1.0:1746065138.497814:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497816:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065138 -> 1746065138 00002000:00010000:1.0:1746065138.497818:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065138 -> 1746065138 00000100:00100000:0.0:1746065138.497818:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263197824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065138.497819:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:1.0:1746065138.497836:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3761:x1830881263198464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (148us total) trans 21474840760 rc 0/0 00000100:00100000:1.0:1746065138.497840:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12317 00000100:00100000:0.0:1746065138.497872:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263197824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (105us total) trans 17179873325 rc 0/0 00000100:00100000:0.0:1746065138.497877:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12320 00000004:00080000:1.0:1746065138.497882:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f3100/2, rc 0, transno 17179873325 00000100:00100000:1.0:1746065138.497885:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263197824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065138.497894:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513b480/2, rc 0, transno 21474840760 00000100:00100000:0.0:1746065138.497897:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263198464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.497903:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dfb80/2, rc 0, transno 21474840761 00000100:00100000:0.0:1746065138.497905:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263198976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.497909:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dd880/2, rc 0, transno 21474840762 00000100:00100000:0.0:1746065138.497911:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263199488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065138.497916:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dca80/2, rc 0, transno 21474840759 00000100:00100000:0.0:1746065138.497918:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263199360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065138.500164:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.500236:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.500559:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4804 00000100:00100000:0.0:1746065138.500567:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:31768:x1830881263163392:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:0.0:1746065138.500609:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:31768:x1830881263163392:12345-192.168.202.27@tcp:49:cat.0 Request processed in 44us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.500615:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4804 00000100:00100000:0.0:1746065138.503031:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.508396:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.512051:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163776 00000100:00100000:0.0:1746065138.512058:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163776 00000100:00100000:1.0:1746065138.512880:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.516713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.517491:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.517524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.517559:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263164800 00000100:00100000:0.0:1746065138.517564:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263164800 00002000:00100000:0.0:1746065138.517595:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88009adf5c00 x1830881263164800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.517603:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5c00 with x1830881263164800 ext(2097152->3145727) 00002000:00010000:0.0:1746065138.517606:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf5c00 00000100:00100000:0.0:1746065138.517618:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3292 00000100:00100000:0.0:1746065138.517624:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263164800:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065138.522192:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.528198:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.528442:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.528934:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.529023:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165440 00000100:00100000:0.0:1746065138.529027:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165440 00010000:00010000:0.0:1746065138.529056:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda400/0xad6b7ddc146d304 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932242 expref: 28 pid: 12258 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.529087:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5448 00000100:00100000:0.0:1746065138.529092:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263165440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065138.529100:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065138.529114:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fda400/0xad6b7ddc146d304 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932242 expref: 28 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.529122:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fda400/0xad6b7ddc146d304 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932242 expref: 28 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.529136:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fda400/0xad6b7ddc146d304 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932242 expref: 28 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.529149:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.529150:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.529155:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc146d30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4153344->18446744073709551615] (req 4153344->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932249 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.529161:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc146d30b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4153344->18446744073709551615] (req 4153344->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932249 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.529187:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc146d30b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4153344->18446744073709551615] (req 4153344->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932249 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.529199:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263200384:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065138.529223:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.531880:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263200384:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065138.531898:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.531926:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263165440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2833us (2992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.531934:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5448 00000100:00100000:0.0:1746065138.533984:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.534432:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.534474:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165824 00000100:00100000:1.0:1746065138.534478:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165824 00002000:00100000:1.0:1746065138.534497:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2801664->3145727) req@ffff88009adf4000 x1830881263165824/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.534503:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4000 with x1830881263165824 ext(2801664->3145727) 00010000:00010000:1.0:1746065138.534509:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc146d312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932257 expref: 8 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.534521:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc146d312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932257 expref: 8 pid: 12260 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065138.534527:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adf4000 00000100:00100000:1.0:1746065138.534539:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1180 00000100:00100000:1.0:1746065138.534544:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263165824:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065138.535581:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.545880:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.545900:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166464 00000100:00100000:0.0:1746065138.545907:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166464 00000100:00100000:0.0:1746065138.545951:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4806 00000100:00100000:0.0:1746065138.545958:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+9:31764:x1830881263166464:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065138.546130:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+10:31764:x1830881263166464:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 172us (251us total) trans 8589935738 rc 0/0 00000100:00100000:0.0:1746065138.546137:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4806 00000100:00100000:1.0:1746065138.547061:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263165824:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12515us (12627us total) trans 17179873326 rc 0/0 00000100:00100000:1.0:1746065138.547068:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1180 00002000:00100000:1.0:1746065138.547075:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2801664->3145727) req@ffff88009adf4000 x1830881263165824/t17179873326(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.547082:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4000 with x1830881263165824 ext(2801664->3145727) 00010000:00010000:1.0:1746065138.547090:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc146d312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932257 expref: 10 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.547102:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc146d312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932257 expref: 10 pid: 12260 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746065138.547108:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adf4000 00000100:00100000:0.0:1746065138.551276:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.551322:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.551723:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166976 00000100:00100000:0.0:1746065138.551727:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166976 00002000:00100000:0.0:1746065138.551744:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3608576->4153343) req@ffff88009adf6300 x1830881263166976/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.551751:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6300 with x1830881263166976 ext(3608576->4153343) 00002000:00010000:0.0:1746065138.551754:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf6300 00000100:00100000:0.0:1746065138.551792:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3296 00000100:00100000:0.0:1746065138.551798:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263166976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065138.563273:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.563325:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167232 00000100:00100000:1.0:1746065138.563333:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167232 00010000:00010000:1.0:1746065138.563367:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc146d312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932257 expref: 11 pid: 12260 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.563408:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5449 00000100:00100000:1.0:1746065138.563416:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263167232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.563426:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.563441:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc146d312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932257 expref: 11 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.563451:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc146d312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932257 expref: 11 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.563468:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552e000/0xad6b7ddc146d312 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932257 expref: 11 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.563498:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.563501:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.563507:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9600/0xad6b7ddc146d320 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93225e expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.563513:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9600/0xad6b7ddc146d320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93225e expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.563520:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.563521:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.563524:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146d32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93226c expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.563529:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146d32e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93226c expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.563535:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.563536:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.563538:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc146d335 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932273 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.563543:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc146d335 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932273 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.563573:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc146d335 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932273 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.563582:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263200512:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065138.563670:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146d32e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93226c expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.563678:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263200640:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065138.563710:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9600/0xad6b7ddc146d320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93225e expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.563717:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263200768:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065138.563734:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.572471:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263200512:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065138.572485:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263200640:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065138.572493:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263200768:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065138.572515:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.572801:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263167232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9383us (9533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.572807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.572810:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5449 00000100:00100000:0.0:1746065138.576027:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167744 00000100:00100000:0.0:1746065138.576035:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167744 00002000:00100000:0.0:1746065138.576258:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88009a6df800 x1830881263167744/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.576268:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df800 with x1830881263167744 ext(2097152->3145727) 00002000:00010000:0.0:1746065138.576489:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6df800 00000100:00100000:0.0:1746065138.576518:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3298 00000100:00100000:0.0:1746065138.576525:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263167744:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065138.577126:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.581172:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.585416:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263167744:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8883us (9517us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065138.585426:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3298 00002000:00100000:1.0:1746065138.585435:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88009a6df800 x1830881263167744/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/440 e 0 to 0 dl 1746065149 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.585444:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df800 with x1830881263167744 ext(2097152->3145727) 00002000:00010000:1.0:1746065138.585449:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6df800 00000100:00100000:0.0:1746065138.587451:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.590300:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.590331:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.590349:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168512 00000100:00100000:1.0:1746065138.590355:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168512 00000100:00100000:0.0:1746065138.590369:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168640 00000100:00100000:0.0:1746065138.590372:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168640 00000100:00100000:1.0:1746065138.590399:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12330 00002000:00100000:0.0:1746065138.590399:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4153344->4194303) req@ffff8800954bce00 x1830881263168640/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065138.590406:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+22:31769:x1830881263168512:12345-192.168.202.27@tcp:101:cat.0 00002000:00100000:0.0:1746065138.590408:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bce00 with x1830881263168640 ext(4153344->4194303) 00010000:00010000:0.0:1746065138.590414:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc146d30b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4153344->18446744073709551615] (req 4153344->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932249 expref: 29 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.590416:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.590423:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc146d30b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4153344->18446744073709551615] (req 4153344->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932249 expref: 29 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.590425:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc146d343 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932281 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065138.590433:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954bce00 00010000:00010000:1.0:1746065138.590442:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:0.0:1746065138.590443:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1182 00010000:00010000:1.0:1746065138.590446:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc146d343 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932281 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065138.590447:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263168640:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:1.0:1746065138.590456:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc146d343 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932281 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.590469:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927c00, rc 0) 00000100:00100000:1.0:1746065138.590497:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+23:31769:x1830881263168512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.590502:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12330 00000100:00100000:0.0:1746065138.591821:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.593519:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263168640:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 3067us (3183us total) trans 21474840763 rc 0/0 00000100:00100000:0.0:1746065138.593525:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1182 00002000:00100000:0.0:1746065138.593530:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4153344->4194303) req@ffff8800954bce00 x1830881263168640/t21474840763(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/448 e 0 to 0 dl 1746065149 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.593536:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bce00 with x1830881263168640 ext(4153344->4194303) 00010000:00010000:0.0:1746065138.593541:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc146d30b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4153344->18446744073709551615] (req 4153344->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932249 expref: 30 pid: 12258 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746065138.593547:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc146d30b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4153344->18446744073709551615] (req 4153344->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932249 expref: 30 pid: 12258 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746065138.593551:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800954bce00 00000100:00100000:1.0:1746065138.595812:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.609476:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.609512:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.609748:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.609798:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169408 00000100:00100000:0.0:1746065138.609798:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169792 00000100:00100000:1.0:1746065138.609804:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169408 00000100:00100000:0.0:1746065138.609804:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169792 00002000:00100000:1.0:1746065138.609834:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800954bf100 x1830881263169408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.609834:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x70:0x0] (4071424->4194303) req@ffff8800954bd180 x1830881263169792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065138.609843:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bf100 with x1830881263169408 ext(3145728->4194303) 00002000:00100000:0.0:1746065138.609847:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bd180 with x1830881263169792 ext(4071424->4194303) 00002000:00010000:1.0:1746065138.609848:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800954bf100 00002000:00010000:0.0:1746065138.609850:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954bd180 00000100:00100000:0.0:1746065138.609879:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3300 00000100:00100000:0.0:1746065138.609885:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263169408:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065138.628176:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.638982:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263170048 00000100:00100000:0.0:1746065138.638989:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263170048 00000100:00100000:0.0:1746065138.639168:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12332 00000100:00100000:0.0:1746065138.639175:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+10:31769:x1830881263170048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065138.639190:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.639204:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc146d351 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93228f expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.639228:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146d32e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93226c expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.639235:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065138.639236:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065138.639239:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc146d351 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93228f expref: 11 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.639262:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146d32e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93226c expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.639272:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146d32e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93226c expref: 33 pid: 12260 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746065138.639283:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263201536:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065138.639349:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.639532:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.642802:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.650180:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.654833:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.657656:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263201792:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065138.657670:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065138.657696:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263170688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2676us (2863us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.657703:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5452 00000100:00100000:0.0:1746065138.659503:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.664256:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.664600:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171328 00000100:00100000:1.0:1746065138.664608:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171328 00000100:00100000:1.0:1746065138.664675:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4808 00000100:00100000:1.0:1746065138.664683:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+28:31768:x1830881263171328:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065138.664885:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+29:31768:x1830881263171328:12345-192.168.202.27@tcp:35:cat.0 Request processed in 201us (634us total) trans 8589935740 rc 0/0 00000100:00100000:1.0:1746065138.664891:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4808 00000100:00100000:0.0:1746065138.672999:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.684207:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.684264:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171840 00000100:00100000:1.0:1746065138.684273:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171840 00000100:00100000:1.0:1746065138.684320:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4809 00000100:00100000:1.0:1746065138.684327:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+10:31769:x1830881263171840:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065138.684514:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+11:31769:x1830881263171840:12345-192.168.202.27@tcp:35:cat.0 Request processed in 186us (314us total) trans 8589935741 rc 0/0 00000100:00100000:1.0:1746065138.684521:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4809 00000100:00100000:0.0:1746065138.705982:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.774414:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.780592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.780759:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263172480 00000100:00100000:1.0:1746065138.780833:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263172480 00000100:00100000:1.0:1746065138.780888:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12335 00000100:00100000:1.0:1746065138.780896:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+24:31778:x1830881263172480:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065138.780911:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.780925:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc146d3ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322b2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.780952:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146d33c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93227a expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.780961:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc146d343 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932281 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.780967:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.780968:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.780972:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc146d3ac lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3620864->3633151] (req 3620864->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b2 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.780997:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc146d343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932281 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.781013:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc146d343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932281 expref: 25 pid: 12260 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.781025:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263201920:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.781142:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146d33c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93227a expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.781150:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146d33c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93227a expref: 28 pid: 9548 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.781159:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.781178:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.784419:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263201920:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.784433:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202048:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.784459:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc146d3ac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3620864->3633151] (req 3620864->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b2 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.784474:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927a00, rc 0) 00000100:00100000:1.0:1746065138.784522:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+25:31778:x1830881263172480:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3626us (3936us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.784530:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12335 00000100:00100000:0.0:1746065138.786285:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.786402:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.790075:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.792885:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.793238:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.795022:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.796746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.796924:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263173888 00000100:00100000:1.0:1746065138.796928:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263173888 00000100:00100000:1.0:1746065138.796952:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12336 00000100:00100000:1.0:1746065138.796956:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263173888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065138.796965:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.796989:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322c0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.797033:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202304:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065138.797322:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00002000:00010000:1.0:1746065138.801291:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065138 -> 1746065139 00002000:00010000:1.0:1746065138.801296:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065138 -> 1746065139 00000100:00100000:1.0:1746065138.801312:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202304:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065138.801340:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3c8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322c0 expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.801352:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322c0 expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.801376:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926c00, rc 0) 00000100:00100000:1.0:1746065138.801412:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263173888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4454us (4666us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065138.801420:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12336 00000100:00100000:0.0:1746065138.805281:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174144 00000100:00100000:0.0:1746065138.805289:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174144 00000100:00100000:0.0:1746065138.805338:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13457 00000100:00100000:0.0:1746065138.805345:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+14:31784:x1830881263174144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065138.805363:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.805377:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146d3cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322c7 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.805455:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146d3d6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065138.805467:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146d3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065138.805475:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146d3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:0.0:1746065138.805483:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065138.805555:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146d3cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322c7 expref: 17 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.805584:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146d3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322c7 expref: 16 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.805591:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065138.805593:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065138.805595:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2e00, rc 0) 00000100:00100000:0.0:1746065138.805631:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+16:31784:x1830881263174144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 286us (437us total) trans 8589935746 rc 0/0 00000100:00100000:0.0:1746065138.805637:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13457 00000100:00100000:0.0:1746065138.810704:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.810752:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174272 00000100:00100000:1.0:1746065138.810761:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174272 00000100:00100000:1.0:1746065138.810816:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12337 00000100:00100000:1.0:1746065138.810823:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263174272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065138.810838:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.810851:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc146d3e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322ce expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.810892:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202432:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065138.810966:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.813884:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.816392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.816498:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.816654:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.816685:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174784 00000100:00100000:0.0:1746065138.816692:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174784 00002000:00100000:0.0:1746065138.816723:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097c30a80 x1830881263174784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.816731:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c30a80 with x1830881263174784 ext(1048576->2097151) 00002000:00010000:0.0:1746065138.816735:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c30a80 00000100:00100000:0.0:1746065138.817119:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263175040 00000100:00100000:0.0:1746065138.817122:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263175040 00002000:00100000:0.0:1746065138.817134:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009c5f3100 x1830881263175040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.817140:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3100 with x1830881263175040 ext(1048576->2097151) 00002000:00010000:0.0:1746065138.817143:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3100 00000100:00100000:1.0:1746065138.817210:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202432:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065138.817236:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc146d3e4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ce expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.817248:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc146d3e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ce expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.817265:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926800, rc 0) 00000100:00100000:1.0:1746065138.817299:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263174272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6476us (6602us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065138.817306:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12337 00000100:00100000:0.0:1746065138.835424:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.836740:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.838815:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.838834:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.852032:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.852115:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176448 00000100:00100000:1.0:1746065138.852123:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176448 00000100:00100000:1.0:1746065138.853321:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12338 00000100:00100000:1.0:1746065138.853332:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:31781:x1830881263176448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065138.853350:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.853366:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc146d3eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322d5 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.853388:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.853390:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065138.853396:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc146d3eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322d5 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.853414:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc146d3eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322d5 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.853422:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926e00, rc 0) 00000100:00100000:1.0:1746065138.854425:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:31781:x1830881263176448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1092us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.854432:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12338 00000100:00100000:0.0:1746065138.861195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.869768:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.869821:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176832 00000100:00100000:1.0:1746065138.869829:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176832 00000100:00100000:1.0:1746065138.869872:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12339 00000100:00100000:1.0:1746065138.869883:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+24:31784:x1830881263176832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065138.869898:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.869912:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322dc expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.869935:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc146d3ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3620864->18446744073709551615] (req 3620864->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b2 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.869941:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.869943:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065138.869946:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3f2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322dc expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.869970:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc146d3ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3620864->18446744073709551615] (req 3620864->3633151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b2 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.869986:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d927a00/0xad6b7ddc146d3ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3620864->18446744073709551615] (req 3620864->3633151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b2 expref: 25 pid: 12260 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.869997:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202560:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.870163:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.872453:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.872578:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202560:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.872598:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3f2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322dc expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.872616:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926c00, rc 0) 00000100:00100000:1.0:1746065138.872645:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+26:31784:x1830881263176832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2763us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.872651:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12339 00000100:00100000:0.0:1746065138.875719:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.875795:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.876619:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177088 00000100:00100000:1.0:1746065138.876627:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177088 00000100:00100000:1.0:1746065138.876807:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177216 00000100:00100000:1.0:1746065138.876811:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177216 00000100:00100000:1.0:1746065138.876830:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12340 00000100:00100000:1.0:1746065138.876836:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:31776:x1830881263177088:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065138.876850:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.876863:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc146d3f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322e3 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.876886:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552f000/0xad6b7ddc146d319 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932250 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.876895:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc146d3eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322d5 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.876901:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065138.876903:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065138.876906:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc146d3f9 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2396160->3145727] (req 2396160->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322e3 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.876930:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc146d3eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322d5 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.876939:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc146d3eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322d5 expref: 31 pid: 12260 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.876949:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202688:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065138.877011:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552f000/0xad6b7ddc146d319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932250 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065138.877018:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552f000/0xad6b7ddc146d319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932250 expref: 26 pid: 9550 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.877025:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202816:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065138.877051:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065138.877143:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12341 00000100:00100000:0.0:1746065138.877151:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:31781:x1830881263177216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065138.877160:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.877166:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d400 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322ea expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.877176:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065138.877179:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d400 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ea expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.877187:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d400 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ea expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.877195:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72400, rc 0) 00000100:00100000:0.0:1746065138.877211:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:31781:x1830881263177216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 63us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.877217:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12341 00000100:00100000:0.0:1746065138.877931:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.879711:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202688:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065138.879720:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263202816:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065138.879739:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc146d3f9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2396160->3145727] (req 2396160->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322e3 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.879749:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926200, rc 0) 00000100:00100000:0.0:1746065138.879986:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:31776:x1830881263177088:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3148us (4266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065138.879993:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12340 00000100:00100000:0.0:1746065138.880389:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.880417:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.882686:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.886495:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.886759:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.886850:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.897381:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.901297:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.901344:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.901457:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263179008 00000100:00100000:1.0:1746065138.901463:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263179008 00010000:00010000:1.0:1746065138.901487:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc146d335 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932273 expref: 11 pid: 12260 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.901678:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5459 00000100:00100000:1.0:1746065138.901685:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263179136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.901692:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.901700:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9600/0xad6b7ddc146d320 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93225e expref: 37 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.901709:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a9600/0xad6b7ddc146d320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93225e expref: 37 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.901720:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9600/0xad6b7ddc146d320 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93225e expref: 37 pid: 12260 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.901732:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.901748:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263179136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.901753:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5459 00000100:00100000:1.0:1746065138.901919:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.901949:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.902008:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12344 00000100:00100000:0.0:1746065138.902200:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263179264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065138.902209:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065138.902216:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc146d415 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9322ff expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065138.902227:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065138.902232:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc146d415 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ff expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.902239:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc146d415 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ff expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065138.902250:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73600, rc 0) 00000100:00100000:0.0:1746065138.902477:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263179264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 462us (526us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065138.902486:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12344 00000100:00100000:0.0:1746065138.903097:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.903123:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.903148:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.903159:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263179520 00000100:00100000:1.0:1746065138.903162:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263179520 00010000:00010000:1.0:1746065138.903174:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc146d351 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93228f expref: 10 pid: 9548 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746065138.903598:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5460 00000100:00100000:1.0:1746065138.903606:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263179520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065138.903613:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065138.903623:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc146d351 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93228f expref: 10 pid: 9548 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.903631:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc146d351 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93228f expref: 10 pid: 9548 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.903643:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc146d351 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93228f expref: 10 pid: 9548 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746065138.903651:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065138.903681:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263179520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065138.903686:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5460 00000100:00100000:0.0:1746065138.908590:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263180032 00000100:00100000:0.0:1746065138.908598:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263180032 00002000:00100000:0.0:1746065138.908634:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4816895) req@ffff88009adf4380 x1830881263180032/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:54/0 lens 488/0 e 0 to 0 dl 1746065149 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065138.908643:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4380 with x1830881263180032 ext(4194304->4816895) 00002000:00010000:0.0:1746065138.908647:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf4380 00000100:00100000:0.0:1746065138.908662:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3321 00000100:00100000:0.0:1746065138.908669:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+25:2006:x1830881263180032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065138.911143:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.913809:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.916825:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.917486:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.917614:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.921984:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.925402:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.925436:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065138.925507:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065138.925722:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12352 00000100:00100000:1.0:1746065138.925730:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263181568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065138.925737:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065138.925745:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47e00/0xad6b7ddc146d44d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932337 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065138.925800:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204096:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065138.925834:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065138.926809:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204096:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065138.926828:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d47e00/0xad6b7ddc146d44d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932337 expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.926838:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47e00/0xad6b7ddc146d44d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932337 expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065138.926857:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47e00, rc 0) 00000100:00100000:1.0:1746065138.926876:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263181568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1149us (1370us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065138.926882:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12352 00000100:00100000:0.0:1746065139.023328:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065139.023674:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065139.026352:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.026596:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065139.026837:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065139.037881:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.043303:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.046267:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.046411:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.048211:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.048654:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263183104 00000100:00100000:1.0:1746065139.048659:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263183104 00000100:00100000:1.0:1746065139.048712:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12353 00000100:00100000:1.0:1746065139.048719:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:31792:x1830881263183104:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065139.048730:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.048743:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932353 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.048764:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146d1de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321af expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.048790:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc146d2c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93220a expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.048797:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc146d2be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932203 expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.048802:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.048804:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.048807:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1490944->1708031] (req 1490944->1708031) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932353 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.048832:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc146d2be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932203 expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.048842:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc146d2be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932203 expref: 36 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.048851:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204480:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.048940:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc146d2c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93220a expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.048949:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc146d2c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93220a expref: 8 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.048956:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204608:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.048984:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146d1de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321af expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.048991:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146d1de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321af expref: 11 pid: 13375 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746065139.048998:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204736:192.168.202.27@tcp:104: 00000100:00080000:0.0:1746065139.049129:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065139.049577:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065139.050018:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065139.050261:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.053454:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.053496:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204480:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.053510:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204736:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.053521:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204608:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.053557:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1490944->1708031] (req 1490944->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932353 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.053572:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47200, rc 0) 00000100:00100000:1.0:1746065139.053641:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+36:31792:x1830881263183104:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4922us (5433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.053649:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12353 00000100:00080000:0.0:1746065139.053743:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065139.055372:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.055413:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.055454:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.055933:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263183616 00000100:00100000:1.0:1746065139.055936:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263183616 00000100:00100000:1.0:1746065139.055965:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12355 00000100:00100000:1.0:1746065139.055971:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:31795:x1830881263183616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.055983:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.055993:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a174c00/0xad6b7ddc146d4bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932361 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.056013:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.056018:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [1490944->1708031] (req 1490944->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932353 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.056023:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.056031:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a174c00/0xad6b7ddc146d4bd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932361 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.056077:0:13375:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [1490944->1708031] (req 1490944->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932353 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.056088:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a174c00/0xad6b7ddc146d4bd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932361 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746065139.056093:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746065139.056095:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.056096:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.056101:0:13375:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1490944->1708031) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932353 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.056107:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1490944->1708031) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932353 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.056129:0:13375:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1490944->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932353 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.056139:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1490944->1708031) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932353 expref: 36 pid: 13375 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.056149:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204992:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065139.056331:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.057926:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263204992:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065139.057939:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174c00, rc 0) 00000100:00100000:1.0:1746065139.057978:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+36:31795:x1830881263183616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2006us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.057985:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12355 00000100:00100000:0.0:1746065139.058434:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.062655:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.066885:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.066938:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.066996:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263184768 00000100:00100000:1.0:1746065139.067000:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263184768 00000100:00100000:1.0:1746065139.067241:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4813 00000100:00100000:1.0:1746065139.067248:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+37:31792:x1830881263184768:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065139.067581:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+38:31792:x1830881263184768:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 331us (640us total) trans 8589935752 rc 0/0 00000100:00100000:1.0:1746065139.067587:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4813 00000100:00100000:0.0:1746065139.075422:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.082268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.084639:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065139.085572:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065139.092789:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.096403:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.096441:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.096463:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263185536 00000100:00100000:1.0:1746065139.096469:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263185536 00000100:00100000:0.0:1746065139.096472:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.096495:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263185664 00000100:00100000:1.0:1746065139.096497:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263185664 00000100:00100000:0.0:1746065139.096507:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263185792 00000100:00100000:0.0:1746065139.096509:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263185792 00000100:00100000:1.0:1746065139.096516:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12356 00000100:00100000:1.0:1746065139.096522:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263185536:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065139.096525:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12357 00000100:00100000:0.0:1746065139.096529:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263185664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065139.096536:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.096536:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.096548:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93236f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.096548:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146d4e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932376 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.096564:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.096566:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.096572:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93236f expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.096574:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146d4e0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932376 expref: 16 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.096583:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93236f expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.096587:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146d4e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932376 expref: 16 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.096594:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47200, rc 0) 00010000:00010000:0.0:1746065139.096598:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4200, rc 0) 00000100:00100000:1.0:1746065139.096929:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263185536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 406us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.096929:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263185664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 398us (487us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065139.096935:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12356 00000100:00100000:0.0:1746065139.096937:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12357 00000100:00080000:1.0:1746065139.096950:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065139.108431:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.111593:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.111909:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.115211:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.115395:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263186432 00000100:00100000:1.0:1746065139.115399:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263186432 00010000:00010000:1.0:1746065139.115421:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc146d4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932368 expref: 9 pid: 9571 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.115441:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5469 00000100:00100000:1.0:1746065139.115447:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263186432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.115456:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.115460:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc146d4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932368 expref: 9 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.115467:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc146d4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932368 expref: 9 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.115482:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc146d4d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932368 expref: 9 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.115494:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065139.115498:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc146d503 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065139.115508:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc146d503 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065139.115513:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc146d503 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065139.115526:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.115553:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263186432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.115559:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5469 00010000:00010000:0.0:1746065139.115666:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc146d503 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.115672:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc146d503 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065139.115689:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065139.115766:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47c00/0xad6b7ddc146d4fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93238b expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.115948:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc146d503 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93238b expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.115955:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065139.115957:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065139.115959:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47000, rc 0) 00000100:00100000:0.0:1746065139.115994:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31797:x1830881263186176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4080us (4400us total) trans 8589935753 rc 0/0 00000100:00100000:0.0:1746065139.116000:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13462 00000100:00100000:0.0:1746065139.118334:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.119031:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.121618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.126515:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.126567:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.127457:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.127483:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.127832:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263187456 00000100:00100000:0.0:1746065139.127835:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263187456 00000100:00100000:0.0:1746065139.127857:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263187584 00000100:00100000:0.0:1746065139.127859:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263187584 00000100:00100000:0.0:1746065139.127870:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12360 00000100:00100000:0.0:1746065139.127875:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263187456:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065139.127883:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.127897:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146d51f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932399 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.127912:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.127914:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.127920:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146d51f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932399 expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.127933:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146d51f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932399 expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.127942:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5600, rc 0) 00000100:00100000:0.0:1746065139.127968:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263187456:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 93us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.128140:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12360 00000100:00100000:0.0:1746065139.136770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.141206:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.141640:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263188096 00000100:00100000:1.0:1746065139.141647:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263188096 00000100:00100000:1.0:1746065139.141682:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4814 00000100:00100000:1.0:1746065139.141688:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31797:x1830881263188096:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065139.141844:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31797:x1830881263188096:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 155us (640us total) trans 8589935754 rc 0/0 00000100:00100000:1.0:1746065139.141849:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4814 00000100:00100000:1.0:1746065139.155746:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.155767:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065139.156082:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065139.158919:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.158954:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.159366:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.159956:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189120 00000100:00100000:0.0:1746065139.159960:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189120 00010000:00010000:0.0:1746065139.159974:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d2b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321fc expref: 32 pid: 12258 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065139.160000:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5474 00000100:00100000:0.0:1746065139.160005:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263189120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.160012:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.160019:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d2b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321fc expref: 32 pid: 12258 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.160027:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d2b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321fc expref: 32 pid: 12258 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.160049:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d2b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321fc expref: 32 pid: 12258 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.160061:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.160064:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.160069:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f47a00/0xad6b7ddc146d550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323b5 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.160076:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47a00/0xad6b7ddc146d550 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323b5 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.160098:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f47a00/0xad6b7ddc146d550 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323b5 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.160107:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263206528:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065139.160145:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.160673:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.162115:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.162167:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.162193:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.162240:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.162392:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189504 00000100:00100000:0.0:1746065139.162396:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189504 00000100:00100000:0.0:1746065139.162414:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189376 00000100:00100000:0.0:1746065139.162416:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189376 00000100:00100000:0.0:1746065139.162424:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189632 00000100:00100000:0.0:1746065139.162426:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189632 00000100:00100000:0.0:1746065139.162436:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12364 00000100:00100000:0.0:1746065139.162441:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263189504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065139.162447:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.162456:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146d56c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9323ca expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.162466:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.162468:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.162474:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146d56c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ca expref: 28 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.162488:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146d56c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ca expref: 28 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.162495:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:0.0:1746065139.162517:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263189504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.162522:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12364 00000100:00100000:0.0:1746065139.162533:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12365 00000100:00100000:0.0:1746065139.162537:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263189376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065139.162542:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.162549:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d573 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9323c3 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.162558:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.162559:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.162563:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d573 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323c3 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.162570:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d573 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323c3 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.162575:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:0.0:1746065139.162586:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263189376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 49us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.162590:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12365 00000100:00100000:0.0:1746065139.162597:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12366 00000100:00100000:0.0:1746065139.162601:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263189632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065139.162605:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.162610:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc146d57a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9323d1 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.162629:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263206784:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065139.162669:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.162691:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263206528:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065139.162701:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.162713:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263189120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2708us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.162719:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5474 00000100:00100000:0.0:1746065139.167733:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.172248:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.172428:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190144 00000100:00100000:1.0:1746065139.172433:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190144 00010000:00010000:1.0:1746065139.172456:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146d4e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93236f expref: 12 pid: 13375 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746065139.173370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.173468:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.174534:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3328 00000100:00100000:0.0:1746065139.174541:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263190528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065139.175439:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190784 00000100:00100000:0.0:1746065139.175444:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190784 00010000:00010000:0.0:1746065139.175461:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a174c00/0xad6b7ddc146d4bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932361 expref: 37 pid: 13375 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065139.175491:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5476 00000100:00100000:0.0:1746065139.175496:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263190784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.175504:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.175515:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a174c00/0xad6b7ddc146d4bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932361 expref: 37 pid: 13375 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.175524:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a174c00/0xad6b7ddc146d4bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932361 expref: 37 pid: 13375 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.175540:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a174c00/0xad6b7ddc146d4bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932361 expref: 37 pid: 13375 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.175551:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.175571:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263190784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.175577:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5476 00000100:00100000:0.0:1746065139.185428:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.185571:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190912 00000100:00100000:1.0:1746065139.185579:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190912 00010000:00010000:1.0:1746065139.185607:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d573 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323c3 expref: 10 pid: 3068 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746065139.185627:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5477 00000100:00100000:1.0:1746065139.185633:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263190912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.185644:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.185660:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d573 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323c3 expref: 10 pid: 3068 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746065139.185670:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d573 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323c3 expref: 10 pid: 3068 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746065139.185689:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d573 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323c3 expref: 10 pid: 3068 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746065139.185811:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.185813:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.185819:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146d581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323d8 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.185826:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146d581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323d8 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.185855:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146d581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323d8 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.185865:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263207296:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065139.185931:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.187012:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.187733:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263207296:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065139.187745:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.187769:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263190912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2136us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.187801:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5477 00000100:00100000:0.0:1746065139.190292:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263191296 00000100:00100000:0.0:1746065139.190297:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263191296 00000100:00100000:0.0:1746065139.190335:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13466 00000100:00100000:0.0:1746065139.190341:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+38:31804:x1830881263191296:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065139.190356:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.190369:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc146d58f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9323e6 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.190425:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190440:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190449:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190460:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190465:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190470:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190542:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146d5a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190549:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190554:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065139.190562:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9007680 00010000:00010000:0.0:1746065139.190621:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190626:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190631:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190635:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190640:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065139.190644:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190649:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190657:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065139.190659:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065139.190662:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190666:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190688:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190703:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190707:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190717:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065139.190719:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190723:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190728:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098c34400) 00010000:00010000:0.0:1746065139.190730:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065139.190732:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190740:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146d59d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.190792:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc146d58f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323e6 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.190801:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146d5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323e6 expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.190807:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065139.190809:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065139.190811:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:0.0:1746065139.190840:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+40:31804:x1830881263191296:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 499us (567us total) trans 8589935757 rc 0/0 00000100:00100000:0.0:1746065139.190846:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13466 00000100:00100000:0.0:1746065139.191461:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.194056:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.194371:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.194469:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263191808 00000100:00100000:0.0:1746065139.194476:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263191808 00000100:00100000:1.0:1746065139.194629:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.194693:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4816 00000100:00100000:0.0:1746065139.194700:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+40:31804:x1830881263191808:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065139.194867:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+41:31804:x1830881263191808:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 167us (817us total) trans 8589935758 rc 0/0 00000100:00100000:0.0:1746065139.194873:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4816 00000100:00100000:0.0:1746065139.201503:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.201591:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192448 00000100:00100000:1.0:1746065139.201599:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192448 00010000:00010000:1.0:1746065139.201624:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146d581 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323d8 expref: 12 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.202067:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5478 00000100:00100000:1.0:1746065139.202074:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263192448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.202085:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.202100:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146d581 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323d8 expref: 12 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.202110:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146d581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323d8 expref: 12 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.202128:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146d581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1642495) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323d8 expref: 12 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.202160:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.202162:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.202167:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146d588 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323df expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.202174:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146d588 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323df expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.202200:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146d588 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323df expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.202210:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263207552:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065139.202281:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.203965:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263207552:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065139.203979:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.204004:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263192448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1930us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.204011:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5478 00000100:00100000:0.0:1746065139.205454:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.222428:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.231258:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.234486:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.241250:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.241343:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193344 00000100:00100000:1.0:1746065139.241351:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193344 00010000:00010000:1.0:1746065139.241378:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc146d407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322f1 expref: 38 pid: 12260 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.241403:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5479 00000100:00100000:1.0:1746065139.241409:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263193344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.241421:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.241436:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc146d407 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322f1 expref: 38 pid: 12260 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.241447:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc146d407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322f1 expref: 38 pid: 12260 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.241464:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc146d407 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322f1 expref: 38 pid: 12260 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.241495:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.241497:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.241503:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc146d5b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ed expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.241510:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc146d5b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ed expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.241536:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc146d5b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ed expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.241546:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263207808:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065139.242010:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.243768:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263207808:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065139.243815:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.243848:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263193344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2437us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.243856:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5479 00000100:00100000:0.0:1746065139.247573:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.268594:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.268633:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.268672:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.268872:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12371 00000100:00100000:1.0:1746065139.268880:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263193984:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.268893:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.268903:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d5c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932402 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.268916:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.268918:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.268925:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d5c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932402 expref: 39 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.268937:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d5c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932402 expref: 39 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.268947:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2e00, rc 0) 00000100:00100000:1.0:1746065139.269161:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263193984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 281us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.269166:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12371 00000100:00100000:0.0:1746065139.272995:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.275008:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.281013:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.281155:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194368 00000100:00100000:1.0:1746065139.281163:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194368 00010000:00010000:1.0:1746065139.281199:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47a00/0xad6b7ddc146d550 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323b5 expref: 28 pid: 9550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.281230:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5480 00000100:00100000:1.0:1746065139.281236:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263194368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.281250:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.281264:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f47a00/0xad6b7ddc146d550 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 712704->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323b5 expref: 28 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.281274:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f47a00/0xad6b7ddc146d550 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 712704->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323b5 expref: 28 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.281290:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f47a00/0xad6b7ddc146d550 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 712704->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323b5 expref: 28 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.281310:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.281312:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.281318:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d5ce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932409 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.281324:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d5ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932409 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.281350:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d5ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932409 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.281360:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263208192:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065139.281430:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.283013:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263208192:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065139.283029:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.283065:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263194368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1828us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.283077:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5480 00000100:00100000:0.0:1746065139.286990:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.287028:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.287249:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3333 00000100:00100000:1.0:1746065139.287258:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263194880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065139.297016:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263194880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9753us (9979us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065139.297026:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3333 00002000:00100000:1.0:1746065139.297171:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880099cc0e00 x1830881263194880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/440 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065139.297180:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0e00 with x1830881263194880 ext(1048576->2097151) 00002000:00010000:1.0:1746065139.297184:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc0e00 00000100:00100000:0.0:1746065139.307280:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.307373:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195136 00000100:00100000:1.0:1746065139.307385:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195136 00002000:00100000:1.0:1746065139.307425:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099cc1180 x1830881263195136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065139.307435:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1180 with x1830881263195136 ext(2097152->4194303) 00002000:00010000:1.0:1746065139.307503:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc1180 00000100:00100000:1.0:1746065139.307533:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3334 00000100:00100000:1.0:1746065139.307541:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263195136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065139.318230:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263195136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10682us (10950us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065139.318239:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3334 00002000:00100000:1.0:1746065139.318248:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099cc1180 x1830881263195136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/440 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065139.318263:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1180 with x1830881263195136 ext(2097152->4194303) 00002000:00010000:1.0:1746065139.318269:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc1180 00000100:00100000:0.0:1746065139.411610:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.415411:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.415652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.415688:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.415747:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195648 00000100:00100000:1.0:1746065139.415752:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195648 00010000:00010000:1.0:1746065139.415795:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc146d557 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ae expref: 20 pid: 9571 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.415814:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195776 00000100:00100000:1.0:1746065139.415816:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195776 00010000:00010000:1.0:1746065139.415824:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146d518 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932392 expref: 9 pid: 9571 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.415958:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195520 00000100:00100000:1.0:1746065139.415960:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195520 00010000:00010000:1.0:1746065139.415972:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146d5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323e6 expref: 43 pid: 9571 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065139.416015:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5482 00000100:00100000:0.0:1746065139.416019:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263195776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.416025:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.416039:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146d518 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932392 expref: 9 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.416048:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146d518 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932392 expref: 9 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.416162:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146d518 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932392 expref: 9 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.416180:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065139.416184:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc146d5dc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.416192:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc146d5dc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.416197:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc146d5dc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065139.416223:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.416292:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263195776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 221us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.416298:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5482 00000100:00100000:0.0:1746065139.428307:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.450155:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.450176:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.450210:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.450255:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196416 00000100:00100000:0.0:1746065139.450265:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196416 00010000:00010000:0.0:1746065139.450305:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146d1e5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321bd expref: 15 pid: 3068 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746065139.450328:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196544 00000100:00100000:0.0:1746065139.450330:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196544 00010000:00010000:0.0:1746065139.450336:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25c00/0xad6b7ddc146d2e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932226 expref: 29 pid: 12258 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.450427:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5485 00000100:00100000:0.0:1746065139.450434:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5486 00000100:00100000:1.0:1746065139.450435:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263196288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.450443:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065139.450443:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+29:2007:x1830881263196544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.450451:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.450452:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc146d2da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93221f expref: 32 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.450460:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25c00/0xad6b7ddc146d2e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932226 expref: 29 pid: 12258 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.450462:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc146d2da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93221f expref: 32 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.450473:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc146d2da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93221f expref: 32 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.450487:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.450505:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263196288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 72us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.450511:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5485 00010000:00010000:0.0:1746065139.450527:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25c00/0xad6b7ddc146d2e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932226 expref: 29 pid: 12258 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.450540:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25c00/0xad6b7ddc146d2e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932226 expref: 28 pid: 12258 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.450553:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.450554:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.450560:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146d60d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93241e expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.450566:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146d60d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93241e expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.450590:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146d60d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93241e expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.450600:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263209088:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065139.450660:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.452122:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263209088:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065139.452137:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.452193:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+27:2007:x1830881263196544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1750us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.452210:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5486 00000100:00100000:0.0:1746065139.452881:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.452999:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196800 00000100:00100000:1.0:1746065139.453004:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196800 00002000:00100000:1.0:1746065139.453063:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1376256->1380351) req@ffff880099cc2d80 x1830881263196800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065139.453073:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2d80 with x1830881263196800 ext(1376256->1380351) 00002000:00010000:1.0:1746065139.453093:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc2d80 00000100:00100000:1.0:1746065139.453119:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3335 00000100:00100000:1.0:1746065139.453127:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263196800:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065139.453288:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263196800:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 161us (407us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065139.453303:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3335 00002000:00100000:1.0:1746065139.453309:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1376256->1380351) req@ffff880099cc2d80 x1830881263196800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065139.453324:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2d80 with x1830881263196800 ext(1376256->1380351) 00002000:00010000:1.0:1746065139.453337:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc2d80 00000100:00100000:0.0:1746065139.471904:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.478396:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.481960:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.482445:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.484511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.490630:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.490669:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.539388:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.546041:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.546202:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.546230:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.546293:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198848 00000100:00100000:0.0:1746065139.546296:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.546302:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198848 00000100:00100000:1.0:1746065139.546355:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198976 00000100:00100000:1.0:1746065139.546358:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198976 00000100:00100000:0.0:1746065139.546380:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12377 00000100:00100000:0.0:1746065139.546389:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263198848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065139.546404:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.546418:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc146d645 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93243a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.546457:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263209472:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065139.546506:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.546567:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12378 00000100:00100000:1.0:1746065139.546574:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263198976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.546591:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.546609:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146d64c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932441 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.546718:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263209728:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065139.546798:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.548919:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263209728:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065139.548947:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146d64c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932441 expref: 40 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.548959:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b6600/0xad6b7ddc146d64c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932441 expref: 40 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.548984:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6600, rc 0) 00000100:00100000:1.0:1746065139.549019:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263198976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2446us (2816us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065139.549026:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12378 00000100:00100000:0.0:1746065139.549247:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.553385:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.553517:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263199616 00000100:00100000:1.0:1746065139.553526:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263199616 00000100:00100000:1.0:1746065139.553593:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12379 00000100:00100000:1.0:1746065139.553603:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+31:31814:x1830881263199616:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065139.553624:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.553646:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146d653 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932448 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.553679:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc146d4f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932384 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.553687:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146d56c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ca expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.553695:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146d51f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932399 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.553702:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322dc expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.553711:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d400 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ea expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.553720:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065139.553722:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065139.553726:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146d653 lrc: 8/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->5021695] (req 4194304->5021695) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932448 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.553760:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d400 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ea expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.553806:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d400 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322ea expref: 32 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.553820:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263209856:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.553913:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322dc expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.553921:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d926c00/0xad6b7ddc146d3f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322dc expref: 27 pid: 12260 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.553928:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263209984:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.553949:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146d51f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932399 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.553956:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146d51f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932399 expref: 13 pid: 12258 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746065139.553962:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.553983:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146d56c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ca expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.553989:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146d56c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323ca expref: 27 pid: 3068 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746065139.554000:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210240:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.554019:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc146d4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932384 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.554026:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc146d4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932384 expref: 32 pid: 9550 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.554046:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210368:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.554066:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.555338:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263209856:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.555350:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263209984:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.555357:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210112:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.555689:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210240:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.556003:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210368:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.556049:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146d653 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->5021695] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932448 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.556063:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:1.0:1746065139.556110:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+32:31814:x1830881263199616:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2507us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.556119:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12379 00000100:00100000:0.0:1746065139.558445:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.558546:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263200128 00000100:00100000:1.0:1746065139.558554:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263200128 00000100:00100000:1.0:1746065139.558621:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12380 00000100:00100000:0.0:1746065139.558812:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.559013:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+32:31824:x1830881263200128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.559046:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.559064:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc146d65a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93244f expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.559089:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146d60d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93241e expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.559097:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.559098:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.559101:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc146d65a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93244f expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.559132:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146d60d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1589247) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93241e expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.559143:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146d60d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1589247) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93241e expref: 27 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.559157:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210496:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.559237:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.559494:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263200384 00000100:00100000:0.0:1746065139.559502:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263200384 00010000:00010000:0.0:1746065139.559526:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc146d4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932384 expref: 35 pid: 9550 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065139.559640:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5492 00000100:00100000:0.0:1746065139.559648:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263200384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.559657:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.559863:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc146d4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932384 expref: 35 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.559873:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc146d4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932384 expref: 34 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.559889:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc146d4f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932384 expref: 34 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.559910:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.559931:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263200384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 283us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.559938:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5492 00000100:00100000:1.0:1746065139.560969:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210496:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.560986:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc146d65a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93244f expref: 31 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.561000:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090790600, rc 0) 00000100:00100000:1.0:1746065139.561021:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+31:31824:x1830881263200128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2111us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.561027:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12380 00000100:00100000:0.0:1746065139.561375:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.569970:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.575020:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.594601:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.597704:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.597819:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.599495:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.599563:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263201792 00000100:00100000:0.0:1746065139.599567:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263201792 00002000:00100000:0.0:1746065139.599587:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4116479) req@ffff880091a92300 x1830881263201792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065139.599596:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92300 with x1830881263201792 ext(2097152->4116479) 00002000:00010000:0.0:1746065139.599600:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a92300 00000100:00100000:0.0:1746065139.631694:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.631755:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263201920 00000100:00100000:1.0:1746065139.631762:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263201920 00000100:00100000:1.0:1746065139.631824:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12381 00000100:00100000:1.0:1746065139.631831:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:31827:x1830881263201920:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065139.631845:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.631857:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146d684 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93245d expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.631877:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d5ce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932409 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.631882:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc146d637 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93242c expref: 28 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.631886:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.631887:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.631889:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146d684 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [946176->1048575] (req 946176->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93245d expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.631906:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc146d637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93242c expref: 28 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.631918:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc146d637 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93242c expref: 28 pid: 3068 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746065139.631926:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210880:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.631997:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d5ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932409 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.632002:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146d5ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932409 expref: 30 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.632007:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263211008:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.632018:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.633884:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263210880:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.633894:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263211008:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.633912:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146d684 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [946176->1048575] (req 946176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93245d expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.633925:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9e00, rc 0) 00000100:00100000:1.0:1746065139.633959:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+28:31827:x1830881263201920:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2129us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.633968:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12381 00000100:00100000:0.0:1746065139.634592:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.634647:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.634691:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5495 00000100:00100000:0.0:1746065139.634699:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2006:x1830881263202048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.634709:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.634726:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc146d637 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93242c expref: 28 pid: 3068 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746065139.634744:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc146d637 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93242c expref: 28 pid: 3068 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746065139.634763:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc146d637 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93242c expref: 28 pid: 3068 timeout: 835 lvb_type: 1 00010000:00010000:0.0:1746065139.634846:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.634867:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2006:x1830881263202048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 169us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.634873:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5495 00000100:00100000:0.0:1746065139.637295:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.640436:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.640484:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263202560 00000100:00100000:1.0:1746065139.640491:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263202560 00000100:00100000:1.0:1746065139.640538:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12382 00000100:00100000:1.0:1746065139.640545:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+11:31827:x1830881263202560:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065139.640559:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.640572:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a8200/0xad6b7ddc146d68b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932464 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.640595:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146d588 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323df expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.640603:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc146d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323fb expref: 38 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.640609:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.640610:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.640613:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8200/0xad6b7ddc146d68b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->1433599] (req 1048576->1433599) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932464 expref: 12 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.640636:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc146d5c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323fb expref: 38 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.640645:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc146d5c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323fb expref: 38 pid: 9550 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746065139.640655:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263211264:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.640918:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146d588 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323df expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.640931:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146d588 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9323df expref: 12 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.640939:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263211392:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.641084:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.642301:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263211264:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.642311:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263211392:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065139.642329:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8200/0xad6b7ddc146d68b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->1433599] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932464 expref: 12 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.642342:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8200, rc 0) 00000100:00100000:1.0:1746065139.642379:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+12:31827:x1830881263202560:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1834us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.642385:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12382 00000100:00100000:0.0:1746065139.643589:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.643769:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.648070:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.662508:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263211648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065139.662564:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065139.664252:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263211648 00000100:00100000:1.0:1746065139.664262:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263211648 00000100:00100000:1.0:1746065139.664304:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1746065139.664315:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263211648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746065139.664344:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:1.0:1746065139.664380:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263211648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.664386:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1746065139.664532:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263211648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065139.677729:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ceddf226-8ddf-479f-9953-8a74c62285a9:3760:1830881263211776:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.677803:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065139.678338:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3762:1830881263212032:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.678365:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065139.678402:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3762:1830881263212544:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.678415:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065139.678453:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263212288:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.678472:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065139.678483:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3760:1830881263212800:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.678498:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263211904:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.678609:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065139.678916:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263213056:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.678932:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065139.678984:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3761:1830881263212416:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679004:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065139.679468:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263212160:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679485:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065139.679495:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3759:1830881263212672:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679513:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212288 00000100:00100000:1.0:1746065139.679516:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212288 00000100:00080000:1.0:1746065139.679530:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065139.679549:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213056 00000100:00100000:1.0:1746065139.679551:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213056 00000100:00100000:1.0:1746065139.679562:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212160 00000100:00100000:1.0:1746065139.679564:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212160 00000100:00100000:1.0:1746065139.679579:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1746065139.679583:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263212288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679605:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263212288:12345-0@lo:400:kworker.0 Request processed in 22us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.679610:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1746065139.679619:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1746065139.679622:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263213056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679637:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263213056:12345-0@lo:400:kworker.0 Request processed in 15us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.679641:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1746065139.679648:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1746065139.679652:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263212160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679668:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263212160:12345-0@lo:400:kworker.0 Request processed in 16us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.679668:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263212928:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679672:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00080000:1.0:1746065139.679681:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746065139.679683:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065139.679684:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746065139.679685:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065139.679689:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212928 00000100:00100000:1.0:1746065139.679692:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212928 00000100:00100000:1.0:1746065139.679705:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1746065139.679705:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1746065139.679708:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3761:x1830881263212928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679710:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3762:x1830881263212032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679728:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3761:x1830881263212928:12345-0@lo:400:kworker.0 Request processed in 19us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.679728:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3762:x1830881263212032:12345-0@lo:400:kworker.0 Request processed in 19us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.679732:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1746065139.679732:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00080000:1.0:1746065139.679740:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746065139.679741:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065139.679743:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1746065139.679747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065139.679747:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3761:x1830881263212416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679757:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3759:1830881263213184:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679763:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3761:x1830881263212416:12345-0@lo:400:kworker.0 Request processed in 16us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.679767:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1746065139.679770:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065139.679790:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1746065139.679795:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3759:x1830881263212672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679806:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263212160:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679815:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3759:x1830881263212672:12345-0@lo:400:kworker.0 Request processed in 21us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.679819:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3759:1830881263212672:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679820:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1746065139.679829:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3759:1830881263213184:0@lo:400:kworker.0 00000100:00080000:1.0:1746065139.679839:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065139.679839:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3761:1830881263212416:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679847:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3762:1830881263212544:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679847:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263212928:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679854:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263213056:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679860:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065139.679861:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3762:1830881263212032:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679876:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ceddf226-8ddf-479f-9953-8a74c62285a9:3760:1830881263211776:0@lo:400:kworker.0 00000100:00100000:1.0:1746065139.679900:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263212288:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.679923:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263211904:0@lo:400:kworker.0 00000100:00100000:0.0:1746065139.680042:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3760:1830881263212800:0@lo:400:kworker.0 00000100:00080000:1.0:1746065139.680555:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065139.742107:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.742413:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065139.742425:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263213312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746065139.742460:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065139.742603:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263213312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065139.744594:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.745908:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.747832:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.747962:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263203968 00000100:00100000:1.0:1746065139.747968:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263203968 00000100:00100000:0.0:1746065139.748107:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.748373:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263203840 00000100:00100000:1.0:1746065139.748377:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263203840 00000100:00100000:1.0:1746065139.748397:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12383 00000100:00100000:1.0:1746065139.748403:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263203968:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.748415:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065139.748642:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065139.748671:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146d6bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932479 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.748703:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fabb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263213440:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065139.748743:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00002000:00010000:1.0:1746065139.750759:0:9548:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size: 4813376 -> 5021216 00002000:00010000:1.0:1746065139.750764:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065138 -> 1746065139 00000100:00100000:1.0:1746065139.750798:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fabb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263213440:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065139.750819:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146d6bc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932479 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.750835:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146d6bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932479 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.750846:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9600, rc 0) 00000100:00100000:1.0:1746065139.750873:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263203968:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2470us (3046us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065139.750879:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12383 00000100:00100000:0.0:1746065139.758348:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.758385:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.760209:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.760479:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263204864 00000100:00100000:1.0:1746065139.760485:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263204864 00002000:00100000:1.0:1746065139.760511:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cf3480 x1830881263204864/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065139.760518:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3480 with x1830881263204864 ext(1048576->2097151) 00002000:00010000:1.0:1746065139.760522:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3480 00000100:00100000:1.0:1746065139.760535:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3346 00000100:00100000:1.0:1746065139.760541:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+30:2007:x1830881263204864:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065139.775606:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065139.775625:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263213696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065139.775677:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065139.776097:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+30:2007:x1830881263204352:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17534us (17751us total) trans 0 rc 946176/946176 00000100:00100000:0.0:1746065139.776107:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3344 00002000:00100000:0.0:1746065139.776117:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8a:0x0] (0->946175) req@ffff880099cf1500 x1830881263204352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/440 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065139.776126:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1500 with x1830881263204352 ext(0->946175) 00002000:00010000:0.0:1746065139.776132:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf1500 00000100:00100000:1.0:1746065139.776672:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263213696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065139.778452:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+28:2007:x1830881263204864:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17906us (18241us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065139.778460:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3346 00002000:00100000:1.0:1746065139.778468:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cf3480 x1830881263204864/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/440 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065139.778477:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3480 with x1830881263204864 ext(1048576->2097151) 00002000:00010000:1.0:1746065139.778481:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3480 00000100:00100000:0.0:1746065139.783145:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.790419:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263213824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065139.790479:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065139.790570:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213824 00000100:00100000:0.0:1746065139.790576:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213824 00000100:00100000:0.0:1746065139.790603:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1746065139.790609:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263213824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065139.790624:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 512000 granted 1138641216 pending 5300224 free 3910807552 avail 3679285248 00000100:00100000:0.0:1746065139.790660:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263213824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.790666:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1746065139.791202:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263213824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065139.793987:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205248 00000100:00100000:0.0:1746065139.793995:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205248 00000100:00100000:0.0:1746065139.794127:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205376 00000100:00100000:0.0:1746065139.794131:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205376 00000100:00100000:1.0:1746065139.794182:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12386 00000100:00100000:1.0:1746065139.794190:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+28:2007:x1830881263205248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.794204:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.794218:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146d6ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93248e expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.794257:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263213952:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065139.794318:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.794554:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12387 00000100:00100000:0.0:1746065139.794560:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263205376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065139.794567:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.794575:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc146d6f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932495 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.794596:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263214080:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065139.794619:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.795145:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.798593:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263213952:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065139.798617:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146d6ed lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93248e expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.798627:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146d6ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93248e expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.798636:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9600, rc 0) 00000100:00100000:1.0:1746065139.798670:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+28:2007:x1830881263205248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4482us (4928us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065139.798679:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12386 00000100:00100000:0.0:1746065139.805771:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.811525:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.839575:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.849813:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263214336:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065139.849836:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.849906:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263205888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9574us (10335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.849915:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5499 00000100:00100000:1.0:1746065139.855094:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.855127:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.855149:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.855175:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.855188:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263206400 00000100:00100000:1.0:1746065139.855192:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263206400 00000100:00100000:1.0:1746065139.855222:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12390 00000100:00100000:1.0:1746065139.855227:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263206528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.855244:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.855251:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9c00/0xad6b7ddc146d710 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9324b1 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.855263:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.855264:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.855271:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9c00/0xad6b7ddc146d710 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324b1 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.855284:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9c00/0xad6b7ddc146d710 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324b1 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.855292:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9c00, rc 0) 00000100:00100000:1.0:1746065139.855321:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263206528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 94us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.855328:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12390 00000100:00100000:0.0:1746065139.865699:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.871666:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.873255:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.873916:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.876042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.876261:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207168 00000100:00100000:1.0:1746065139.876265:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207168 00002000:00100000:1.0:1746065139.876288:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (4116480->4194303) req@ffff880099cf2300 x1830881263207168/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065139.876295:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2300 with x1830881263207168 ext(4116480->4194303) 00010000:00010000:1.0:1746065139.876301:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146d63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932433 expref: 38 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.876310:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146d63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932433 expref: 38 pid: 3068 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746065139.876315:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf2300 00000100:00100000:1.0:1746065139.876333:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1198 00000100:00100000:1.0:1746065139.876339:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263207168:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065139.890913:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.890992:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207296 00000100:00100000:1.0:1746065139.890999:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207296 00010000:00010000:1.0:1746065139.891043:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc146d5dc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932410 expref: 42 pid: 9571 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.891081:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5500 00000100:00100000:1.0:1746065139.891089:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263207296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.891101:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.891107:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc146d5dc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932410 expref: 42 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.891116:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc146d5dc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932410 expref: 42 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.891134:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc146d5dc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932410 expref: 42 pid: 9571 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.891150:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065139.891154:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc146d73a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065139.891162:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc146d73a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065139.891168:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc146d73a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065139.891196:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.891228:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263207296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 140us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.891234:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5500 00000100:00100000:0.0:1746065139.904494:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207424 00000100:00100000:0.0:1746065139.904500:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207424 00000100:00100000:1.0:1746065139.904501:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207552 00000100:00100000:1.0:1746065139.904505:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207552 00000100:00100000:1.0:1746065139.904535:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12394 00000100:00100000:0.0:1746065139.904542:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12395 00000100:00100000:0.0:1746065139.904548:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263207424:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065139.904551:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263207552:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065139.904560:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065139.904560:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.904571:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146d748 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9324d4 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.904571:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2600/0xad6b7ddc146d741 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9324cd expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.904608:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263215104:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065139.904608:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263215232:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065139.904909:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.904933:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.904950:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.904990:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.905024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.905047:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207680 00000100:00100000:1.0:1746065139.905053:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207680 00000100:00100000:1.0:1746065139.905069:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207936 00000100:00100000:1.0:1746065139.905070:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207936 00000100:00100000:1.0:1746065139.905079:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207808 00000100:00100000:1.0:1746065139.905081:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207808 00000100:00100000:1.0:1746065139.905624:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12397 00000100:00100000:1.0:1746065139.905630:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263207936:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065139.905636:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.905641:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146d756 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9324e9 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.905657:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12398 00000100:00100000:1.0:1746065139.905659:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263215360:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065139.905664:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263207808:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065139.905671:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065139.905673:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065139.905677:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146d75d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9324e2 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.905742:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.905743:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.905749:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146d75d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324e2 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.905758:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146d75d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324e2 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065139.905770:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3400, rc 0) 00000100:00100000:0.0:1746065139.905812:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263207808:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 149us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065139.905817:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12398 00000100:00100000:1.0:1746065139.909763:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263215104:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065139.909810:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146d748 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324d4 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.909823:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146d748 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324d4 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.909845:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee600, rc 0) 00000100:00100000:1.0:1746065139.909891:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263207552:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5349us (5440us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065139.909899:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12394 00000100:00100000:0.0:1746065139.910097:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.910113:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.910125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065139.910162:0:3068:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880099cc1c00 x1830881263215360) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146d63e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932433 expref: 39 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.910179:0:3068:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146d63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932433 expref: 39 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.910194:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc146d63e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932433 expref: 39 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065139.910205:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263215360:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065139.910215:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.910217:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.910223:0:3068:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146d71e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324bf expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.910231:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146d71e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324bf expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.910265:0:3068:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146d71e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324bf expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.910276:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263215488:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065139.910712:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 702 00000100:00100000:1.0:1746065139.910719:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263208320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.910726:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.910728:0:9565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc146d63e) 00010000:00010000:1.0:1746065139.910729:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065139.911050:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.911202:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263208320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 482us (1074us total) trans 0 rc 116/116 00000100:00100000:1.0:1746065139.911208:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 702 00000100:00100000:0.0:1746065139.913954:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.922184:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.922410:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.923983:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263208576:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9886us (10028us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065139.923993:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3348 00002000:00100000:0.0:1746065139.924003:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009077d880 x1830881263208576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/440 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065139.924012:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881263208576 ext(0->1048575) 00002000:00010000:0.0:1746065139.924017:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077d880 00000100:00100000:0.0:1746065139.924050:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263208960 00000100:00100000:0.0:1746065139.924055:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263208960 00002000:00100000:0.0:1746065139.924081:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009077c000 x1830881263208960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065139.924088:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c000 with x1830881263208960 ext(2097152->4194303) 00010000:00010000:0.0:1746065139.924095:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146d71e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324bf expref: 13 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.924108:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099cd2600/0xad6b7ddc146d71e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324bf expref: 13 pid: 9550 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746065139.924115:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009077c000 00000100:00100000:1.0:1746065139.924237:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.935269:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.935393:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.936849:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5502 00000100:00100000:1.0:1746065139.936859:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263209600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.936870:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.936876:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc146d73a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324c6 expref: 11 pid: 7231 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.936885:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc146d73a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324c6 expref: 11 pid: 7231 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.936901:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc146d73a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324c6 expref: 11 pid: 7231 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.936929:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065139.936934:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc146d772 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065139.936942:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc146d772 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065139.936948:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc146d772 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065139.936970:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.937003:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263209600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 147us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.937009:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5502 00000100:00100000:0.0:1746065139.939277:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.941426:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.944194:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.946243:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.946441:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263210112 00000100:00100000:1.0:1746065139.946446:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263210112 00010000:00010000:1.0:1746065139.946466:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146d75d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324e2 expref: 15 pid: 3067 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746065139.946490:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5504 00000100:00100000:1.0:1746065139.946496:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263210112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.946504:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.946517:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146d75d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324e2 expref: 15 pid: 3067 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746065139.946525:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146d75d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324e2 expref: 15 pid: 3067 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746065139.946543:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146d75d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324e2 expref: 15 pid: 3067 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746065139.946565:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.946590:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263210112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.946595:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5504 00000100:00100000:0.0:1746065139.955170:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263210496 00000100:00100000:0.0:1746065139.955174:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263210496 00010000:00010000:0.0:1746065139.955189:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc146d6fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93249c expref: 32 pid: 9550 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746065139.955216:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5505 00000100:00100000:0.0:1746065139.955221:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+32:2004:x1830881263210496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065139.955229:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065139.955243:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc146d6fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93249c expref: 32 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.955251:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc146d6fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93249c expref: 32 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.955263:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc146d6fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93249c expref: 31 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746065139.955274:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.955276:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065139.955279:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.955285:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065139.955305:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065139.955313:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263216512:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065139.955350:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.957341:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.957386:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263210752 00000100:00100000:1.0:1746065139.957392:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263210752 00010000:00010000:1.0:1746065139.957412:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8200/0xad6b7ddc146d68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932464 expref: 15 pid: 9548 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.957439:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5506 00000100:00100000:1.0:1746065139.957444:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263210752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.957453:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.957465:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8200/0xad6b7ddc146d68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932464 expref: 15 pid: 9548 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.957474:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a8200/0xad6b7ddc146d68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932464 expref: 15 pid: 9548 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.957489:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8200/0xad6b7ddc146d68b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932464 expref: 15 pid: 9548 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.957505:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.957507:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.957512:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 39 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.957519:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 39 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.957539:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 39 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.957548:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263216640:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065139.957603:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.957770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.960147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.961080:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.961235:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263216640:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065139.961247:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.961267:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263210752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3822us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.961273:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5506 00000100:00100000:0.0:1746065139.961853:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.963470:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.967187:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065139.967951:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc146d7a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93251a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.968600:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146d764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324f0 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.968607:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.968608:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065139.968611:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc146d7a3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93251a expref: 43 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.968634:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146d764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324f0 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.968644:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146d764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324f0 expref: 12 pid: 9550 timeout: 835 lvb_type: 0 00000100:00100000:3.0:1746065139.968653:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263216896:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065139.969232:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.970195:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263216896:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065139.970211:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc146d7a3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93251a expref: 43 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065139.970223:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67800, rc 0) 00000100:00100000:3.0:1746065139.970256:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+43:31838:x1830881263212032:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2333us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.970262:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12403 00000100:00100000:0.0:1746065139.972610:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.972646:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065139.972748:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212544 00000100:00100000:3.0:1746065139.972752:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212544 00002000:00100000:3.0:1746065139.972763:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3928064->4194303) req@ffff880136a79500 x1830881263212544/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065139.972769:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79500 with x1830881263212544 ext(3928064->4194303) 00010000:00010000:3.0:1746065139.972798:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146d764 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324f0 expref: 14 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746065139.972806:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146d764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324f0 expref: 14 pid: 9550 timeout: 835 lvb_type: 0 00002000:00010000:3.0:1746065139.972811:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a79500 00000100:00100000:3.0:1746065139.973075:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1202 00000100:00100000:3.0:1746065139.973080:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263212544:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065139.978972:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.978990:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.979008:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.979020:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.979425:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212672 00000100:00100000:1.0:1746065139.979431:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212672 00000100:00100000:1.0:1746065139.979458:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212800 00000100:00100000:1.0:1746065139.979460:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212800 00000100:00100000:1.0:1746065139.979471:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212928 00000100:00100000:1.0:1746065139.979473:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212928 00000100:00100000:1.0:1746065139.979481:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213056 00000100:00100000:1.0:1746065139.979483:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213056 00000100:00100000:1.0:1746065139.979494:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12404 00000100:00100000:1.0:1746065139.979500:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:31834:x1830881263212672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.979514:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.979525:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146d7aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932521 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.979544:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.979546:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.979549:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146d7aa lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932521 expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.979558:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146d7aa lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932521 expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.979566:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857000, rc 0) 00000100:00100000:1.0:1746065139.979584:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+16:31834:x1830881263212672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 85us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.979589:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12404 00000100:00100000:1.0:1746065139.979600:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12405 00000100:00100000:1.0:1746065139.979604:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263212800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.979610:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.979618:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146d7b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932528 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.979633:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146d7b1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932528 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.979641:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146d7b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932528 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.979656:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856400, rc 0) 00000100:00100000:1.0:1746065139.979670:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263212800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 65us (680us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065139.979680:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12405 00000100:00100000:1.0:1746065139.979689:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12406 00000100:00100000:1.0:1746065139.979694:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263212928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065139.979699:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.979704:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146d7b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93252f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.979732:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263217024:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065139.979789:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065139.979806:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12407 00000100:00100000:1.0:1746065139.979811:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+30:31836:x1830881263213056:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065139.979817:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065139.979822:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932536 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.979835:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f67a00/0xad6b7ddc146d79c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932513 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.979840:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.979841:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065139.979843:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->4743167] (req 4194304->4743167) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 31 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.979858:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f67a00/0xad6b7ddc146d79c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932513 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.979866:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f67a00/0xad6b7ddc146d79c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932513 expref: 31 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.979874:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263217152:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065139.979901:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065139.982344:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263212544:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 9257us (9690us total) trans 17179873333 rc 0/0 00000100:00100000:3.0:1746065139.982353:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1202 00002000:00100000:3.0:1746065139.982361:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3928064->4194303) req@ffff880136a79500 x1830881263212544/t17179873333(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065139.982371:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79500 with x1830881263212544 ext(3928064->4194303) 00010000:00010000:3.0:1746065139.982378:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146d764 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324f0 expref: 16 pid: 9550 timeout: 835 lvb_type: 0 00010000:00010000:3.0:1746065139.982390:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146d764 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324f0 expref: 16 pid: 9550 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065139.982396:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a79500 00002000:00010000:1.0:1746065139.982847:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065139 -> 1746065140 00002000:00010000:1.0:1746065139.982851:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065139 -> 1746065140 00002000:00010000:1.0:1746065139.982853:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065139 -> 1746065140 00000100:00100000:1.0:1746065139.982865:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263217024:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065139.982885:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146d7b8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93252f expref: 42 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.982895:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146d7b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93252f expref: 42 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065139.982904:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857a00, rc 0) 00000100:00100000:1.0:1746065139.982924:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263212928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3230us (3915us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065139.982930:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12406 00000100:00100000:0.0:1746065139.984992:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065139.985104:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.985149:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213184 00000100:00100000:1.0:1746065139.985155:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213184 00010000:00010000:1.0:1746065139.985179:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67a00/0xad6b7ddc146d79c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932513 expref: 31 pid: 3068 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746065139.985427:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5508 00000100:00100000:1.0:1746065139.985435:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+31:2005:x1830881263213184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065139.985445:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065139.985459:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880095f67a00/0xad6b7ddc146d79c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932513 expref: 31 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.985467:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f67a00/0xad6b7ddc146d79c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932513 expref: 31 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.985484:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67a00/0xad6b7ddc146d79c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932513 expref: 31 pid: 3068 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746065139.985495:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.985497:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065139.985502:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.985509:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065139.985532:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065139.985542:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263217280:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065139.987313:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065139.987660:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065139.987822:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263217280:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065139.987834:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065139.987859:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881263213184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2425us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065139.987866:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5508 00000100:00100000:3.0:1746065139.988114:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263217408:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065139.988122:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263217536:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065139.988135:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065139.988148:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263213312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2710us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065139.988154:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5509 00000100:00100000:0.0:1746065139.992557:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065139.992613:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213824 00000100:00100000:3.0:1746065139.992620:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213824 00002000:00100000:3.0:1746065139.992656:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880136a78a80 x1830881263213824/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065139.992666:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78a80 with x1830881263213824 ext(3145728->4194303) 00002000:00010000:3.0:1746065139.992671:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78a80 00000100:00100000:3.0:1746065139.992710:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3353 00000100:00100000:3.0:1746065139.992717:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263213824:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065139.994829:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214080 00000100:00100000:0.0:1746065139.994836:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214080 00002000:00100000:0.0:1746065139.994865:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2449408->2453503) req@ffff880099e11180 x1830881263214080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065139.994873:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11180 with x1830881263214080 ext(2449408->2453503) 00002000:00010000:0.0:1746065139.994877:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e11180 00000100:00100000:0.0:1746065139.994891:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214336 00000100:00100000:0.0:1746065139.994893:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214336 00002000:00100000:0.0:1746065139.994904:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (4739072->4743167) req@ffff88009acec000 x1830881263214336/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065139.994910:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec000 with x1830881263214336 ext(4739072->4743167) 00002000:00010000:0.0:1746065139.994912:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acec000 00000100:00100000:0.0:1746065139.994929:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3354 00000100:00100000:0.0:1746065139.994935:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263214080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065139.995106:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263214080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 170us (370us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065139.995112:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3354 00002000:00100000:0.0:1746065139.995117:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2449408->2453503) req@ffff880099e11180 x1830881263214080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065139.995123:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11180 with x1830881263214080 ext(2449408->2453503) 00002000:00010000:0.0:1746065139.995126:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e11180 00000100:00100000:0.0:1746065139.995139:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3355 00000100:00100000:0.0:1746065139.995143:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+30:2004:x1830881263214336:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065139.995193:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+30:2004:x1830881263214336:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 49us (418us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065139.995198:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3355 00002000:00100000:0.0:1746065139.995203:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (4739072->4743167) req@ffff88009acec000 x1830881263214336/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065139.995219:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec000 with x1830881263214336 ext(4739072->4743167) 00002000:00010000:0.0:1746065139.995221:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acec000 00000100:00100000:1.0:1746065139.996841:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065139.996868:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214464 00000100:00100000:3.0:1746065139.996874:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214464 00002000:00100000:3.0:1746065139.997634:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2555904->3145727) req@ffff880099cc2680 x1830881263214464/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/0 e 0 to 0 dl 1746065150 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065139.997643:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2680 with x1830881263214464 ext(2555904->3145727) 00010000:00010000:3.0:1746065139.997650:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 34 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065139.997663:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 34 pid: 9550 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065139.998286:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cc2680 00000100:00100000:3.0:1746065139.998307:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1203 00000100:00100000:3.0:1746065139.998313:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263214464:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065139.999830:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263213824:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 7109us (7276us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065139.999838:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3353 00002000:00100000:3.0:1746065139.999845:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880136a78a80 x1830881263213824/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:55/0 lens 488/440 e 0 to 0 dl 1746065150 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065139.999853:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78a80 with x1830881263213824 ext(3145728->4194303) 00002000:00010000:3.0:1746065139.999857:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78a80 00000100:00100000:1.0:1746065140.001346:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.002629:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.002658:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214976 00000100:00100000:3.0:1746065140.002663:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214976 00000100:00100000:3.0:1746065140.002685:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4824 00000100:00100000:3.0:1746065140.002691:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+41:31838:x1830881263214976:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065140.002794:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+42:31838:x1830881263214976:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 102us (165us total) trans 8589935774 rc 0/0 00000100:00100000:3.0:1746065140.002799:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4824 00000100:00100000:3.0:1746065140.005346:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.005518:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.005858:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.005961:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.006589:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215488 00000100:00100000:1.0:1746065140.006592:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215488 00000100:00100000:1.0:1746065140.007322:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12411 00000100:00100000:1.0:1746065140.007327:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263215232:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.007333:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.007340:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856000/0xad6b7ddc146d7db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93254b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.007349:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.007351:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.007355:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856000/0xad6b7ddc146d7db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93254b expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.007363:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856000/0xad6b7ddc146d7db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93254b expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.007369:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856000, rc 0) 00000100:00100000:1.0:1746065140.007382:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263215232:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.007387:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12411 00000100:00100000:1.0:1746065140.007395:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12412 00000100:00100000:1.0:1746065140.007398:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263215488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.007402:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.007406:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146d7e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932559 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.007417:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146d7e2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932559 expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.007424:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146d7e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932559 expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.007433:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856800, rc 0) 00000100:00100000:1.0:1746065140.007442:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263215488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 44us (1482us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.007446:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12412 00000100:00100000:3.0:1746065140.007825:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263214464:12345-192.168.202.27@tcp:4:cat.0 Request processed in 9512us (10989us total) trans 21474840771 rc 0/0 00000100:00100000:3.0:1746065140.008090:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1203 00002000:00100000:3.0:1746065140.008097:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2555904->3145727) req@ffff880099cc2680 x1830881263214464/t21474840771(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:55/0 lens 488/448 e 0 to 0 dl 1746065150 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.008105:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2680 with x1830881263214464 ext(2555904->3145727) 00010000:00010000:3.0:1746065140.008111:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 36 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.008121:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 36 pid: 9550 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065140.008127:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cc2680 00000100:00100000:0.0:1746065140.013233:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.013294:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215616 00000100:00100000:3.0:1746065140.013299:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215616 00010000:00010000:3.0:1746065140.013324:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 36 pid: 9550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.013617:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5510 00000100:00100000:3.0:1746065140.013624:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881263215616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.013634:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.013645:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 36 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.013655:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 36 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.013671:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146d787 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2555904->3145727] (req 2555904->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932505 expref: 36 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.013696:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.013698:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.013703:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146d7c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93253d expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.013710:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146d7c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93253d expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.013735:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146d7c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93253d expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.013745:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263217920:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065140.013821:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.015829:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263217920:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065140.015846:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.015878:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263215616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2254us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.015885:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5510 00000100:00100000:0.0:1746065140.020014:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.020052:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.020075:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215872 00000100:00100000:3.0:1746065140.020082:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215872 00000100:00100000:0.0:1746065140.020087:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065140.020123:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4743168->5021695) req@ffff880097f52680 x1830881263215872/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.020132:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52680 with x1830881263215872 ext(4743168->5021695) 00002000:00010000:3.0:1746065140.020136:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f52680 00000100:00100000:3.0:1746065140.020369:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263216256 00000100:00100000:3.0:1746065140.020372:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263216256 00000100:00100000:0.0:1746065140.020380:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3356 00002000:00100000:3.0:1746065140.020384:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097f51f80 x1830881263216256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065140.020388:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+31:2005:x1830881263215872:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:3.0:1746065140.020391:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51f80 with x1830881263216256 ext(2097152->4194303) 00002000:00010000:3.0:1746065140.020393:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f51f80 00000100:00100000:3.0:1746065140.020403:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3357 00000100:00100000:3.0:1746065140.020406:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263216256:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065140.031226:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.031591:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.035731:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263216256:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15321us (15676us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065140.035739:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3357 00002000:00100000:3.0:1746065140.035745:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097f51f80 x1830881263216256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.035753:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51f80 with x1830881263216256 ext(2097152->4194303) 00002000:00010000:3.0:1746065140.035756:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f51f80 00000100:00100000:0.0:1746065140.039953:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.040001:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.040139:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12416 00000100:00100000:1.0:1746065140.040149:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263216896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.040157:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.040168:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc146d7fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932575 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.040186:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc146d7fe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932575 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.040200:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc146d7fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932575 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.040223:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856c00, rc 0) 00000100:00100000:1.0:1746065140.040247:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263216896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 101us (246us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.040253:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12416 00000100:00100000:0.0:1746065140.040994:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.041033:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217024 00000100:00100000:1.0:1746065140.041037:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217024 00000100:00100000:1.0:1746065140.041065:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12417 00000100:00100000:1.0:1746065140.041069:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+41:31841:x1830881263217024:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.041075:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.041081:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93257c expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.041092:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.041093:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.041097:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93257c expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.041109:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93257c expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.041117:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857800, rc 0) 00000100:00100000:1.0:1746065140.041147:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:31841:x1830881263217024:12345-192.168.202.27@tcp:101:cat.0 Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.041153:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12417 00000100:00100000:0.0:1746065140.044279:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.044399:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217280 00000100:00100000:3.0:1746065140.044406:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217280 00002000:00100000:3.0:1746065140.044435:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097f51c00 x1830881263217280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.044443:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51c00 with x1830881263217280 ext(3145728->4194303) 00002000:00010000:3.0:1746065140.044447:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f51c00 00000100:00100000:3.0:1746065140.044470:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3359 00000100:00100000:3.0:1746065140.044475:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263217280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.050876:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263217280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6393us (6593us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.050891:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3359 00002000:00100000:3.0:1746065140.050901:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097f51c00 x1830881263217280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.050909:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51c00 with x1830881263217280 ext(3145728->4194303) 00002000:00010000:3.0:1746065140.050915:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f51c00 00000100:00100000:0.0:1746065140.053784:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.055015:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.055060:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217536 00000100:00100000:1.0:1746065140.055065:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217536 00000100:00100000:1.0:1746065140.055104:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12419 00000100:00100000:1.0:1746065140.055110:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263217536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.055232:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.055247:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc146d813 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93258a expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.055269:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc146d813 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93258a expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.055277:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc146d813 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93258a expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.055296:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856a00, rc 0) 00000100:00100000:1.0:1746065140.055324:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263217536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 214us (310us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.055329:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12419 00000100:00100000:0.0:1746065140.058618:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.060852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.060899:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217792 00000100:00100000:3.0:1746065140.060904:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217792 00002000:00100000:3.0:1746065140.060929:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4743167) req@ffff880097f50380 x1830881263217792/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.060938:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50380 with x1830881263217792 ext(4194304->4743167) 00010000:00010000:3.0:1746065140.060944:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 31 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.060954:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 31 pid: 9548 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065140.060959:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097f50380 00000100:00100000:3.0:1746065140.060979:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1204 00000100:00100000:3.0:1746065140.060983:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+31:2004:x1830881263217792:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065140.064991:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+33:2004:x1830881263217792:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3998us (4131us total) trans 21474840772 rc 0/0 00000100:00100000:3.0:1746065140.065063:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1204 00002000:00100000:3.0:1746065140.065074:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4743167) req@ffff880097f50380 x1830881263217792/t21474840772(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.065088:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50380 with x1830881263217792 ext(4194304->4743167) 00010000:00010000:3.0:1746065140.065096:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 33 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.065108:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 33 pid: 9548 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065140.065114:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097f50380 00000100:00100000:0.0:1746065140.066872:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.066913:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217920 00000100:00100000:3.0:1746065140.066920:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217920 00010000:00010000:3.0:1746065140.066945:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 33 pid: 9548 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.066970:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5511 00000100:00100000:3.0:1746065140.066976:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+33:2005:x1830881263217920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.066986:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.067000:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 33 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.067010:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 33 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.067043:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146d7bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4743167) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932536 expref: 33 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.067075:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.067077:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.067082:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d81a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932591 expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.067089:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d81a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932591 expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.067114:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d81a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932591 expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.067123:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263218560:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065140.067189:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.068403:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263218560:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065140.068417:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.068449:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+32:2005:x1830881263217920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1473us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.068457:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5511 00000100:00100000:0.0:1746065140.070862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.070910:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263218176 00000100:00100000:3.0:1746065140.070917:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263218176 00002000:00100000:3.0:1746065140.070975:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097f50700 x1830881263218176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.070983:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50700 with x1830881263218176 ext(4194304->5021695) 00002000:00010000:3.0:1746065140.070987:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f50700 00000100:00100000:3.0:1746065140.071286:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3360 00000100:00100000:3.0:1746065140.071293:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263218176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.075882:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263218176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 4582us (5019us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065140.075889:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3360 00002000:00100000:3.0:1746065140.075895:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097f50700 x1830881263218176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.075901:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50700 with x1830881263218176 ext(4194304->5021695) 00002000:00010000:3.0:1746065140.075905:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f50700 00000100:00100000:0.0:1746065140.078744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.079803:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263218304 00000100:00100000:3.0:1746065140.079812:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263218304 00000100:00100000:3.0:1746065140.079865:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12421 00000100:00100000:3.0:1746065140.079872:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263218304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.079887:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.079900:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc146d821 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932598 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.079926:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc146d821 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932598 expref: 43 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.079935:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc146d821 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932598 expref: 43 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.079957:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73600, rc 0) 00000100:00100000:3.0:1746065140.080006:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263218304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 134us (1269us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065140.080015:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12421 00000100:00100000:0.0:1746065140.081822:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.081895:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263218432 00000100:00100000:3.0:1746065140.081901:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263218432 00000100:00100000:3.0:1746065140.081934:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12422 00000100:00100000:3.0:1746065140.081940:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263218432:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.081951:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.082040:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc146d828 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93259f expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.082065:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc146d828 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93259f expref: 43 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.082073:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc146d828 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93259f expref: 43 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.082080:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:3.0:1746065140.082120:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263218432:12345-192.168.202.27@tcp:101:cat.0 Request processed in 179us (304us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065140.082125:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12422 00000100:00100000:0.0:1746065140.128851:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.132618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.140702:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.140815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.141438:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263219072 00000100:00100000:3.0:1746065140.141442:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263219072 00000100:00100000:3.0:1746065140.141468:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12423 00000100:00100000:3.0:1746065140.141475:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+32:31849:x1830881263219072:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065140.141488:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.141502:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9325b4 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.141528:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc146d65a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93244f expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.141536:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f66e00/0xad6b7ddc146d74f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324db expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.141541:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de5a00/0xad6b7ddc146d6b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932472 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.141546:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.141548:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.141551:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1466368->1515519] (req 1466368->1515519) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.141573:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de5a00/0xad6b7ddc146d6b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932472 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.141582:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de5a00/0xad6b7ddc146d6b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932472 expref: 33 pid: 3068 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.141592:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263218688:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.141657:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f66e00/0xad6b7ddc146d74f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324db expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.141664:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f66e00/0xad6b7ddc146d74f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324db expref: 13 pid: 12260 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.141676:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263218816:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.141696:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc146d65a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93244f expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.141704:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc146d65a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93244f expref: 35 pid: 9548 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.141711:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263218944:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.141725:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.146821:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263218688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.146833:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263218816:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.146841:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263218944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.146868:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1466368->1515519] (req 1466368->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.146882:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:3.0:1746065140.148608:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+33:31849:x1830881263219072:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7126us (7905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.148617:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12423 00000100:00100000:0.0:1746065140.150142:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.150269:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.150793:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.167795:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.168982:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263219840 00000100:00100000:3.0:1746065140.168990:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263219840 00002000:00100000:3.0:1746065140.169019:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1511424->1515519) req@ffff880097f53b80 x1830881263219840/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.169042:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53b80 with x1830881263219840 ext(1511424->1515519) 00002000:00010000:3.0:1746065140.169047:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53b80 00000100:00100000:3.0:1746065140.169068:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3361 00000100:00100000:3.0:1746065140.169074:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+32:2006:x1830881263219840:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065140.169174:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+32:2006:x1830881263219840:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 99us (1385us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.169179:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3361 00002000:00100000:3.0:1746065140.169184:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1511424->1515519) req@ffff880097f53b80 x1830881263219840/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.169190:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53b80 with x1830881263219840 ext(1511424->1515519) 00002000:00010000:3.0:1746065140.169193:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53b80 00000100:00100000:0.0:1746065140.175358:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.181540:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.181612:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263220352 00000100:00100000:1.0:1746065140.181620:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263220352 00000100:00100000:1.0:1746065140.181671:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13478 00000100:00100000:1.0:1746065140.181679:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+33:31855:x1830881263220352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.181697:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.181712:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146d86e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9325bb expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.181799:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181812:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181821:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181832:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181837:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181842:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181914:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc146d883 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181924:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc146d883 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181929:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc146d883 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065140.181936:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065140.181993:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.181999:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182007:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182012:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182018:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065140.182021:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182035:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182045:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065140.182047:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065140.182050:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182054:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc146d875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182068:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182072:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182076:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182080:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065140.182082:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182090:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182095:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5300) 00010000:00010000:1.0:1746065140.182097:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065140.182099:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182102:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146d87c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.182132:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146d86e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325bb expref: 36 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.182141:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc146d883 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325bb expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.182147:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.182148:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065140.182151:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857c00, rc 0) 00000100:00100000:1.0:1746065140.182186:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+35:31855:x1830881263220352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 507us (652us total) trans 8589935778 rc 0/0 00000100:00100000:1.0:1746065140.182192:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13478 00000100:00100000:0.0:1746065140.186854:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.188645:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.188693:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263220736 00000100:00100000:3.0:1746065140.188698:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263220736 00000100:00100000:3.0:1746065140.188728:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 704 00000100:00100000:3.0:1746065140.188734:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+36:2005:x1830881263220736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.188743:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.188768:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc146d883 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325bb expref: 36 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.188802:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.188805:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.188829:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+35:2005:x1830881263220736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.188834:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 704 00000100:00100000:0.0:1746065140.192843:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.192887:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.192908:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263220864 00000100:00100000:3.0:1746065140.192916:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263220864 00000100:00100000:3.0:1746065140.193073:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12424 00000100:00100000:3.0:1746065140.193081:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+32:2007:x1830881263220864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.193095:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.193109:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146d891 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9325c2 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.193127:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.193128:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.193136:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146d891 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325c2 expref: 33 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.193148:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146d891 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325c2 expref: 33 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.193156:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:3.0:1746065140.193192:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+33:2007:x1830881263220864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 112us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.193198:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12424 00000100:00100000:0.0:1746065140.205618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.205681:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.205744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.205806:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263221376 00000100:00100000:3.0:1746065140.205814:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263221376 00002000:00100000:3.0:1746065140.205850:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88012f1a7100 x1830881263221376/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.205859:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7100 with x1830881263221376 ext(0->1048575) 00002000:00010000:3.0:1746065140.205864:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7100 00000100:00100000:3.0:1746065140.205882:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263221760 00000100:00100000:3.0:1746065140.205884:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263221760 00002000:00100000:3.0:1746065140.205893:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012f1a5f80 x1830881263221760/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 504/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.205899:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5f80 with x1830881263221760 ext(1048576->2097151) 00002000:00010000:3.0:1746065140.205902:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5f80 00000100:00100000:3.0:1746065140.205916:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3362 00000100:00100000:3.0:1746065140.205921:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+34:2006:x1830881263221376:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.218864:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+33:2006:x1830881263221376:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12933us (13247us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.218875:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3362 00002000:00100000:3.0:1746065140.218884:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88012f1a7100 x1830881263221376/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.218893:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7100 with x1830881263221376 ext(0->1048575) 00002000:00010000:3.0:1746065140.218898:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7100 00000100:00100000:0.0:1746065140.235142:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.252534:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.256308:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.256423:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.256682:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222272 00000100:00100000:3.0:1746065140.256688:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222272 00000100:00100000:0.0:1746065140.257289:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.257313:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222400 00000100:00100000:0.0:1746065140.257316:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222400 00002000:00100000:0.0:1746065140.257339:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2453503) req@ffff880097a6ca80 x1830881263222400/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065140.257346:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ca80 with x1830881263222400 ext(2097152->2453503) 00010000:00010000:0.0:1746065140.257351:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc146d7a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93251a expref: 42 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.257365:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc146d7a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93251a expref: 42 pid: 9550 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065140.257371:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6ca80 00000100:00100000:0.0:1746065140.257383:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1205 00000100:00100000:0.0:1746065140.257388:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263222400:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065140.259170:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.259194:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222528 00000100:00100000:0.0:1746065140.259199:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222528 00002000:00100000:0.0:1746065140.259222:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1466368->1515519) req@ffff880097a6d180 x1830881263222528/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065140.259229:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d180 with x1830881263222528 ext(1466368->1515519) 00010000:00010000:0.0:1746065140.259233:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 33 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.259240:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 33 pid: 9548 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065140.259245:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6d180 00000100:00100000:0.0:1746065140.259264:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1206 00000100:00100000:0.0:1746065140.259270:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+33:2005:x1830881263222528:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065140.259301:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263219328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.259316:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146d8a6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d7 expref: 36 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.259326:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130105000, rc 0) 00000100:00100000:3.0:1746065140.259349:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:31851:x1830881263222272:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1957us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.259355:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12427 00000100:00100000:0.0:1746065140.261397:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881263222400:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 4003us (4103us total) trans 17179873334 rc 0/0 00000100:00100000:0.0:1746065140.261406:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1205 00000100:00100000:1.0:1746065140.261410:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+35:2005:x1830881263222528:12345-192.168.202.27@tcp:4:cat.0 Request processed in 2140us (2245us total) trans 21474840773 rc 0/0 00002000:00100000:0.0:1746065140.261414:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2453503) req@ffff880097a6ca80 x1830881263222400/t17179873334(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065140.261416:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1206 00002000:00100000:1.0:1746065140.261419:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1466368->1515519) req@ffff880097a6d180 x1830881263222528/t21474840773(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065140.261422:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ca80 with x1830881263222400 ext(2097152->2453503) 00002000:00100000:1.0:1746065140.261430:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d180 with x1830881263222528 ext(1466368->1515519) 00010000:00010000:0.0:1746065140.261430:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc146d7a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93251a expref: 44 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.261435:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 35 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.261439:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f67800/0xad6b7ddc146d7a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93251a expref: 44 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.261441:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 35 pid: 9548 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746065140.261445:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6ca80 00002000:00010000:1.0:1746065140.261446:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6d180 00000100:00100000:0.0:1746065140.264507:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.264651:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.264982:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5516 00000100:00100000:0.0:1746065140.264988:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+35:2007:x1830881263222784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.264997:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065140.265007:0:7190:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065139 -> 1746065140 00002000:00010000:0.0:1746065140.265009:0:7190:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065139 -> 1746065140 00002000:00010000:0.0:1746065140.265011:0:7190:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065139 -> 1746065140 00010000:00010000:0.0:1746065140.265015:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 35 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.265037:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->1515519) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 35 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.265050:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146d867 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1466368->1515519) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325b4 expref: 35 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.265069:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.265071:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.265077:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146d8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d7 expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.265085:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146d8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d7 expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.265111:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146d8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d7 expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.265122:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263219456:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065140.265173:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.269989:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.270087:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263223040 00000100:00100000:1.0:1746065140.270095:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263223040 00002000:00100000:1.0:1746065140.270131:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (2002944->2007039) req@ffff880097a6dc00 x1830881263223040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.270140:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6dc00 with x1830881263223040 ext(2002944->2007039) 00002000:00010000:1.0:1746065140.270145:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6dc00 00000100:00100000:3.0:1746065140.270150:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263219584:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065140.270161:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3366 00010000:00010000:3.0:1746065140.270166:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.270167:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263223040:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065140.270199:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263222656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5352us (5698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.270205:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5515 00000100:00100000:1.0:1746065140.270258:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263223040:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 90us (277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065140.270263:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3366 00002000:00100000:1.0:1746065140.270661:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (2002944->2007039) req@ffff880097a6dc00 x1830881263223040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.270668:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6dc00 with x1830881263223040 ext(2002944->2007039) 00002000:00010000:1.0:1746065140.270671:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6dc00 00000100:00100000:0.0:1746065140.272217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.272257:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.272736:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3368 00000100:00100000:1.0:1746065140.272744:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+34:2007:x1830881263223552:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065140.274912:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.275052:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263223680 00000100:00100000:3.0:1746065140.275058:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263223680 00000100:00100000:3.0:1746065140.275104:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12428 00000100:00100000:3.0:1746065140.275111:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:31851:x1830881263223680:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065140.275125:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.275139:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146d8ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9325de expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.275162:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d81a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932591 expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.275170:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146d891 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325c2 expref: 35 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.275177:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146d7c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93253d expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.275182:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.275184:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065140.275187:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146d8ad lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->2854911] (req 2097152->2854911) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325de expref: 37 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.275211:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146d7c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93253d expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.275221:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146d7c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93253d expref: 37 pid: 9548 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.275232:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263219712:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.275307:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146d891 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325c2 expref: 35 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.275315:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146d891 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325c2 expref: 35 pid: 9548 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.275322:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263219840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.275351:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d81a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932591 expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.275358:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc146d81a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932591 expref: 37 pid: 9548 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.275364:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263219968:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.275378:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.281647:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263219712:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.281657:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263219840:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.281664:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263219968:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.281690:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146d8ad lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->2854911] (req 2097152->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325de expref: 37 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.281703:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4200, rc 0) 00000100:00100000:3.0:1746065140.281721:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:31851:x1830881263223680:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6611us (6815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.281727:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12428 00000100:00100000:0.0:1746065140.286239:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.286647:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+34:2007:x1830881263223552:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13902us (14387us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065140.286660:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3368 00002000:00100000:1.0:1746065140.286669:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097a6ed80 x1830881263223552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.286677:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ed80 with x1830881263223552 ext(3145728->4194303) 00010000:00010000:1.0:1746065140.286683:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146d891 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325c2 expref: 34 pid: 9548 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746065140.286693:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146d891 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325c2 expref: 34 pid: 9548 timeout: 836 lvb_type: 1 00002000:00010000:1.0:1746065140.286698:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6ed80 00000100:00100000:0.0:1746065140.289508:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.289547:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.289614:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224064 00000100:00100000:3.0:1746065140.289618:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224064 00000100:00100000:3.0:1746065140.289643:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12429 00000100:00100000:3.0:1746065140.289648:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+34:31855:x1830881263224064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.289659:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.289670:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc146d8b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9325e5 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.290018:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.290021:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.290034:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc146d8b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325e5 expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.290199:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc146d8b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325e5 expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.290210:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:3.0:1746065140.290667:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+35:31855:x1830881263224064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 594us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.290674:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12429 00000100:00100000:0.0:1746065140.296548:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.298284:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.298315:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.298659:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12431 00000100:00100000:1.0:1746065140.298665:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+37:2007:x1830881263224448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.298672:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.298679:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857200/0xad6b7ddc146d8c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9325f3 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.298694:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d857200/0xad6b7ddc146d8c2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325f3 expref: 38 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.298701:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857200/0xad6b7ddc146d8c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325f3 expref: 38 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.298724:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:1.0:1746065140.298941:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+37:2007:x1830881263224448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 275us (624us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.298947:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12431 00000100:00100000:3.0:1746065140.301649:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263220224:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065140.301668:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146d8bb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325ec expref: 35 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.301679:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146d8bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325ec expref: 35 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.301692:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:3.0:1746065140.303031:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+34:2007:x1830881263224320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4491us (4733us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065140.303041:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12430 00000100:00100000:1.0:1746065140.308613:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.308699:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.308719:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.308744:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224832 00000100:00100000:1.0:1746065140.308751:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224832 00000100:00100000:1.0:1746065140.308800:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224960 00000100:00100000:1.0:1746065140.308803:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224960 00000100:00100000:1.0:1746065140.308818:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12432 00000100:00100000:1.0:1746065140.308825:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881263224832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.308840:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.308856:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146d8c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932601 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.308880:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146d8c9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932601 expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.308889:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146d8c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932601 expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.308901:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856a00, rc 0) 00000100:00100000:1.0:1746065140.308935:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263224832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 110us (328us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.308944:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12432 00000100:00100000:1.0:1746065140.308958:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12433 00000100:00100000:1.0:1746065140.308963:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881263224960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.308970:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.308978:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932608 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.308988:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.308990:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.308997:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932608 expref: 44 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.309009:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932608 expref: 44 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.309018:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857400, rc 0) 00000100:00100000:1.0:1746065140.309041:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881263224960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 78us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.309045:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12433 00000100:00100000:0.0:1746065140.309327:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224704 00000100:00100000:0.0:1746065140.309331:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224704 00000100:00100000:0.0:1746065140.309356:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13479 00000100:00100000:0.0:1746065140.309360:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+35:31860:x1830881263224704:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065140.309374:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.309384:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc146d8d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9325fa expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.309436:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309444:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309451:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309460:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309466:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309470:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309539:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc146d8ec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309546:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc146d8ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309551:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc146d8ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065140.309557:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065140.309611:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309619:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309624:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309628:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309632:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065140.309635:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309640:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309648:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065140.309650:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065140.309653:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.309657:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146d8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.310650:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.310658:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.310662:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.310666:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065140.310669:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.310673:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.310680:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e3d9600) 00010000:00010000:0.0:1746065140.310683:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065140.310685:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.310689:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d8e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.310720:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc146d8d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325fa expref: 38 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.310730:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc146d8ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325fa expref: 37 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.310735:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065140.310737:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065140.310739:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1200, rc 0) 00000100:00100000:0.0:1746065140.310768:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+37:31860:x1830881263224704:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1407us (2069us total) trans 8589935780 rc 0/0 00000100:00100000:0.0:1746065140.310794:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13479 00000100:00100000:0.0:1746065140.319041:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.319082:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.320510:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263225728 00000100:00100000:3.0:1746065140.320515:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263225728 00000100:00100000:3.0:1746065140.320544:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12434 00000100:00100000:3.0:1746065140.320549:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+17:31860:x1830881263225728:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065140.320559:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.320572:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93260f expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320593:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc146d89f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d0 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320601:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932608 expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.320612:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146d7aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932521 expref: 18 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320618:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93257c expref: 43 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320623:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065140.320625:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065140.320628:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 7/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3510272->3633151] (req 3510272->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320651:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93257c expref: 43 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320661:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93257c expref: 43 pid: 12260 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.320671:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263220352:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.320751:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146d7aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932521 expref: 18 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320759:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146d7aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932521 expref: 18 pid: 3068 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.320771:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263220480:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.320826:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932608 expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.320834:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932608 expref: 43 pid: 12260 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.320841:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263220608:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.320865:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc146d89f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d0 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.320873:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc146d89f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d0 expref: 18 pid: 9550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.320879:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263220736:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.320895:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.321520:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.325800:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263220352:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065140.328314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.328335:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.328512:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263220480:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.328521:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263220608:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.328528:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263220736:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.328556:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3510272->3633151] (req 3510272->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.328571:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d000, rc 0) 00000100:00100000:3.0:1746065140.328610:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+18:31860:x1830881263225728:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8060us (9527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.328618:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12434 00000100:00100000:0.0:1746065140.328743:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.329103:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.329297:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5521 00000100:00100000:1.0:1746065140.329303:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263225984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.329309:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.329315:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932608 expref: 45 pid: 12260 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746065140.329325:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932608 expref: 45 pid: 12260 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746065140.329335:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146d8d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932608 expref: 45 pid: 12260 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746065140.329344:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.329360:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263225984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.329365:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5521 00000100:00100000:1.0:1746065140.329375:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5522 00000100:00100000:1.0:1746065140.329378:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263226112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.329382:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.329387:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93257c expref: 43 pid: 12260 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.329393:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93257c expref: 43 pid: 12260 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.329400:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc146d805 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93257c expref: 43 pid: 12260 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.329406:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.329415:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263226112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.329423:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5522 00000100:00100000:0.0:1746065140.329643:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.329677:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226496 00000100:00100000:3.0:1746065140.329682:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226496 00010000:00010000:3.0:1746065140.329694:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc146d89f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d0 expref: 18 pid: 9550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.329710:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5523 00000100:00100000:3.0:1746065140.329715:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263226496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.329721:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.329729:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc146d89f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d0 expref: 18 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.329737:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc146d89f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d0 expref: 18 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.329747:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130104a00/0xad6b7ddc146d89f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d0 expref: 18 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.329759:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.329761:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.329766:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.329789:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.329812:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.329822:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263220864:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065140.329852:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226368 00000100:00100000:1.0:1746065140.329855:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226368 00000100:00100000:3.0:1746065140.329861:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102900 going to sleep for 11 seconds 00002000:00100000:1.0:1746065140.329881:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2002943) req@ffff880097a6df80 x1830881263226368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.329894:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6df80 with x1830881263226368 ext(1048576->2002943) 00002000:00010000:1.0:1746065140.329975:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6df80 00000100:00100000:1.0:1746065140.329997:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3371 00000100:00100000:1.0:1746065140.330002:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263226368:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065140.330851:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.330920:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.330943:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.331310:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226624 00000100:00100000:3.0:1746065140.331325:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226624 00000100:00100000:3.0:1746065140.331416:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226880 00000100:00100000:3.0:1746065140.331419:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226880 00000100:00100000:3.0:1746065140.331439:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226752 00000100:00100000:3.0:1746065140.331441:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226752 00000100:00100000:3.0:1746065140.331453:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12435 00000100:00100000:3.0:1746065140.331469:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+35:2006:x1830881263226624:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.331490:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.331515:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146d908 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932616 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.331542:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263221120:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065140.332035:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12437 00000100:00100000:1.0:1746065140.332045:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+36:2006:x1830881263226752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.332052:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.332059:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146d90f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93261d expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.332075:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146d90f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93261d expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.332083:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146d90f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93261d expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.332092:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae22600, rc 0) 00000100:00100000:3.0:1746065140.332571:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065140.332725:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+36:2006:x1830881263226752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 680us (1779us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.332747:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12437 00000100:00100000:0.0:1746065140.335409:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.335928:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263220864:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065140.335946:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.335985:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263226496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6269us (6857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.335993:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5523 00000100:00100000:1.0:1746065140.337641:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263226368:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7637us (8537us total) trans 0 rc 954368/954368 00000100:00100000:1.0:1746065140.337647:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3371 00002000:00100000:1.0:1746065140.337652:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2002943) req@ffff880097a6df80 x1830881263226368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.337659:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6df80 with x1830881263226368 ext(1048576->2002943) 00002000:00010000:1.0:1746065140.337662:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6df80 00000100:00100000:0.0:1746065140.337912:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263221120:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065140.338087:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146d908 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932616 expref: 35 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.338098:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146d908 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932616 expref: 35 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.338109:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ac00, rc 0) 00000100:00100000:0.0:1746065140.338131:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+34:2006:x1830881263226624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6663us (7281us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065140.338137:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12435 00000100:00100000:3.0:1746065140.338307:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263220992:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065140.338323:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc146d901 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932624 expref: 18 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.338336:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc146d901 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932624 expref: 18 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.338343:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f400, rc 0) 00000100:00100000:3.0:1746065140.338404:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263226880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6930us (7483us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065140.338409:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12436 00000100:00100000:0.0:1746065140.340728:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.343360:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.343421:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.343437:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227520 00000100:00100000:0.0:1746065140.343441:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227520 00000100:00100000:0.0:1746065140.343466:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227648 00000100:00100000:0.0:1746065140.343467:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227648 00000100:00100000:0.0:1746065140.343476:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12438 00000100:00100000:0.0:1746065140.343482:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+35:2007:x1830881263227520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065140.343496:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.343509:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d916 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93262b expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.343552:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263221248:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065140.343615:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.343635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.343678:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.343734:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227776 00000100:00100000:1.0:1746065140.343738:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227776 00000100:00100000:1.0:1746065140.343755:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227904 00000100:00100000:1.0:1746065140.343757:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227904 00000100:00100000:1.0:1746065140.343768:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12439 00000100:00100000:1.0:1746065140.343798:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+36:2007:x1830881263227648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.343804:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.343810:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc146d91d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932632 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.343827:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc146d91d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932632 expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.343836:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc146d91d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932632 expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.343844:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b800, rc 0) 00000100:00100000:1.0:1746065140.343865:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+36:2007:x1830881263227648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 92us (443us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.343870:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12439 00000100:00100000:1.0:1746065140.343882:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12440 00000100:00100000:1.0:1746065140.343887:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263227776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.343892:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.343897:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1a400/0xad6b7ddc146d924 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932639 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.343909:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a400/0xad6b7ddc146d924 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932639 expref: 36 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.343916:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a400/0xad6b7ddc146d924 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932639 expref: 36 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.343922:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a400, rc 0) 00000100:00100000:1.0:1746065140.343935:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263227776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 48us (300us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.343939:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12440 00000100:00100000:1.0:1746065140.343948:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12441 00000100:00100000:1.0:1746065140.343952:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263227904:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.343958:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.343966:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146d92b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932640 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065140.343987:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263221376:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065140.344018:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.345602:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263221248:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065140.345624:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d916 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93262b expref: 35 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.345635:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0a00/0xad6b7ddc146d916 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93262b expref: 35 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.345644:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0a00, rc 0) 00000100:00100000:0.0:1746065140.345681:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+34:2007:x1830881263227520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2198us (2325us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065140.345688:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12438 00000100:00100000:0.0:1746065140.346010:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263221376:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065140.346036:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146d92b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932640 expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.346045:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146d92b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932640 expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.346057:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a800, rc 0) 00000100:00100000:0.0:1746065140.346085:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263227904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2131us (2406us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065140.346090:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12441 00000100:00100000:0.0:1746065140.346490:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.349085:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.349200:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228416 00000100:00100000:1.0:1746065140.349207:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228416 00002000:00100000:1.0:1746065140.349242:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2854912->3145727) req@ffff880099ec7800 x1830881263228416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.349250:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7800 with x1830881263228416 ext(2854912->3145727) 00002000:00010000:1.0:1746065140.349255:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec7800 00000100:00100000:1.0:1746065140.349281:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3374 00000100:00100000:1.0:1746065140.349287:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881263228416:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065140.352061:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881263228416:12345-192.168.202.27@tcp:3:cat.0 Request processed in 2766us (2973us total) trans 0 rc 290816/290816 00000100:00100000:1.0:1746065140.352069:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3374 00002000:00100000:1.0:1746065140.352079:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2854912->3145727) req@ffff880099ec7800 x1830881263228416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 290816/290816 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.352086:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7800 with x1830881263228416 ext(2854912->3145727) 00002000:00010000:1.0:1746065140.352090:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec7800 00000100:00100000:0.0:1746065140.355017:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.359175:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.360883:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228672 00000100:00100000:1.0:1746065140.360892:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228672 00002000:00100000:1.0:1746065140.360933:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3510272->3633151) req@ffff880099ec4e00 x1830881263228672/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.360942:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4e00 with x1830881263228672 ext(3510272->3633151) 00010000:00010000:1.0:1746065140.360950:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 16 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.360963:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 16 pid: 9548 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065140.360974:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec4e00 00000100:00100000:1.0:1746065140.361009:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1207 00000100:00100000:1.0:1746065140.361015:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263228672:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065140.367920:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263228672:12345-192.168.202.27@tcp:4:cat.0 Request processed in 6895us (8743us total) trans 17179873335 rc 0/0 00000100:00100000:1.0:1746065140.367933:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1207 00002000:00100000:1.0:1746065140.367943:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3510272->3633151) req@ffff880099ec4e00 x1830881263228672/t17179873335(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.367952:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4e00 with x1830881263228672 ext(3510272->3633151) 00010000:00010000:1.0:1746065140.367961:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 18 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.367974:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 18 pid: 9548 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065140.367980:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec4e00 00000100:00100000:0.0:1746065140.371625:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.371716:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228800 00000100:00100000:3.0:1746065140.371725:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228800 00010000:00010000:3.0:1746065140.371755:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 18 pid: 9548 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.371810:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5524 00000100:00100000:3.0:1746065140.371818:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263228800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.371830:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.371848:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 18 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.371859:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 18 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.371877:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146d8fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->3633151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93260f expref: 18 pid: 9548 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.371892:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.371894:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.371900:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d932 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932647 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.371908:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d932 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932647 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.371933:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d932 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932647 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.371943:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263221632:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065140.372433:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.375564:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263221632:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065140.375581:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.375613:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263228800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3796us (3994us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.375624:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5524 00000100:00100000:0.0:1746065140.379445:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.379492:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229056 00000100:00100000:1.0:1746065140.379498:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229056 00002000:00100000:1.0:1746065140.379528:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880099ec4380 x1830881263229056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.379535:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4380 with x1830881263229056 ext(2097152->3145727) 00002000:00010000:1.0:1746065140.379539:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec4380 00000100:00100000:1.0:1746065140.379561:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3375 00000100:00100000:1.0:1746065140.379567:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881263229056:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065140.387564:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881263229056:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7988us (8117us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065140.387573:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3375 00002000:00100000:1.0:1746065140.387582:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880099ec4380 x1830881263229056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.387591:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4380 with x1830881263229056 ext(2097152->3145727) 00002000:00010000:1.0:1746065140.387597:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec4380 00000100:00100000:0.0:1746065140.392844:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.400161:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.400213:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.400238:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229568 00000100:00100000:1.0:1746065140.400245:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229568 00002000:00100000:1.0:1746065140.400287:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88012f09d180 x1830881263229568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.400295:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881263229568 ext(3145728->4194303) 00002000:00010000:1.0:1746065140.400300:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d180 00000100:00100000:1.0:1746065140.400359:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229696 00000100:00100000:1.0:1746065140.400362:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229696 00002000:00100000:1.0:1746065140.400376:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88012f09f480 x1830881263229696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.400383:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f480 with x1830881263229696 ext(3145728->4194303) 00002000:00010000:1.0:1746065140.400386:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09f480 00000100:00100000:1.0:1746065140.400409:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3376 00000100:00100000:1.0:1746065140.400415:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263229568:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.401006:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3377 00000100:00100000:3.0:1746065140.401014:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263229696:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065140.415246:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263229568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14823us (15085us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065140.415261:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3376 00002000:00100000:1.0:1746065140.415270:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88012f09d180 x1830881263229568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.415278:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881263229568 ext(3145728->4194303) 00002000:00010000:1.0:1746065140.415286:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d180 00000100:00100000:3.0:1746065140.415730:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263229696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14716us (15514us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.415736:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3377 00002000:00100000:3.0:1746065140.415742:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88012f09f480 x1830881263229696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.415749:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f480 with x1830881263229696 ext(3145728->4194303) 00002000:00010000:3.0:1746065140.415752:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09f480 00000100:00100000:0.0:1746065140.422913:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.430038:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.430156:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230080 00000100:00100000:3.0:1746065140.430164:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230080 00002000:00100000:3.0:1746065140.430199:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012f09ed80 x1830881263230080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.430208:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ed80 with x1830881263230080 ext(4194304->5021695) 00002000:00010000:3.0:1746065140.430212:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ed80 00000100:00100000:3.0:1746065140.430239:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3378 00000100:00100000:3.0:1746065140.430298:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263230080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.435517:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263230080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5214us (5487us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065140.435528:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3378 00002000:00100000:3.0:1746065140.435538:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012f09ed80 x1830881263230080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.435547:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ed80 with x1830881263230080 ext(4194304->5021695) 00002000:00010000:3.0:1746065140.435553:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ed80 00000100:00100000:0.0:1746065140.442717:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.446955:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.465733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.468729:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.471229:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.471300:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230848 00000100:00100000:3.0:1746065140.471305:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230848 00010000:00010000:3.0:1746065140.471328:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc146d836 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325a6 expref: 45 pid: 7231 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.471432:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5525 00000100:00100000:3.0:1746065140.471439:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881263230848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.471449:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.471454:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc146d836 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325a6 expref: 45 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.471464:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc146d836 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325a6 expref: 45 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.471482:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc146d836 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325a6 expref: 45 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.471610:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.471614:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d96a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.471622:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d96a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.471628:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d96a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.471736:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.471764:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881263230848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 325us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.471770:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5525 00000100:00100000:0.0:1746065140.476085:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.476114:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.476131:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.476150:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.476168:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.476186:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230976 00000100:00100000:0.0:1746065140.476193:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230976 00000100:00100000:0.0:1746065140.476219:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231232 00000100:00100000:0.0:1746065140.476221:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231232 00000100:00100000:0.0:1746065140.476227:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231488 00000100:00100000:0.0:1746065140.476229:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231488 00000100:00100000:0.0:1746065140.476236:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231104 00000100:00100000:0.0:1746065140.476237:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231104 00000100:00100000:0.0:1746065140.476242:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231360 00000100:00100000:0.0:1746065140.476244:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231360 00000100:00100000:0.0:1746065140.476253:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12447 00000100:00100000:0.0:1746065140.476259:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263230976:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065140.476272:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.476285:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc146d971 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932671 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.476302:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.476304:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.476354:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc146d971 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932671 expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.476367:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc146d971 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932671 expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.476375:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857400, rc 0) 00000100:00100000:0.0:1746065140.476409:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263230976:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 150us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.476415:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12447 00000100:00100000:0.0:1746065140.476428:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12448 00000100:00100000:0.0:1746065140.476433:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263231232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065140.476441:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.476447:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146d978 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93267f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.476478:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263221888:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065140.476519:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.476607:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12449 00000100:00100000:0.0:1746065140.476612:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263231488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065140.476618:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.476626:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93268d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.476635:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.476636:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.476640:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.476648:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.476654:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856400, rc 0) 00000100:00100000:0.0:1746065140.476668:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263231488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 56us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.476672:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12449 00000100:00100000:0.0:1746065140.476680:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12450 00000100:00100000:0.0:1746065140.476684:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263231104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065140.476689:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.476693:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932678 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.476700:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.476701:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.476704:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.476711:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.476716:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:0.0:1746065140.476724:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263231104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 39us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.476727:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12450 00000100:00100000:0.0:1746065140.476733:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12451 00000100:00100000:0.0:1746065140.476736:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263231360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065140.476740:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.476743:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146d98d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932686 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.476755:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146d98d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932686 expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.476762:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146d98d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932686 expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.476799:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856200, rc 0) 00000100:00100000:0.0:1746065140.476812:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263231360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 75us (643us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065140.476816:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12451 00000100:00100000:0.0:1746065140.481271:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.485921:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.486943:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231872 00000100:00100000:3.0:1746065140.486951:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231872 00010000:00010000:3.0:1746065140.486980:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d96a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93266a expref: 13 pid: 7231 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.487014:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5526 00000100:00100000:3.0:1746065140.487029:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263231872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.487040:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.487046:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d96a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93266a expref: 13 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.487055:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d96a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93266a expref: 13 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.487075:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d96a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93266a expref: 13 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.487099:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.487103:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.487110:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.487115:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.487130:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.487878:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263231872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 854us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.487885:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5526 00010000:00010000:3.0:1746065140.487924:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.487930:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065140.487944:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065140.488206:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc146d994 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932694 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.488223:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932694 expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.488228:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.488231:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065140.488233:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:3.0:1746065140.488381:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:31866:x1830881263231744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6939us (7114us total) trans 8589935783 rc 0/0 00000100:00100000:3.0:1746065140.488387:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13481 00000100:00100000:0.0:1746065140.490652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.490719:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232000 00000100:00100000:3.0:1746065140.490725:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232000 00000100:00100000:3.0:1746065140.490765:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13482 00000100:00100000:3.0:1746065140.490770:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:31866:x1830881263232000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065140.490820:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.490831:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146d9a9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93269b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.491208:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146d9b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.491221:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932694 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.491228:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146d9b0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.491251:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932694 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.491265:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146d99b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932694 expref: 13 pid: 7231 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.491275:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263222144:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.491347:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.492303:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263222144:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.492317:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146d9b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065140.492519:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.495872:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.497014:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.497315:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232384 00000100:00100000:1.0:1746065140.497319:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232384 00000100:00100000:1.0:1746065140.497343:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12453 00000100:00100000:1.0:1746065140.497348:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263232384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065140.497356:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.497364:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146d9be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326a9 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.497382:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146d9be lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326a9 expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.497390:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146d9be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326a9 expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.497403:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ac00, rc 0) 00000100:00100000:1.0:1746065140.497429:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263232384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 81us (416us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065140.497434:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12453 00000100:00100000:0.0:1746065140.500196:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.501992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.502015:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.502046:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.502235:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.502249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.502269:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233152 00000100:00100000:0.0:1746065140.502272:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233152 00000100:00100000:0.0:1746065140.502290:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12455 00000100:00100000:0.0:1746065140.502295:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263233024:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065140.502314:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502325:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.502337:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146d2d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932218 expref: 16 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502343:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc146d2cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932211 expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502348:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.502350:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.502351:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502367:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc146d2cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932211 expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502374:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc146d2cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932211 expref: 42 pid: 3068 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.502382:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263222528:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065140.502425:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146d2d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932218 expref: 16 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502432:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146d2d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932218 expref: 16 pid: 12258 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.502439:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263222656:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065140.502460:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.502467:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 14 pid: 11461 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746065140.502474:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263222784:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065140.502489:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.502504:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12457 00000100:00100000:0.0:1746065140.502509:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263232896:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065140.502523:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502531:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502537:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 14 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.502542:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856000/0xad6b7ddc146d7db lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93254b expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.502547:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.502548:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.502550:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502566:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856000/0xad6b7ddc146d7db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93254b expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.502573:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d856000/0xad6b7ddc146d7db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93254b expref: 16 pid: 3068 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746065140.502580:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263223296:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065140.502603:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 14 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.502610:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 14 pid: 1880 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746065140.502617:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263223552:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065140.502637:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.502644:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 42 pid: 3068 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.502650:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263223808:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065140.502663:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.502696:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.502949:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233408 00000100:00100000:3.0:1746065140.502953:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233408 00000100:00100000:3.0:1746065140.502978:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12459 00000100:00100000:3.0:1746065140.502983:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263233408:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065140.502997:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.503006:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d932 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932647 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.503012:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 15 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.503017:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.503018:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.503030:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.503050:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 15 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.503056:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 15 pid: 1880 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.503063:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263224064:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.503106:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d932 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932647 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.503113:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146d932 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932647 expref: 42 pid: 12260 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.503120:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263224192:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.503132:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.509125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.509146:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263222912:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.509156:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263223040:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.509163:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263223168:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065140.509166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.509182:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065140.509185:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.509194:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.509299:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263222528:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065140.509308:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263222656:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065140.509315:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263222784:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065140.509329:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.510480:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.510614:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263223296:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065140.510632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.510803:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234048 00000100:00100000:3.0:1746065140.510809:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234048 00000100:00100000:0.0:1746065140.510809:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233536 00000100:00100000:0.0:1746065140.510813:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233536 00000100:00100000:3.0:1746065140.510822:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233792 00000100:00100000:3.0:1746065140.510824:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233792 00010000:00010000:0.0:1746065140.510837:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 16 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:3.0:1746065140.510839:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d939 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93264e expref: 36 pid: 12260 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.510857:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233664 00000100:00100000:0.0:1746065140.510859:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233664 00010000:00010000:0.0:1746065140.510867:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc146d2cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932211 expref: 43 pid: 3068 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.510928:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234304 00000100:00100000:0.0:1746065140.510930:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234304 00000100:00100000:3.0:1746065140.510934:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5528 00010000:00010000:0.0:1746065140.510940:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd600/0xad6b7ddc146d7cd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932544 expref: 35 pid: 9548 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.510942:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263233536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065140.510950:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5529 00010000:00010000:3.0:1746065140.510954:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065140.510955:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263233792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.510962:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.510969:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 16 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.510973:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d939 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93264e expref: 36 pid: 12260 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.510978:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 16 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.510980:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d939 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93264e expref: 36 pid: 12260 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.510996:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146d1d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9321b6 expref: 16 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.510996:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146d939 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93264e expref: 36 pid: 12260 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.511007:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065140.511009:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.511050:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263233792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.511056:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5529 00000100:00100000:0.0:1746065140.511068:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5530 00000100:00100000:0.0:1746065140.511072:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263233664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.511078:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065140.511085:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc146d2cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932211 expref: 43 pid: 3068 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.511091:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc146d2cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932211 expref: 43 pid: 3068 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.511100:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc146d2cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932211 expref: 43 pid: 3068 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.511108:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.511131:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5531 00000100:00100000:1.0:1746065140.511138:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+35:2006:x1830881263234304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.511145:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.511153:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd600/0xad6b7ddc146d7cd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932544 expref: 35 pid: 9548 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746065140.511162:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd600/0xad6b7ddc146d7cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932544 expref: 35 pid: 9548 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746065140.511603:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd600/0xad6b7ddc146d7cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932544 expref: 35 pid: 9548 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746065140.511615:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.511665:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263233536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 724us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.511671:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5528 00000100:00100000:0.0:1746065140.511912:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263233664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 837us (2715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.511918:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5530 00000100:00100000:1.0:1746065140.512012:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+34:2006:x1830881263234304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 874us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.512018:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5531 00010000:00010000:3.0:1746065140.512166:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc146d8b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325e5 expref: 33 pid: 9550 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.512189:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5532 00000100:00100000:3.0:1746065140.512194:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+33:2007:x1830881263234048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.512201:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.512208:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc146d8b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325e5 expref: 33 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.512215:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc146d8b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325e5 expref: 33 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.512231:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc146d8b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325e5 expref: 33 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.512241:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.512257:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+32:2007:x1830881263234048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (3140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.512262:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5532 00000100:00100000:3.0:1746065140.512398:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263223424:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.512406:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263223680:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.512423:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.512561:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.512574:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.512576:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263223552:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065140.512585:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263223808:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065140.512586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.512597:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065140.512599:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.512606:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234176 00000100:00100000:0.0:1746065140.512608:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234176 00000100:00100000:1.0:1746065140.512610:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234688 00000100:00100000:1.0:1746065140.512612:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234688 00010000:00010000:1.0:1746065140.512620:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 15 pid: 1880 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.512620:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146d2d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932218 expref: 17 pid: 12258 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.512631:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234944 00000100:00100000:1.0:1746065140.512642:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234432 00000100:00100000:1.0:1746065140.512644:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234432 00010000:00010000:1.0:1746065140.512652:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856000/0xad6b7ddc146d7db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93254b expref: 18 pid: 3068 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.512660:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5533 00000100:00100000:1.0:1746065140.512663:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5534 00000100:00100000:3.0:1746065140.512665:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263234176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065140.512667:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263234688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.512673:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.512674:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.512680:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146d2d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932218 expref: 18 pid: 12258 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.512680:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 15 pid: 1880 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746065140.512687:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 15 pid: 1880 timeout: 836 lvb_type: 1 00010000:00010000:3.0:1746065140.512688:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146d2d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932218 expref: 18 pid: 12258 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.512698:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146d986 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932678 expref: 15 pid: 1880 timeout: 836 lvb_type: 1 00010000:00010000:3.0:1746065140.512701:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc146d2d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932218 expref: 18 pid: 12258 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.512705:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065140.512708:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.512710:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.512713:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.512719:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065140.512722:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263234688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (147us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065140.512758:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.512787:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263234176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.512793:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5534 00000100:00100000:3.0:1746065140.512796:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5533 00010000:00010000:1.0:1746065140.512812:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.512817:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263224064:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065140.512818:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.512824:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263224192:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065140.512832:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.512834:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.512839:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.512845:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.512851:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065140.512855:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.512860:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.512866:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065140.512869:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.512874:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857600/0xad6b7ddc146d9e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.512887:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.512905:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.512911:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263233024:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10615us (10896us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.512913:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263235200 00000100:00100000:3.0:1746065140.512916:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263235200 00000100:00100000:1.0:1746065140.512918:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12455 00010000:00010000:3.0:1746065140.512925:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 43 pid: 3068 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.512944:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5537 00000100:00100000:3.0:1746065140.512949:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881263235200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.512955:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.512961:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 42 pid: 3068 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.512969:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 42 pid: 3068 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.512979:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc146d779 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324fe expref: 41 pid: 3068 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.512986:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.512987:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.512989:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.512999:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513032:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.513048:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263235200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.513053:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5537 00000100:00100000:3.0:1746065140.513066:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234816 00000100:00100000:3.0:1746065140.513069:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234816 00000100:00100000:0.0:1746065140.513071:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234944 00010000:00010000:0.0:1746065140.513081:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 13 pid: 1880 timeout: 836 lvb_type: 1 00002000:00100000:3.0:1746065140.513082:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (2002944->2097151) req@ffff88008f7ff800 x1830881263234816/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.513089:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881263234816 ext(2002944->2097151) 00010000:00010000:3.0:1746065140.513093:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146d8a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d7 expref: 37 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.513100:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146d8a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d7 expref: 37 pid: 9550 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065140.513106:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7ff800 00000100:00100000:0.0:1746065140.513106:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5538 00000100:00100000:0.0:1746065140.513111:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263234944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065140.513114:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1209 00010000:00010000:0.0:1746065140.513117:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065140.513118:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263234816:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:0.0:1746065140.513122:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 13 pid: 1880 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.513129:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 13 pid: 1880 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.513138:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146d97f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93268d expref: 13 pid: 1880 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.513144:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.513146:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.513147:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.513157:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.513174:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065140.513177:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513184:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.513187:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263234944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.513192:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5538 00010000:00010000:3.0:1746065140.513194:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513199:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513204:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513213:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065140.513216:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513221:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.513226:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065140.513230:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513235:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc146d9fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.513235:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234560 00000100:00100000:0.0:1746065140.513237:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234560 00010000:00010000:0.0:1746065140.513245:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc146d971 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932671 expref: 17 pid: 11461 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746065140.513257:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5539 00000100:00100000:3.0:1746065140.513260:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263233408:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10277us (10564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.513261:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263234560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065140.513265:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12459 00010000:00010000:0.0:1746065140.513266:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065140.513272:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc146d971 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932671 expref: 17 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.513279:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc146d971 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932671 expref: 17 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.513289:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc146d971 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932671 expref: 17 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.513296:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.513308:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.513308:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263234560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.513313:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5539 00000100:00100000:0.0:1746065140.513321:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263235328 00000100:00100000:0.0:1746065140.513323:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263235328 00010000:00010000:0.0:1746065140.513330:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146d717 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324b8 expref: 39 pid: 12258 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.513341:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5540 00000100:00100000:0.0:1746065140.513345:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263235328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.513349:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065140.513355:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146d717 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324b8 expref: 39 pid: 12258 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.513362:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146d717 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324b8 expref: 39 pid: 12258 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.513371:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146d717 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9324b8 expref: 39 pid: 12258 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.513383:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.513384:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.513386:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.513392:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.513400:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.513405:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.513406:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065140.513416:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.513421:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.513421:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881263235328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (113us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065140.513427:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.513431:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065140.513434:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.513439:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.513447:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.513452:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146d9ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065140.513480:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263232896:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10971us (11244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.513485:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12457 00000100:00100000:0.0:1746065140.513494:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5540 00010000:00010000:3.0:1746065140.513542:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513548:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513559:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513568:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513573:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513577:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065140.513579:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513583:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513591:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.513596:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146d9da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.513633:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263232768:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 11356us (11642us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.513638:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12454 00000100:00100000:3.0:1746065140.519552:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263234816:12345-192.168.202.27@tcp:4:cat.0 Request processed in 6424us (6677us total) trans 21474840774 rc 0/0 00000100:00100000:3.0:1746065140.519563:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1209 00002000:00100000:3.0:1746065140.519574:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (2002944->2097151) req@ffff88008f7ff800 x1830881263234816/t21474840774(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.519584:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881263234816 ext(2002944->2097151) 00010000:00010000:3.0:1746065140.519594:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146d8a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d7 expref: 40 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.519848:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146d8a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325d7 expref: 40 pid: 9550 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065140.519856:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7ff800 00000100:00100000:3.0:1746065140.520052:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263233920:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7985us (9573us total) trans 21474840775 rc 0/0 00000100:00100000:3.0:1746065140.520058:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1208 00002000:00100000:3.0:1746065140.520067:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2854911) req@ffff88009c5f3800 x1830881263233920/t21474840775(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.520073:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3800 with x1830881263233920 ext(2097152->2854911) 00010000:00010000:3.0:1746065140.520078:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146d8ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325de expref: 38 pid: 9550 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.520328:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146d8ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9325de expref: 38 pid: 9550 timeout: 836 lvb_type: 0 00002000:00010000:3.0:1746065140.520335:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c5f3800 00000100:00100000:0.0:1746065140.522673:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.524296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065140.524658:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.524666:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.524677:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.524683:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.524688:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.524693:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d358800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065140.524695:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.524702:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.524711:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.524715:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d358800/0xad6b7ddc146d9e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.524756:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263233280:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 22333us (22709us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.524762:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12456 00000100:00100000:0.0:1746065140.527964:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.533618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.533665:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.533761:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236096 00000100:00100000:3.0:1746065140.533768:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236096 00000100:00100000:3.0:1746065140.533820:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4829 00000100:00100000:3.0:1746065140.533826:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+37:31232:x1830881263236096:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065140.533983:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.534031:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.534046:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+39:31232:x1830881263236096:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 219us (484us total) trans 8589935785 rc 0/0 00000100:00100000:3.0:1746065140.534057:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4829 00000100:00100000:3.0:1746065140.534088:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5543 00000100:00100000:3.0:1746065140.534094:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+39:2005:x1830881263236352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065140.534111:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5545 00000100:00100000:3.0:1746065140.534115:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263236224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.534120:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.534125:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146d2fd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932234 expref: 44 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.534139:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146d2fd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932234 expref: 44 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.534161:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146d2fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932234 expref: 44 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.534211:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.534215:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.534221:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.534235:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263236224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 120us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.534242:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5545 00010000:00010000:3.0:1746065140.534256:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.534260:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146d2f6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93223b expref: 37 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.534267:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146d2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93223b expref: 37 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.534276:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc146d2f6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93223b expref: 37 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.534284:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.534287:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.534292:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.534303:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+36:2005:x1830881263236352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 210us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.534308:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5543 00000100:00100000:1.0:1746065140.534477:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.534505:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.534588:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236864 00000100:00100000:3.0:1746065140.534592:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236864 00000100:00100000:3.0:1746065140.534610:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4830 00000100:00100000:3.0:1746065140.534614:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+43:30398:x1830881263236864:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065140.534689:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+44:30398:x1830881263236864:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 73us (212us total) trans 8589935786 rc 0/0 00000100:00100000:3.0:1746065140.534695:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4830 00000100:00100000:1.0:1746065140.535102:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.535311:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236992 00000100:00100000:0.0:1746065140.535314:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236992 00010000:00010000:0.0:1746065140.535396:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc146d47e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932345 expref: 44 pid: 9571 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.535654:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5547 00000100:00100000:0.0:1746065140.535663:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263236992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.535670:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065140.535673:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc146d47e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932345 expref: 44 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.535681:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc146d47e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932345 expref: 44 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.535692:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc146d47e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932345 expref: 44 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.535924:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065140.535927:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065140.535933:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.535962:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263236992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 301us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.535967:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5547 00000100:00100000:1.0:1746065140.537547:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237248 00000100:00100000:1.0:1746065140.537553:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237248 00010000:00010000:1.0:1746065140.537571:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4800/0xad6b7ddc146d3ba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b9 expref: 43 pid: 7204 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065140.537589:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5549 00000100:00100000:1.0:1746065140.537594:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263237248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.537602:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.537606:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4800/0xad6b7ddc146d3ba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b9 expref: 43 pid: 7204 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.537614:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4800/0xad6b7ddc146d3ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b9 expref: 43 pid: 7204 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.537859:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4800/0xad6b7ddc146d3ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9322b9 expref: 43 pid: 7204 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.537885:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.537889:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065140.537896:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065140.537989:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065140.538093:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.538317:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263237248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 720us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.538323:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5549 00000001:00080000:3.0:1746065140.542860:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935787 is committed 00000004:00080000:3.0:1746065140.542869:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 422 committed 00000004:00080000:3.0:1746065140.542908:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 469 committed 00000004:00080000:3.0:1746065140.542919:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 468 committed 00000004:00080000:3.0:1746065140.542921:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 467 committed 00000004:00080000:3.0:1746065140.542923:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 466 committed 00000004:00080000:3.0:1746065140.542925:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 421 committed 00000004:00080000:3.0:1746065140.542927:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 465 committed 00000004:00080000:3.0:1746065140.542928:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 420 committed 00000004:00080000:3.0:1746065140.542930:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 464 committed 00000004:00080000:3.0:1746065140.542931:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 419 committed 00000004:00080000:3.0:1746065140.542933:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 418 committed 00000004:00080000:3.0:1746065140.542934:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 417 committed 00000004:00080000:3.0:1746065140.542935:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 463 committed 00000004:00080000:3.0:1746065140.542937:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 462 committed 00000004:00080000:3.0:1746065140.542938:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 416 committed 00000004:00080000:3.0:1746065140.542939:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 415 committed 00000004:00080000:3.0:1746065140.542941:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 461 committed 00000001:00080000:3.0:1746065140.542945:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935786 is committed 00000001:00080000:3.0:1746065140.542949:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935785 is committed 00000100:00100000:0.0:1746065140.543192:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263225344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.543239:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.543265:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263225856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.543279:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.543301:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746065140.543305:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263225216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.543344:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.543354:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263225728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.543367:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.543403:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263225472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.543471:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263226752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.543882:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263226240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.543916:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.543940:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263225600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.544043:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263225984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.544057:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.544070:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263226496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.544081:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.544088:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263227008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.544100:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065140.544118:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.544126:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.544131:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.544137:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065140.544140:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.544146:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065140.544386:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12462 00000100:00100000:1.0:1746065140.544393:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3760:x1830881263225216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.544457:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3760:x1830881263225216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1112us total) trans 21474840777 rc 0/0 00000100:00100000:1.0:1746065140.544462:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12462 00000100:00100000:1.0:1746065140.544471:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12463 00000100:00100000:1.0:1746065140.544475:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3760:x1830881263225728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065140.544509:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065140.544511:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065140.544512:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065140.544515:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065140.544516:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746065140.544532:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3760:x1830881263225728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1164us total) trans 21474840778 rc 0/0 00000100:00100000:1.0:1746065140.544536:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12463 00000100:00100000:1.0:1746065140.544545:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12464 00000100:00100000:1.0:1746065140.544548:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3761:x1830881263225472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.544610:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3761:x1830881263225472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (692us total) trans 21474840779 rc 0/0 00000100:00100000:1.0:1746065140.544614:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12464 00000100:00100000:1.0:1746065140.544623:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12465 00000100:00100000:0.0:1746065140.544804:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12466 00000100:00100000:0.0:1746065140.544811:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263226496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.544865:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3761:x1830881263226496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (783us total) trans 17179873337 rc 0/0 00000100:00100000:0.0:1746065140.544870:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12466 00000100:00100000:0.0:1746065140.544880:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12467 00000100:00100000:0.0:1746065140.544883:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263227008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.544946:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3761:x1830881263227008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (844us total) trans 17179873338 rc 0/0 00000100:00100000:0.0:1746065140.544951:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12467 00010000:00010000:3.0:1746065140.545336:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.545340:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065140.545343:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065140.545350:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146da04 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000004:00080000:3.0:1746065140.545390:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097243b80/2, rc 0, transno 17179873337 00000100:00100000:3.0:1746065140.545395:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263226496:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065140.545403:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097243100/2, rc 0, transno 17179873338 00000100:00100000:3.0:1746065140.545406:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263227008:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065140.545414:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d04e00/2, rc 0, transno 21474840779 00000100:00100000:3.0:1746065140.545421:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263225472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.545519:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065140.545545:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097241500/2, rc 0, transno 17179873336 00000100:00100000:0.0:1746065140.545548:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263225344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.545557:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263226368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.545573:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.545583:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263226880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.545595:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065140.545607:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06300/2, rc 0, transno 21474840777 00000100:00100000:0.0:1746065140.545609:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263225216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.545615:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06a00/2, rc 0, transno 21474840778 00000100:00100000:0.0:1746065140.545617:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263225728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.545622:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065140.545626:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263227264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.545637:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.545653:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226240 00000100:00100000:0.0:1746065140.545656:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226240 00000100:00100000:0.0:1746065140.545671:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226368 00000100:00100000:0.0:1746065140.545673:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226368 00000100:00100000:0.0:1746065140.545680:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226880 00000100:00100000:0.0:1746065140.545682:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226880 00000100:00100000:0.0:1746065140.545687:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227264 00000100:00100000:0.0:1746065140.545688:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227264 00000100:00100000:0.0:1746065140.545694:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12468 00000100:00100000:0.0:1746065140.545697:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3760:x1830881263226240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.545718:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12469 00000100:00100000:3.0:1746065140.545726:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881263226368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065140.545751:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:0.0:1746065140.545753:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065140.545755:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065140.545756:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065140.545758:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:0.0:1746065140.545792:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3760:x1830881263226240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (272us total) trans 21474840780 rc 0/0 00000100:00100000:0.0:1746065140.545796:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12468 00000100:00100000:3.0:1746065140.545803:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263226368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (228us total) trans 17179873339 rc 0/0 00000100:00100000:0.0:1746065140.545807:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12470 00000100:00100000:3.0:1746065140.545810:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12469 00000100:00100000:0.0:1746065140.545811:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263226880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.545821:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12471 00000100:00100000:3.0:1746065140.545826:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3760:x1830881263227264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.545858:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263226880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (262us total) trans 17179873340 rc 0/0 00000100:00100000:0.0:1746065140.545862:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12470 00000100:00100000:3.0:1746065140.545872:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3760:x1830881263227264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (233us total) trans 21474840781 rc 0/0 00000100:00100000:3.0:1746065140.545877:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12471 00000004:00080000:0.0:1746065140.545881:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fd180/2, rc 0, transno 21474840781 00000100:00100000:0.0:1746065140.545884:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263227264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.545890:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097241c00/2, rc 0, transno 17179873339 00000100:00100000:0.0:1746065140.545892:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263226368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065140.545898:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097243800/2, rc 0, transno 17179873340 00000100:00100000:0.0:1746065140.546265:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263226880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.546267:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3761:x1830881263225984:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.546278:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06d80/2, rc 0, transno 21474840780 00000100:00100000:0.0:1746065140.546281:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263226240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.546287:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d05500/2, rc 0, transno 21474840776 00000100:00100000:0.0:1746065140.546289:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263225856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.546343:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3761:x1830881263225984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1715us (2283us total) trans 21474840782 rc 0/0 00000100:00100000:1.0:1746065140.546349:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12465 00000100:00100000:1.0:1746065140.546797:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.546829:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263226112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.546847:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.546857:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263226624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.546869:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.546878:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263227136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.546892:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065140.546910:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d04000/2, rc 0, transno 21474840783 00000100:00100000:1.0:1746065140.546913:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263225600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.546928:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12473 00000100:00100000:1.0:1746065140.546935:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3762:x1830881263226112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065140.546977:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065140.546979:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065140.546986:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065140.546988:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065140.546990:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:1.0:1746065140.547010:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3762:x1830881263226112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (162us total) trans 21474840784 rc 0/0 00000100:00100000:1.0:1746065140.547017:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12473 00000004:00080000:1.0:1746065140.547048:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d07100/2, rc 0, transno 21474840784 00000100:00100000:1.0:1746065140.547051:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263226112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065140.547058:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097242300/2, rc 0, transno 17179873341 00000100:00100000:1.0:1746065140.547060:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263226624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.547074:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.547091:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226752 00000100:00100000:1.0:1746065140.547093:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226752 00000100:00100000:1.0:1746065140.547107:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12476 00000100:00100000:1.0:1746065140.547111:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881263226752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.547164:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881263226752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (88us total) trans 17179873343 rc 0/0 00000100:00100000:1.0:1746065140.547168:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12476 00000004:00080000:1.0:1746065140.547187:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097242680/2, rc 0, transno 17179873342 00000100:00100000:1.0:1746065140.547191:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263227136:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065140.547200:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097240e00/2, rc 0, transno 17179873343 00000100:00100000:1.0:1746065140.547202:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263226752:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065140.547310:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06680/2, rc 0, transno 21474840782 00000100:00100000:3.0:1746065140.547313:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263225984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.548502:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.553353:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.553433:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237504 00000100:00100000:1.0:1746065140.553442:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237504 00000100:00100000:1.0:1746065140.553512:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13486 00000100:00100000:1.0:1746065140.553521:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31866:x1830881263237504:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065140.553616:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.553631:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146da12 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326be expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.553701:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146da19 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.553716:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146da19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.553724:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146da19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065140.553745:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065140.553748:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065140.553759:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146da19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.553803:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146da12 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326be expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.553826:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146da19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326be expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.553832:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.553834:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065140.553838:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:1.0:1746065140.553878:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31866:x1830881263237504:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 358us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.553884:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13486 00000100:00100000:0.0:1746065140.562992:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.563038:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.563063:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.563086:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237632 00000100:00100000:0.0:1746065140.563093:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237632 00000100:00100000:1.0:1746065140.563111:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237760 00000100:00100000:1.0:1746065140.563116:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237760 00000100:00100000:0.0:1746065140.563138:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237888 00000100:00100000:0.0:1746065140.563141:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237888 00000100:00100000:1.0:1746065140.563529:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12477 00000100:00100000:1.0:1746065140.563537:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263237632:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065140.563554:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.563570:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326c5 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065140.563588:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6f3, atime: 0x6812d6f4, ctime: 0x6812d6f3, blocks: 0x7f8 00010000:00010000:1.0:1746065140.563604:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.563606:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.563613:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.563626:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.563634:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488a00, rc 0) 00000100:00100000:0.0:1746065140.564290:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12478 00000100:00100000:0.0:1746065140.564298:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263237760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065140.564306:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.564317:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146da27 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326cc expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065140.564330:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6f3, atime: 0x6812d6f4, ctime: 0x6812d6f3, blocks: 0x808 00010000:00010000:0.0:1746065140.564338:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.564339:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.564344:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146da27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326cc expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.564353:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146da27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326cc expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.564364:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2200, rc 0) 00000100:00100000:3.0:1746065140.564689:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12479 00000100:00100000:3.0:1746065140.564696:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263237888:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065140.564704:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.564713:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc146da2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326d3 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065140.564724:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6f2, atime: 0x6812d6f2, ctime: 0x6812d6f2, blocks: 0x800 00010000:00010000:3.0:1746065140.564732:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.564733:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.564737:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc146da2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326d3 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.564746:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc146da2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326d3 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.564752:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ba00, rc 0) 00000100:00100000:1.0:1746065140.565945:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263237632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2402us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.565953:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12477 00000100:00100000:3.0:1746065140.566564:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263237888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1866us (3498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.566564:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263237760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2265us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.566571:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12478 00000100:00100000:3.0:1746065140.566574:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12479 00000100:00100000:1.0:1746065140.566595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.566610:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238016 00000100:00100000:3.0:1746065140.566616:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238016 00000100:00100000:3.0:1746065140.566649:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12480 00000100:00100000:3.0:1746065140.566654:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263238016:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065140.566665:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.566679:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326da expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065140.566696:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6f4, atime: 0x6812d6f4, ctime: 0x6812d6f4, blocks: 0x808 00010000:00010000:3.0:1746065140.566709:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.566711:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.566717:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.566728:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.566736:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b600, rc 0) 00000100:00100000:3.0:1746065140.566762:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263238016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 108us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.566767:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12480 00000100:00100000:1.0:1746065140.568920:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.568962:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.570183:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238144 00000100:00100000:3.0:1746065140.570191:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238144 00000100:00100000:3.0:1746065140.570221:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238272 00000100:00100000:3.0:1746065140.570222:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238272 00000100:00100000:3.0:1746065140.570238:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12481 00000100:00100000:3.0:1746065140.570244:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263238144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065140.570259:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.570275:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326e1 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065140.570294:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d6f4, atime: 0x6812d6f4, ctime: 0x6812d6f4, blocks: 0x1650 00010000:00010000:3.0:1746065140.570308:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.570310:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.570318:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 16 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.570330:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 16 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.570338:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a400, rc 0) 00000100:00100000:1.0:1746065140.570702:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12482 00000100:00100000:1.0:1746065140.570710:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263238272:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065140.570718:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.570728:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146da43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326e8 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065140.570741:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d6f4, atime: 0x6812d6f4, ctime: 0x6812d6f4, blocks: 0x1000 00010000:00010000:1.0:1746065140.570750:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.570751:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065140.570755:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146da43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e8 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.570763:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146da43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e8 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065140.570769:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:3.0:1746065140.571319:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263238144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1072us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.571325:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12481 00000100:00100000:1.0:1746065140.571379:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263238272:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 669us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.571383:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12482 00000100:00100000:0.0:1746065140.574285:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.574319:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.574343:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.574361:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238528 00000100:00100000:0.0:1746065140.574361:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238400 00000100:00100000:1.0:1746065140.574367:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238528 00000100:00100000:0.0:1746065140.574367:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238400 00000100:00100000:0.0:1746065140.574396:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238656 00000100:00100000:0.0:1746065140.574398:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238656 00000100:00100000:1.0:1746065140.574402:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12483 00000100:00100000:1.0:1746065140.574408:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263238400:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065140.574422:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12484 00000100:00100000:0.0:1746065140.574426:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263238528:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065140.574505:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263238528:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.574511:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12484 00000100:00100000:0.0:1746065140.574562:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.574573:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238784 00000100:00100000:0.0:1746065140.574575:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238784 00000100:00100000:0.0:1746065140.574588:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12486 00000100:00100000:0.0:1746065140.574592:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263238784:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065140.574625:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263238784:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 31us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.574629:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12486 00000100:00100000:1.0:1746065140.574642:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263238400:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 234us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.574647:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12483 00000100:00100000:1.0:1746065140.574825:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.575210:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.575264:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238912 00000100:00100000:0.0:1746065140.575268:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238912 00000100:00100000:0.0:1746065140.575282:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239040 00000100:00100000:0.0:1746065140.575283:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239040 00000100:00100000:0.0:1746065140.575295:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12488 00000100:00100000:0.0:1746065140.575298:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263239040:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065140.575332:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263239040:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 32us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.575337:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12488 00000100:00100000:0.0:1746065140.577209:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.577314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.577339:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.577361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.577372:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239424 00000100:00100000:0.0:1746065140.577374:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239424 00000100:00100000:0.0:1746065140.577388:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239296 00000100:00100000:0.0:1746065140.577389:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239296 00000100:00100000:0.0:1746065140.577537:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12490 00000100:00100000:0.0:1746065140.577541:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263239424:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065140.577609:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12491 00000100:00100000:1.0:1746065140.577613:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12492 00000100:00100000:3.0:1746065140.577615:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263239680:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065140.577618:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263239296:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065140.577668:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263239424:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 125us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.577674:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12490 00000100:00100000:3.0:1746065140.577744:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263239680:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 130us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.577744:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263239296:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 125us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.577749:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12491 00000100:00100000:1.0:1746065140.577751:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12492 00000100:00100000:1.0:1746065140.577793:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.577811:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239552 00000100:00100000:3.0:1746065140.577814:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239552 00000100:00100000:3.0:1746065140.577828:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12493 00000100:00100000:3.0:1746065140.577832:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263239552:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065140.577837:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.577848:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239808 00000100:00100000:1.0:1746065140.577851:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239808 00000100:00100000:3.0:1746065140.577861:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263239552:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 28us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.577865:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12494 00000100:00100000:3.0:1746065140.577867:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12493 00000100:00100000:1.0:1746065140.577869:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263239808:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065140.577895:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263239808:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 25us (56us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.577899:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12494 00000100:00100000:0.0:1746065140.580647:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.583883:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.587479:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.587579:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263240320 00000100:00100000:3.0:1746065140.587588:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263240320 00000100:00100000:3.0:1746065140.587646:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3379 00000100:00100000:3.0:1746065140.587654:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263240320:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065140.587683:0:29489:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.587696:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.587697:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.587702:0:29489:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.587712:0:29489:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.597068:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.597679:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.597693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.597706:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.597734:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.597830:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.597873:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263241344 00000100:00100000:0.0:1746065140.597876:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263241344 00000100:00100000:0.0:1746065140.597918:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3380 00000100:00100000:0.0:1746065140.597925:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263240576:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065140.597952:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.597963:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.597965:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.597969:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.598132:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263241856 00000100:00100000:3.0:1746065140.598137:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263241856 00000100:00100000:3.0:1746065140.598162:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3382 00000100:00100000:3.0:1746065140.598168:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8adb6cf4-807a-4620-a3cb-7b9d021f2493+22:2006:x1830881263241344:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065140.598182:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598189:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.598191:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.598193:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598206:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.598612:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065140.598796:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065140.598818:0:29489:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598826:0:29489:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598833:0:29489:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598839:0:29489:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ac00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065140.598842:0:29489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598849:0:29489:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598862:0:29489:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598867:0:29489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577ac00/0xad6b7ddc146da4a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.598904:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242112 00000100:00100000:3.0:1746065140.598907:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242112 00000100:00100000:3.0:1746065140.598926:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3383 00000100:00100000:3.0:1746065140.598931:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2007:x1830881263241600:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065140.598945:0:9553:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598952:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.598953:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.598956:0:9553:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.598964:0:9553:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.599144:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3384 00000100:00100000:0.0:1746065140.599151:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+22:2007:x1830881263241856:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065140.599164:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146da6d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.599171:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.599172:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.599176:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146da6d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.599183:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146da6d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.599463:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+23:2006:x1830881263240320:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 11809us (11991us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746065140.599469:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3379 00000100:00100000:3.0:1746065140.601998:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3386 00000100:00100000:3.0:1746065140.602007:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2006:x1830881263240832:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065140.602049:0:20324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.602061:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.602062:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.602066:0:20324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.602076:0:20324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.609318:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.609333:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.609341:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.609346:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065140.609350:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.609357:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.609372:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.609377:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146da5f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.609465:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:2006:x1830881263241344:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 11292us (11752us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.609474:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3382 00010000:00010000:1.0:1746065140.616284:0:9555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.616301:0:9555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.616309:0:9555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.616315:0:9555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd80a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065140.616318:0:9555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.616325:0:9555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.616341:0:9555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.616347:0:9555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146da51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065140.616426:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2006:x1830881263240576:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 18497us (19362us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065140.616434:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3380 00010000:00010000:3.0:1746065140.630537:0:9553:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.630553:0:9553:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.630560:0:9553:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.630566:0:9553:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f877000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065140.630569:0:9553:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.630576:0:9553:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.630593:0:9553:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.630599:0:9553:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f877000/0xad6b7ddc146da66 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.632823:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2007:x1830881263241600:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 33882us (35078us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.632833:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3383 00010000:00010000:0.0:1746065140.643826:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146da74 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.643840:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146da74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.643849:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146da74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.643855:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dce00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065140.643859:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146da74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.643866:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146da74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.643881:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146da74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.643887:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146da74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.644687:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263242112:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 45521us (45886us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065140.644696:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3385 00010000:00010000:3.0:1746065140.650839:0:20324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.650854:0:20324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.650866:0:20324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.650871:0:20324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065140.650876:0:20324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.650883:0:20324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.650898:0:20324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.650904:0:20324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c400/0xad6b7ddc146da7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.650991:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263240832:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 48981us (53308us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.651000:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3386 00000100:00100000:0.0:1746065140.660849:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.661127:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242368 00000100:00100000:1.0:1746065140.661136:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242368 00000100:00100000:1.0:1746065140.661186:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13487 00000100:00100000:1.0:1746065140.661193:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31866:x1830881263242368:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065140.661233:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.661256:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146da19 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326be expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.661286:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.661290:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065140.661329:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.661339:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.661346:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00010000:1.0:1746065140.661427:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129f40a80 reply state ffff88009a999000 transno 8589935788 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.661434:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.661439:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.661441:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065140.661443:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065140.661508:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:31866:x1830881263242368:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 315us (666us total) trans 8589935788 rc 0/0 00000100:00100000:1.0:1746065140.661514:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13487 00000100:00100000:0.0:1746065140.664617:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.664650:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.664673:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.664702:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.664716:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.664733:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242496 00000100:00100000:3.0:1746065140.664740:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242496 00000100:00100000:0.0:1746065140.664740:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.664765:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242752 00000100:00100000:0.0:1746065140.664767:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242752 00000100:00100000:3.0:1746065140.664770:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243008 00000100:00100000:3.0:1746065140.664771:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243008 00000100:00100000:3.0:1746065140.664801:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242624 00000100:00100000:3.0:1746065140.664803:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242624 00000100:00100000:3.0:1746065140.664845:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242880 00000100:00100000:0.0:1746065140.664845:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243136 00000100:00100000:3.0:1746065140.664847:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242880 00000100:00100000:0.0:1746065140.664847:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243136 00000100:00100000:3.0:1746065140.664863:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12497 00000100:00100000:3.0:1746065140.664870:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263242496:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065140.664979:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065140.664982:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065139 -> 1746065140 00002000:00010000:3.0:1746065140.664984:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.664985:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065139 -> 1746065140 00002000:00010000:3.0:1746065140.664987:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746065140.665039:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:2005:x1830881263242496:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 169us (428us total) trans 21474840786 rc 0/0 00000100:00100000:3.0:1746065140.665045:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12497 00000100:00100000:3.0:1746065140.665059:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12501 00000100:00100000:3.0:1746065140.665063:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2005:x1830881263242880:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065140.665097:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065140.665099:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.665101:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.665103:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.665104:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065140.665118:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:2005:x1830881263242880:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 54us (402us total) trans 21474840788 rc 0/0 00000100:00100000:3.0:1746065140.665122:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12501 00000100:00100000:3.0:1746065140.665152:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12502 00000100:00100000:3.0:1746065140.665156:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263243136:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065140.665189:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065140.665191:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.665193:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.665195:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.665196:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746065140.665207:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263243136:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 51us (467us total) trans 17179873347 rc 0/0 00000100:00100000:3.0:1746065140.665211:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12502 00000100:00100000:0.0:1746065140.667416:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.667638:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243392 00000100:00100000:3.0:1746065140.667643:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243392 00000100:00100000:3.0:1746065140.667680:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4831 00000100:00100000:3.0:1746065140.667687:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:31866:x1830881263243392:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:3.0:1746065140.667726:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc146d9cc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b0 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.667758:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065140.667768:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146da0b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b7 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.667797:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065140.667821:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146da0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b7 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.667830:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146da0b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b7 expref: 10 pid: 7231 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.667840:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16721:1830881263227392:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.667910:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065140.669279:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16721:1830881263227392:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.669293:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00000100:00100000:0.0:1746065140.669466:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.669504:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243520 00000100:00100000:1.0:1746065140.669508:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243520 00010000:00010000:1.0:1746065140.669527:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146da0b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b7 expref: 11 pid: 7231 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746065140.669592:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5550 00000100:00100000:1.0:1746065140.669598:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263243520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.669607:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.669612:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146da0b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b7 expref: 11 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.669619:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146da0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b7 expref: 11 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.669631:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146da0b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b7 expref: 11 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.669658:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.669662:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065140.669668:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065140.669673:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065140.669694:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.669767:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263243520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 168us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.669847:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5550 00010000:00010000:3.0:1746065140.670009:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065140.670016:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00000040:00080000:3.0:1746065140.670240:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].477, 88 off50032 00000004:00080000:3.0:1746065140.670246:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688471539ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670268:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].428, 88 off45712 00000004:00080000:3.0:1746065140.670272:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736688498099ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065140.670300:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].429, 88 off45800 00000004:00080000:3.0:1746065140.670304:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736688529969ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065140.670312:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].478, 88 off50120 00000004:00080000:3.0:1746065140.670314:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688540859ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670321:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].479, 88 off50208 00000004:00080000:3.0:1746065140.670323:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688549346ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670330:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].430, 88 off45888 00000004:00080000:3.0:1746065140.670332:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736688558712ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065140.670339:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].431, 88 off45976 00000004:00080000:3.0:1746065140.670341:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736688567679ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065140.670347:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].432, 88 off46064 00000004:00080000:3.0:1746065140.670350:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736688576389ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065140.670356:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].480, 88 off50296 00000004:00080000:3.0:1746065140.670358:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688585017ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670365:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].433, 88 off46152 00000004:00080000:3.0:1746065140.670368:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736688594756ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065140.670376:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].481, 88 off50384 00000004:00080000:3.0:1746065140.670379:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688605659ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670386:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].434, 88 off46240 00000004:00080000:3.0:1746065140.670388:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736688614949ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065140.670395:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].482, 88 off50472 00000004:00080000:3.0:1746065140.670398:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688624069ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670405:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].483, 88 off50560 00000004:00080000:3.0:1746065140.670407:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688633667ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670414:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].484, 88 off50648 00000004:00080000:3.0:1746065140.670416:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688642949ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670423:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].485, 88 off50736 00000004:00080000:3.0:1746065140.670425:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736688651299ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065140.670431:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].435, 88 off46328 00000004:00080000:3.0:1746065140.670433:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736688659659ns, next at 615601404258ns, rc = 0 00000001:00080000:3.0:1746065140.672359:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935789 is committed 00000004:00080000:3.0:1746065140.672366:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 430 committed 00010000:00010000:0.0:1746065140.672410:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065140.672419:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065140.672425:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065140.672430:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065140.672434:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065140.672440:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065140.672452:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065140.672454:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065140.672457:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065140.672462:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146da82 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00000004:00080000:3.0:1746065140.672801:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 478 committed 00000004:00080000:3.0:1746065140.672807:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 477 committed 00000004:00080000:3.0:1746065140.672809:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 476 committed 00000004:00080000:3.0:1746065140.672810:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 475 committed 00000004:00080000:3.0:1746065140.672811:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 429 committed 00000004:00080000:3.0:1746065140.672813:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 474 committed 00000004:00080000:3.0:1746065140.672815:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 428 committed 00000004:00080000:3.0:1746065140.672817:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 473 committed 00000004:00080000:3.0:1746065140.672818:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 427 committed 00000004:00080000:3.0:1746065140.672819:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 426 committed 00000004:00080000:3.0:1746065140.672821:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 425 committed 00000004:00080000:3.0:1746065140.672822:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 472 committed 00000004:00080000:3.0:1746065140.672823:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 471 committed 00000004:00080000:3.0:1746065140.672825:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 424 committed 00000004:00080000:3.0:1746065140.672827:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 423 committed 00000004:00080000:3.0:1746065140.672828:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 470 committed 00000004:00010000:3.0:1746065140.672859:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091b67480 reply state ffff88009a577000 transno 8589935789 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065140.672869:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc146da89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065140.672875:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.672877:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065140.672879:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065140.672885:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.672886:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065140.672892:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc146d9cc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326b0 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746065140.672957:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065140.673081:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263227520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.673116:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.673132:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263228032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.673144:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.673157:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065140.673162:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263227904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.673173:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.673182:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263228416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.673192:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.673208:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263227776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.673220:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.673229:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263228288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.673241:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.673636:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31866:x1830881263243392:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 5947us (6222us total) trans 8589935789 rc 0/0 00000100:00100000:3.0:1746065140.673644:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4831 00000100:00100000:3.0:1746065140.673664:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263227648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.673821:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227520 00000100:00100000:0.0:1746065140.673827:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227520 00000100:00100000:1.0:1746065140.673847:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228032 00000100:00100000:1.0:1746065140.673851:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228032 00000100:00100000:0.0:1746065140.673853:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227904 00000100:00100000:0.0:1746065140.673855:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227904 00000100:00100000:1.0:1746065140.673925:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227776 00000100:00100000:1.0:1746065140.673927:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227776 00000100:00100000:3.0:1746065140.673975:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228288 00000100:00100000:3.0:1746065140.673978:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228288 00000100:00100000:0.0:1746065140.673993:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12503 00000100:00100000:1.0:1746065140.673998:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12504 00000100:00100000:0.0:1746065140.674002:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263227520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.674004:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263228032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.674017:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12505 00000100:00100000:1.0:1746065140.674031:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263227904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065140.674125:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065140.674128:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065140.674130:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065140.674132:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065140.674134:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065140.674202:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12507 00000100:00100000:3.0:1746065140.674208:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3760:x1830881263228416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.674342:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263228544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.674428:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3760:x1830881263227904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 396us (1253us total) trans 17179873348 rc 0/0 00000100:00100000:1.0:1746065140.674433:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12505 00000100:00100000:1.0:1746065140.674443:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12508 00000100:00100000:1.0:1746065140.674448:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263228288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.674484:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3760:x1830881263228416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (1291us total) trans 17179873351 rc 0/0 00000100:00100000:3.0:1746065140.674490:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12507 00000100:00100000:1.0:1746065140.674499:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3762:x1830881263228288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (1257us total) trans 17179873352 rc 0/0 00000100:00100000:3.0:1746065140.674503:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.674504:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12508 00000100:00100000:3.0:1746065140.674523:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263228160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.674536:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.674540:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263228800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.674641:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227648 00000100:00100000:1.0:1746065140.674644:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227648 00000100:00100000:1.0:1746065140.674658:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12509 00000100:00100000:3.0:1746065140.674660:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263228672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.674663:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3761:x1830881263227648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.674676:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.674683:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263229184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.674695:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065140.674701:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065140.674703:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065140.674705:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065140.674707:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00000100:00100000:3.0:1746065140.674708:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228672 00002000:00010000:1.0:1746065140.674708:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065140.674711:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228672 00000100:00100000:3.0:1746065140.674720:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229184 00000100:00100000:3.0:1746065140.674722:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229184 00000100:00100000:1.0:1746065140.674727:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3761:x1830881263227648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (223us total) trans 17179873353 rc 0/0 00000100:00100000:3.0:1746065140.674729:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12511 00000100:00100000:3.0:1746065140.674733:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3761:x1830881263228672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.674733:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12509 00000100:00100000:1.0:1746065140.674747:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263228928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065140.674804:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9180/2, rc 0, transno 17179873353 00000100:00100000:3.0:1746065140.674809:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263227648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065140.674816:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da680/2, rc 0, transno 17179873354 00000100:00100000:3.0:1746065140.674819:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263228160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065140.674827:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b65c00/2, rc 0, transno 21474840790 00000100:00100000:3.0:1746065140.674832:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263229184:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065140.674852:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065140.674854:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.674856:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.674857:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.674859:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065140.674879:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3761:x1830881263228672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (202us total) trans 21474840789 rc 0/0 00000100:00100000:0.0:1746065140.674879:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.674885:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12511 00000100:00100000:0.0:1746065140.674891:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263229312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.674892:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228800 00000100:00100000:3.0:1746065140.674894:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228800 00000100:00100000:3.0:1746065140.674903:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12513 00000100:00100000:3.0:1746065140.674907:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3762:x1830881263228800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.674908:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065140.674924:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d8700/2, rc 0, transno 17179873349 00000100:00100000:0.0:1746065140.674928:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263227776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065140.674934:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9500/2, rc 0, transno 17179873352 00000100:00100000:0.0:1746065140.674937:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263228288:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065140.674942:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:3.0:1746065140.674943:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.674945:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.674947:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00000100:00100000:0.0:1746065140.674947:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065140.674948:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:0.0:1746065140.674959:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263229056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.674968:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3760:x1830881263228032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 964us (1822us total) trans 17179873355 rc 0/0 00000100:00100000:3.0:1746065140.674969:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3762:x1830881263228800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (90us total) trans 21474840791 rc 0/0 00000100:00100000:0.0:1746065140.674972:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.674973:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12504 00000100:00100000:3.0:1746065140.674976:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12513 00000004:00080000:0.0:1746065140.674981:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da300/2, rc 0, transno 17179873348 00000100:00100000:1.0:1746065140.674982:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229312 00000100:00100000:3.0:1746065140.674983:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228544 00000100:00100000:1.0:1746065140.674984:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229312 00000100:00100000:0.0:1746065140.674984:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263227904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.674985:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228544 00000004:00080000:0.0:1746065140.674989:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577c000/2, rc 0, transno 17179873351 00000100:00100000:0.0:1746065140.674991:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263228416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.674992:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229056 00000100:00100000:1.0:1746065140.674993:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229056 00000100:00100000:3.0:1746065140.674994:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12514 00000100:00100000:3.0:1746065140.674997:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+64:3762:x1830881263229312:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.674998:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9f80/2, rc 0, transno 17179873355 00000100:00100000:0.0:1746065140.675000:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263228032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065140.675001:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12515 00000100:00100000:1.0:1746065140.675004:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:3760:x1830881263228544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.675040:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263229568:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065140.675046:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065140.675048:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065140.675049:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065140.675051:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065140.675051:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065140.675052:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00002000:00010000:1.0:1746065140.675053:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065140.675055:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065140.675057:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00000100:00100000:0.0:1746065140.675057:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065140.675059:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746065140.675068:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3762:x1830881263229312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (160us total) trans 21474840792 rc 0/0 00000100:00100000:0.0:1746065140.675070:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229568 00000100:00100000:3.0:1746065140.675073:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12514 00000100:00100000:0.0:1746065140.675073:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229568 00000100:00100000:1.0:1746065140.675079:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3760:x1830881263228544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (130us total) trans 21474840793 rc 0/0 00000100:00100000:3.0:1746065140.675081:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12516 00000100:00100000:0.0:1746065140.675084:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12517 00000100:00100000:3.0:1746065140.675085:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3760:x1830881263229056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.675088:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3760:x1830881263229568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.675091:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12515 00000100:00100000:1.0:1746065140.675104:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.675114:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263229440:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065140.675121:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00000004:00080000:0.0:1746065140.675122:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b65880/2, rc 0, transno 21474840793 00002000:00010000:3.0:1746065140.675123:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065140.675125:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746065140.675125:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263228544:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065140.675126:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065140.675128:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:1.0:1746065140.675129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065140.675140:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228928 00000100:00100000:1.0:1746065140.675142:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228928 00000100:00100000:3.0:1746065140.675148:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3760:x1830881263229056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (175us total) trans 21474840794 rc 0/0 00000100:00100000:0.0:1746065140.675148:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3760:x1830881263229568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (91us total) trans 21474840795 rc 0/0 00000100:00100000:1.0:1746065140.675149:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229440 00000100:00100000:1.0:1746065140.675150:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229440 00000100:00100000:3.0:1746065140.675152:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12516 00000100:00100000:0.0:1746065140.675262:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12517 00000100:00100000:3.0:1746065140.675267:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12518 00000100:00100000:1.0:1746065140.675270:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12519 00000100:00100000:3.0:1746065140.675273:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3759:x1830881263228928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065140.675275:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3759:x1830881263229440:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.675284:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b64e00/2, rc 0, transno 21474840795 00000100:00100000:0.0:1746065140.675287:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263229568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.675293:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b64380/2, rc 0, transno 21474840794 00000100:00100000:0.0:1746065140.675295:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263229056:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065140.675313:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746065140.675315:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065140.675315:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065140.675317:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065140.675317:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.675318:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065140.675319:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.675320:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00002000:00010000:1.0:1746065140.675320:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065140.675322:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746065140.675328:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:0.0:1746065140.675330:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065140.675332:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065140.675333:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065140.675335:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:3.0:1746065140.675339:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3759:x1830881263228928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (235us total) trans 21474840796 rc 0/0 00000100:00100000:3.0:1746065140.675344:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12518 00000100:00100000:1.0:1746065140.675344:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263227520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1345us (2227us total) trans 17179873350 rc 0/0 00000100:00100000:1.0:1746065140.675349:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12503 00000100:00100000:0.0:1746065140.675349:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3759:x1830881263229440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (220us total) trans 21474840797 rc 0/0 00000100:00100000:0.0:1746065140.675354:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12519 00000004:00080000:3.0:1746065140.675362:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b65180/2, rc 0, transno 21474840791 00000100:00100000:3.0:1746065140.675365:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263228800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065140.675368:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b66300/2, rc 0, transno 21474840796 00000004:00080000:0.0:1746065140.675370:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957db100/2, rc 0, transno 17179873350 00000004:00080000:3.0:1746065140.675371:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b64700/2, rc 0, transno 21474840792 00000100:00100000:1.0:1746065140.675372:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263228928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.675372:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263227520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.675373:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263229312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065140.675378:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b66680/2, rc 0, transno 21474840797 00000100:00100000:1.0:1746065140.675381:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263229440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.676623:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.676659:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243648 00000100:00100000:1.0:1746065140.676663:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243648 00000100:00100000:1.0:1746065140.676812:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13488 00000100:00100000:1.0:1746065140.676820:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:31866:x1830881263243648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065140.676834:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.676845:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146da90 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326ef expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.676879:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146da90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326ef expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.676887:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146da90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326ef expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.676895:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.676897:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065140.676899:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a800, rc 0) 00000100:00100000:1.0:1746065140.676927:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31866:x1830881263243648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.676931:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13488 00000100:00100000:0.0:1746065140.678565:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.678620:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243904 00000100:00100000:3.0:1746065140.678625:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243904 00000100:00100000:3.0:1746065140.678659:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4832 00000100:00100000:3.0:1746065140.678665:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31866:x1830881263243904:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065140.678838:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31866:x1830881263243904:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 173us (277us total) trans 8589935790 rc 0/0 00000100:00100000:3.0:1746065140.678844:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4832 00000100:00100000:0.0:1746065140.688941:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.689054:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263244160 00000100:00100000:1.0:1746065140.689062:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263244160 00000100:00100000:1.0:1746065140.689160:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13489 00000100:00100000:1.0:1746065140.689168:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+26:31879:x1830881263244160:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.689190:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.689208:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146da97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9326f6 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.689267:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689278:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689286:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689297:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689302:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689306:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065140.689343:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065140.689382:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146daac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689390:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146daac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689395:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146daac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065140.689403:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065140.689464:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689469:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689478:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689482:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689510:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065140.689513:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689519:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689528:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065140.689530:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065140.689533:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689538:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146da9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689563:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689567:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689572:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689576:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065140.689578:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689586:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689592:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5e00) 00010000:00010000:1.0:1746065140.689594:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065140.689595:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689600:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146daa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.689715:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146da97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326f6 expref: 29 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.689725:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146daac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326f6 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.689730:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.689732:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065140.689734:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30a00, rc 0) 00000100:00100000:1.0:1746065140.689936:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+28:31879:x1830881263244160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 767us (1004us total) trans 8589935791 rc 0/0 00000100:00100000:1.0:1746065140.689941:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13489 00000100:00100000:0.0:1746065140.693480:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.694350:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.694497:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263244544 00000100:00100000:3.0:1746065140.694501:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263244544 00000100:00100000:3.0:1746065140.694532:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12520 00000100:00100000:3.0:1746065140.694537:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:31879:x1830881263244544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.694545:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.694555:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932704 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.694570:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.694571:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.694577:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 37 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.695015:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 37 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.695037:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835de00, rc 0) 00000100:00100000:3.0:1746065140.695057:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+37:31879:x1830881263244544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 519us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.695063:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12520 00000100:00100000:1.0:1746065140.695215:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245184 00000100:00100000:1.0:1746065140.695219:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245184 00000100:00100000:1.0:1746065140.695240:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13492 00000100:00100000:1.0:1746065140.695245:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+9:31877:x1830881263245184:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065140.695255:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.695264:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc146daf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932719 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.695310:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.695319:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.695325:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065140.695926:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.696086:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.696227:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5552 00000100:00100000:1.0:1746065140.696234:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263245312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.696241:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.696246:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04a000/0xad6b7ddc146dacf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326fd expref: 11 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.696254:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04a000/0xad6b7ddc146dacf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326fd expref: 11 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.696265:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04a000/0xad6b7ddc146dacf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326fd expref: 11 pid: 7231 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.696273:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.696275:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065140.696280:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065140.696285:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065140.696291:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.696295:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.696298:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.696312:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.696330:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263245312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.696335:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5552 00010000:00010000:1.0:1746065140.696352:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.696357:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065140.696364:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065140.696423:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc146daf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.696432:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.696437:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.696439:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065140.696441:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6000, rc 0) 00000100:00100000:1.0:1746065140.696464:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+10:31877:x1830881263245184:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1220us (1369us total) trans 8589935794 rc 0/0 00000100:00100000:1.0:1746065140.696473:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13492 00000100:00100000:0.0:1746065140.696862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.696957:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245568 00000100:00100000:1.0:1746065140.696962:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245568 00000100:00100000:1.0:1746065140.696985:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13493 00000100:00100000:1.0:1746065140.696990:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+10:31880:x1830881263245568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.697000:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.697007:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9000/0xad6b7ddc146db15 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932720 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.697044:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9000/0xad6b7ddc146db15 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932720 expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.697052:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9000/0xad6b7ddc146db15 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932720 expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.697064:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.697066:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065140.697068:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d9000, rc 0) 00000100:00100000:1.0:1746065140.697098:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+11:31880:x1830881263245568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.697103:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13493 00000100:00100000:0.0:1746065140.697632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.697686:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245696 00000100:00100000:1.0:1746065140.697689:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245696 00000100:00100000:1.0:1746065140.697753:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13494 00000100:00100000:1.0:1746065140.697759:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+29:31879:x1830881263245696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.697767:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.697796:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8000/0xad6b7ddc146db1c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932727 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.697820:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8000/0xad6b7ddc146db1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932727 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.697828:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8000/0xad6b7ddc146db1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932727 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.697946:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.697949:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065140.697951:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d8000, rc 0) 00000100:00100000:1.0:1746065140.698058:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+30:31879:x1830881263245696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 298us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.698064:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13494 00000100:00100000:1.0:1746065140.706844:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.706883:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245952 00000100:00100000:3.0:1746065140.706891:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245952 00002000:00100000:3.0:1746065140.707195:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009577ed80 x1830881263245952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.707206:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ed80 with x1830881263245952 ext(0->1048575) 00002000:00010000:3.0:1746065140.707210:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577ed80 00000100:00100000:3.0:1746065140.707239:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3387 00000100:00100000:3.0:1746065140.707247:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263245952:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065140.708134:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.708185:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246208 00000100:00100000:0.0:1746065140.708189:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246208 00002000:00100000:0.0:1746065140.708206:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009577fb80 x1830881263246208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065140.708214:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577fb80 with x1830881263246208 ext(0->1048575) 00002000:00010000:0.0:1746065140.708217:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577fb80 00000100:00100000:0.0:1746065140.708240:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3388 00000100:00100000:0.0:1746065140.708244:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+33:2004:x1830881263246208:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.716334:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263245952:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9080us (9489us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.716344:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3387 00002000:00100000:3.0:1746065140.716353:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009577ed80 x1830881263245952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.716361:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ed80 with x1830881263245952 ext(0->1048575) 00002000:00010000:3.0:1746065140.716366:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577ed80 00000100:00100000:0.0:1746065140.716923:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.720879:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263229952:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.720892:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263230080:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.720911:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:1.0:1746065140.721324:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.721370:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246592 00000100:00100000:3.0:1746065140.721375:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246592 00010000:00010000:3.0:1746065140.721394:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8000/0xad6b7ddc146db1c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932727 expref: 30 pid: 9571 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.721409:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5553 00000100:00100000:3.0:1746065140.721414:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263246592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.721427:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.721431:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8000/0xad6b7ddc146db1c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932727 expref: 30 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.721438:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8000/0xad6b7ddc146db1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932727 expref: 30 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.721454:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8000/0xad6b7ddc146db1c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932727 expref: 30 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.721604:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.721608:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.721615:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.721619:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.721793:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263246592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 377us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.721799:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5553 00000100:00100000:0.0:1746065140.722185:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.722558:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246720 00000100:00100000:3.0:1746065140.722562:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246720 00010000:00010000:3.0:1746065140.722576:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146da90 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326ef expref: 8 pid: 9571 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.722625:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5554 00000100:00100000:3.0:1746065140.722631:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263246720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.722639:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.722644:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146da90 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326ef expref: 8 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.722651:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146da90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326ef expref: 8 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.722663:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc146da90 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326ef expref: 8 pid: 9571 timeout: 836 lvb_type: 0 00010000:00010000:3.0:1746065140.722670:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.722673:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.722679:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.722684:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.722901:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.722928:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263246720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 297us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.722933:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5554 00000100:00100000:0.0:1746065140.725996:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.726469:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246848 00000100:00100000:3.0:1746065140.726477:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246848 00000100:00100000:3.0:1746065140.726519:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12522 00000100:00100000:3.0:1746065140.726527:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+40:31879:x1830881263246848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.726542:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.726557:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932735 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.726584:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.726586:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.726592:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932735 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.726605:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932735 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.726614:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d000, rc 0) 00000100:00100000:3.0:1746065140.726664:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+41:31879:x1830881263246848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 138us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.726670:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12522 00000100:00100000:0.0:1746065140.728895:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.729127:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246976 00000100:00100000:1.0:1746065140.729133:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246976 00000100:00100000:1.0:1746065140.729375:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13496 00000100:00100000:1.0:1746065140.729382:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+29:31879:x1830881263246976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065140.729399:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.729412:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93273c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.729447:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.729458:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.729475:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065140.729484:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.729494:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.729496:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065140.729500:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.729505:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5200, rc 0) 00000100:00100000:1.0:1746065140.729549:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:31879:x1830881263246976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 166us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.729554:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13496 00000100:00100000:1.0:1746065140.732141:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.732188:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247104 00000100:00100000:0.0:1746065140.732194:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247104 00000100:00100000:0.0:1746065140.732223:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12523 00000100:00100000:0.0:1746065140.732229:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+15:31880:x1830881263247104:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065140.732240:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.732252:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc146db3f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932743 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.732272:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.732274:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.732280:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc146db3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932743 expref: 16 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.732291:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc146db3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932743 expref: 16 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.732299:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131019c00, rc 0) 00000100:00100000:0.0:1746065140.733012:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+16:31880:x1830881263247104:12345-192.168.202.27@tcp:101:cat.0 Request processed in 781us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.733028:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12523 00000001:00080000:0.0:1746065140.736178:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935795 is committed 00000004:00080000:0.0:1746065140.736185:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 438 committed 00000100:00100000:3.0:1746065140.736237:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247232 00000100:00100000:3.0:1746065140.736244:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247232 00000004:00080000:0.0:1746065140.736429:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 487 committed 00000004:00080000:0.0:1746065140.736443:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 486 committed 00000004:00080000:0.0:1746065140.736445:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 485 committed 00000004:00080000:0.0:1746065140.736446:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 484 committed 00000004:00080000:0.0:1746065140.736448:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 437 committed 00000004:00080000:0.0:1746065140.736449:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 483 committed 00000004:00080000:0.0:1746065140.736451:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 436 committed 00000004:00080000:0.0:1746065140.736452:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 482 committed 00000004:00080000:0.0:1746065140.736454:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 435 committed 00000004:00080000:0.0:1746065140.736455:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 434 committed 00000004:00080000:0.0:1746065140.736457:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 433 committed 00000004:00080000:0.0:1746065140.736458:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 481 committed 00000004:00080000:0.0:1746065140.736460:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 480 committed 00000004:00080000:0.0:1746065140.736461:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 432 committed 00000004:00080000:0.0:1746065140.736463:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 431 committed 00000004:00080000:0.0:1746065140.736464:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 479 committed 00000001:00080000:0.0:1746065140.736472:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935793 is committed 00000001:00080000:0.0:1746065140.736477:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935790 is committed 00000100:00100000:3.0:1746065140.736596:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13497 00000100:00100000:3.0:1746065140.736608:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+10:31880:x1830881263247232:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.736624:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.736639:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93274a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.736682:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 11 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.736692:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 11 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.736703:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.736706:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065140.736709:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.736715:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:3.0:1746065140.736751:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+11:31880:x1830881263247232:12345-192.168.202.27@tcp:101:cat.0 Request processed in 148us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.736757:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13497 00000100:00100000:3.0:1746065140.736795:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263230336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.736826:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.736856:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263230848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.736873:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.736895:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263231360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.736912:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.736922:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263231872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.736935:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065140.736960:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230336 00000100:00100000:3.0:1746065140.736964:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230336 00000100:00100000:3.0:1746065140.736980:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230848 00000100:00100000:3.0:1746065140.736982:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230848 00000100:00100000:3.0:1746065140.736992:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231360 00000100:00100000:3.0:1746065140.736994:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231360 00000100:00100000:3.0:1746065140.737010:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231872 00000100:00100000:3.0:1746065140.737012:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231872 00000100:00100000:3.0:1746065140.737033:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230208 00000100:00100000:3.0:1746065140.737035:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230208 00000100:00100000:3.0:1746065140.737043:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230720 00000100:00100000:3.0:1746065140.737044:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230720 00000100:00100000:3.0:1746065140.737051:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231232 00000100:00100000:3.0:1746065140.737053:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231232 00000100:00100000:3.0:1746065140.737061:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12524 00000100:00100000:3.0:1746065140.737067:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3762:x1830881263230336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065140.737152:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065140.737154:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.737156:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.737157:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065140.737159:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065140.737180:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3762:x1830881263230336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (353us total) trans 21474840798 rc 0/0 00000100:00100000:3.0:1746065140.737187:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12524 00000100:00100000:3.0:1746065140.737197:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12526 00000100:00100000:3.0:1746065140.737200:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3762:x1830881263231360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065140.737253:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3762:x1830881263231360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (339us total) trans 21474840799 rc 0/0 00000100:00100000:3.0:1746065140.737257:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12526 00000100:00100000:3.0:1746065140.737266:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12527 00000100:00100000:3.0:1746065140.737270:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3762:x1830881263231872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065140.737301:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:3.0:1746065140.737303:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065140.737305:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065140.737307:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065140.737308:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:3.0:1746065140.737323:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3762:x1830881263231872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (388us total) trans 21474840800 rc 0/0 00000100:00100000:3.0:1746065140.737328:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12527 00000100:00100000:3.0:1746065140.737337:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12529 00000100:00100000:3.0:1746065140.737341:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3761:x1830881263230720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065140.737375:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746065140.737377:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065140.737379:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065140.737380:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065140.737382:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746065140.737398:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3761:x1830881263230720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (396us total) trans 21474840802 rc 0/0 00000100:00100000:3.0:1746065140.737402:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12529 00000100:00100000:3.0:1746065140.737412:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12531 00000100:00100000:3.0:1746065140.737416:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3761:x1830881263231744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.737465:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3761:x1830881263231744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (401us total) trans 17179873358 rc 0/0 00000100:00100000:3.0:1746065140.737469:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12531 00000004:00080000:3.0:1746065140.737500:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c30380/2, rc 0, transno 21474840798 00000100:00100000:0.0:1746065140.738180:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263230464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.738203:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.738216:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263230976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.738229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.738238:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263231488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.738252:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.738261:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263232000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.738274:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.738285:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746065140.738289:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263230592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.738301:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.738310:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263231104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.738321:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.738327:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263231616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.738338:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.738344:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263232128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.738354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065140.738372:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230464 00000100:00100000:0.0:1746065140.738375:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230464 00000100:00100000:0.0:1746065140.738387:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230976 00000100:00100000:0.0:1746065140.738388:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230976 00000100:00100000:0.0:1746065140.738394:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231488 00000100:00100000:0.0:1746065140.738396:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231488 00000100:00100000:0.0:1746065140.738401:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232000 00000100:00100000:0.0:1746065140.738403:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232000 00000100:00100000:0.0:1746065140.738408:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230592 00000100:00100000:0.0:1746065140.738410:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230592 00000100:00100000:0.0:1746065140.738415:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231104 00000100:00100000:0.0:1746065140.738417:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231104 00000100:00100000:0.0:1746065140.738422:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231616 00000100:00100000:0.0:1746065140.738423:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231616 00000100:00100000:0.0:1746065140.738429:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232128 00000100:00100000:0.0:1746065140.738431:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232128 00000100:00100000:0.0:1746065140.738438:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12533 00000100:00100000:0.0:1746065140.738442:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3759:x1830881263230464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065140.738484:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:0.0:1746065140.738486:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065140.738488:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065140.738489:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065140.738491:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:0.0:1746065140.738511:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3759:x1830881263230464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (307us total) trans 21474840804 rc 0/0 00000100:00100000:0.0:1746065140.738516:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12533 00000100:00100000:0.0:1746065140.738526:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12535 00000100:00100000:0.0:1746065140.738530:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3759:x1830881263231488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.738581:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3759:x1830881263231488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (327us total) trans 17179873360 rc 0/0 00000100:00100000:0.0:1746065140.738586:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12535 00000100:00100000:0.0:1746065140.738595:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12538 00000100:00100000:0.0:1746065140.738599:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3759:x1830881263231104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065140.738633:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:0.0:1746065140.738635:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065140.738636:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065140.738638:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065140.738639:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:0.0:1746065140.738654:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3759:x1830881263231104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (332us total) trans 21474840805 rc 0/0 00000100:00100000:0.0:1746065140.738659:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12538 00000100:00100000:0.0:1746065140.738667:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12539 00000100:00100000:0.0:1746065140.738671:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3759:x1830881263231616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065140.738703:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065140.738705:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065140.738706:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065140.738708:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065140.738709:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:0.0:1746065140.738723:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3759:x1830881263231616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (384us total) trans 21474840806 rc 0/0 00000100:00100000:0.0:1746065140.738727:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12539 00000100:00100000:0.0:1746065140.738736:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12540 00000100:00100000:0.0:1746065140.738739:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3759:x1830881263232128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065140.738802:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3759:x1830881263232128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (446us total) trans 17179873362 rc 0/0 00000100:00100000:0.0:1746065140.738806:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12540 00000004:00080000:0.0:1746065140.738830:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b64a80/2, rc 0, transno 21474840805 00000100:00100000:0.0:1746065140.738833:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263231104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.738840:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097240380/2, rc 0, transno 21474840806 00000100:00100000:0.0:1746065140.738843:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263231616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.738849:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bed80/2, rc 0, transno 17179873362 00000100:00100000:0.0:1746065140.738851:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263232128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065140.738857:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c31c00/2, rc 0, transno 21474840804 00000100:00100000:0.0:1746065140.738860:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263230464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065140.738866:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577df80/2, rc 0, transno 17179873359 00000100:00100000:0.0:1746065140.738868:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263230976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065140.738873:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bce00/2, rc 0, transno 17179873360 00000100:00100000:0.0:1746065140.738876:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263231488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065140.738882:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577e300/2, rc 0, transno 17179873361 00000100:00100000:0.0:1746065140.738884:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263230592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065140.741361:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bdc00/2, rc 0, transno 17179873363 00000100:00100000:0.0:1746065140.741369:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263232000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065140.741519:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263230336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065140.741536:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577d180/2, rc 0, transno 17179873356 00000100:00100000:3.0:1746065140.741539:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263230848:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065140.741549:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097240700/2, rc 0, transno 21474840799 00000100:00100000:3.0:1746065140.741552:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263231360:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065140.741558:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097242d80/2, rc 0, transno 21474840800 00000100:00100000:3.0:1746065140.741560:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263231872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065140.743815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.743840:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.743876:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247360 00000100:00100000:3.0:1746065140.743883:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247360 00000100:00100000:0.0:1746065140.743894:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.743911:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247488 00000100:00100000:3.0:1746065140.743913:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247488 00000100:00100000:3.0:1746065140.743928:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4833 00000100:00100000:3.0:1746065140.743934:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+12:31880:x1830881263247360:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:3.0:1746065140.744036:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40df450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+12:31880:x1830881263247360:12345-192.168.202.27@tcp:49:cat.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.744042:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4833 00000100:00100000:3.0:1746065140.744073:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4834 00000100:00100000:3.0:1746065140.744077:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+28:31879:x1830881263247488:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:3.0:1746065140.744105:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+28:31879:x1830881263247488:12345-192.168.202.27@tcp:49:cat.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.744109:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4834 00000100:00100000:1.0:1746065140.744172:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247616 00000100:00100000:1.0:1746065140.744176:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247616 00000100:00100000:1.0:1746065140.744195:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13498 00000100:00100000:1.0:1746065140.744199:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:31874:x1830881263247616:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065140.744207:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065140.744221:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146db4d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932751 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.744252:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146db4d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932751 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.744264:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146db4d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932751 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065140.744275:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065140.744277:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065140.744280:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4400, rc 0) 00000100:00100000:1.0:1746065140.744295:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+29:31874:x1830881263247616:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 95us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.744299:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13498 00000100:00100000:3.0:1746065140.753922:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.754358:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.754397:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.754672:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248256 00000100:00100000:3.0:1746065140.754676:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248256 00000100:00100000:3.0:1746065140.754713:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 706 00000100:00100000:3.0:1746065140.754719:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263248256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065140.754727:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065140.754746:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146db4d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932751 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.754762:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.754764:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065140.756197:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263248256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1145us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.756210:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 706 00000100:00100000:0.0:1746065140.762378:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.762409:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248512 00000100:00100000:0.0:1746065140.762416:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248512 00010000:00010000:0.0:1746065140.762440:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146da43 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e8 expref: 17 pid: 11461 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746065140.762477:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5555 00000100:00100000:0.0:1746065140.762483:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263248512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.762494:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065140.762509:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146da43 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e8 expref: 17 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.762519:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146da43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e8 expref: 17 pid: 11461 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746065140.762538:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.762540:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.762546:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.762553:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.762577:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.762588:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263232768:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065140.762643:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b300 going to sleep for 11 seconds 00010000:00010000:3.0:1746065140.762989:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146da43 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e8 expref: 17 pid: 11461 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.763002:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263232640:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.763029:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.763039:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9a00, rc 0) 00000100:00100000:3.0:1746065140.763056:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+19:31877:x1830881263248384:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7056us (8658us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.763062:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12541 00000100:00100000:0.0:1746065140.769487:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.769513:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.769546:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248768 00000100:00100000:3.0:1746065140.769553:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248768 00000100:00100000:0.0:1746065140.769571:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065140.769583:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2691072->2695167) req@ffff880098dd8000 x1830881263248768/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.769592:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8000 with x1830881263248768 ext(2691072->2695167) 00002000:00010000:3.0:1746065140.769595:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd8000 00000100:00100000:3.0:1746065140.769610:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3391 00000100:00100000:3.0:1746065140.769615:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263248768:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065140.769727:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263248768:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 111us (244us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065140.769731:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248896 00000100:00100000:3.0:1746065140.769732:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3391 00000100:00100000:0.0:1746065140.769734:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248896 00002000:00100000:3.0:1746065140.769737:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2691072->2695167) req@ffff880098dd8000 x1830881263248768/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.769744:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8000 with x1830881263248768 ext(2691072->2695167) 00002000:00010000:3.0:1746065140.769747:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd8000 00000100:00100000:0.0:1746065140.769751:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263249024 00000100:00100000:0.0:1746065140.769753:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263249024 00000100:00100000:0.0:1746065140.769761:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12542 00000100:00100000:3.0:1746065140.769764:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12543 00000100:00100000:0.0:1746065140.769765:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+42:31879:x1830881263248896:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065140.769768:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+42:31874:x1830881263249024:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065140.769791:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065140.769791:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.769803:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932766 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.769803:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146db62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93275f expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.769818:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.769819:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.769820:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146da27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326cc expref: 15 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065140.769825:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146db62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93275f expref: 44 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.769827:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc146db3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932743 expref: 16 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.769832:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932735 expref: 44 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.769836:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.769836:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146db62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93275f expref: 44 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.769837:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.769840:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1183744->1667071] (req 1183744->1667071) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 44 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.769844:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5600, rc 0) 00010000:00010000:3.0:1746065140.769858:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932735 expref: 44 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.769858:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+44:31879:x1830881263248896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 93us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.769862:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12542 00010000:00010000:3.0:1746065140.769868:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932735 expref: 43 pid: 9549 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.769878:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263232896:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.769926:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc146db3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932743 expref: 16 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.769934:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc146db3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932743 expref: 16 pid: 1880 timeout: 836 lvb_type: 0 00000100:00100000:3.0:1746065140.769941:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263233024:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.769964:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146da27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326cc expref: 15 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.769972:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146da27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326cc expref: 15 pid: 9549 timeout: 836 lvb_type: 1 00000100:00100000:3.0:1746065140.769979:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263233152:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.769995:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.772045:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.772082:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.772096:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263232896:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.772105:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263233024:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065140.772111:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263233152:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065140.772128:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1183744->1667071] (req 1183744->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 44 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.772145:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44a00, rc 0) 00000100:00100000:1.0:1746065140.772159:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5556 00000100:00100000:1.0:1746065140.772169:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263249280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.772177:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065140.772183:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+44:31874:x1830881263249024:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2414us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.772190:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12543 00010000:00010000:1.0:1746065140.772192:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932735 expref: 44 pid: 9549 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.772202:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932735 expref: 43 pid: 9549 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.772346:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.772410:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263249536 00000100:00100000:3.0:1746065140.772414:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263249536 00002000:00100000:3.0:1746065140.772432:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2953216->2957311) req@ffff880098ddb800 x1830881263249536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.772441:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddb800 with x1830881263249536 ext(2953216->2957311) 00002000:00010000:3.0:1746065140.772445:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098ddb800 00000100:00100000:3.0:1746065140.772461:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3392 00000100:00100000:3.0:1746065140.772466:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263249536:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:1.0:1746065140.772579:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146db31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932735 expref: 43 pid: 9549 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.772598:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065140.772632:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263249280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 464us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065140.772638:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5556 00000100:00100000:3.0:1746065140.772642:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263249536:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 174us (295us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.772647:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3392 00002000:00100000:3.0:1746065140.772651:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2953216->2957311) req@ffff880098ddb800 x1830881263249536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.772657:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddb800 with x1830881263249536 ext(2953216->2957311) 00002000:00010000:3.0:1746065140.772660:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098ddb800 00000100:00100000:0.0:1746065140.772915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.772951:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263249792 00000100:00100000:3.0:1746065140.772954:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263249792 00000100:00100000:0.0:1746065140.772959:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.773269:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12544 00000100:00100000:3.0:1746065140.773276:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:31880:x1830881263249792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.773283:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.773291:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc146db69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93276d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.773305:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.773306:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.773311:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc146db69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93276d expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.773320:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc146db69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93276d expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.773325:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44600, rc 0) 00000100:00100000:3.0:1746065140.773344:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+18:31880:x1830881263249792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.773348:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12544 00000100:00100000:0.0:1746065140.775139:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.775179:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250048 00000100:00100000:3.0:1746065140.775184:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250048 00002000:00100000:3.0:1746065140.775206:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880098dd9c00 x1830881263250048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.775214:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9c00 with x1830881263250048 ext(1048576->2097151) 00002000:00010000:3.0:1746065140.775217:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9c00 00000100:00100000:3.0:1746065140.775230:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3393 00000100:00100000:3.0:1746065140.775235:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263250048:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065140.781206:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263233280:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065140.781225:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065140.781257:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263249664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7866us (8297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065140.781264:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5558 00000100:00100000:3.0:1746065140.783218:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250560 00000100:00100000:3.0:1746065140.783224:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250560 00002000:00100000:3.0:1746065140.783251:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800a4e52d80 x1830881263250560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.783259:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52d80 with x1830881263250560 ext(1048576->2097151) 00002000:00010000:3.0:1746065140.783263:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e52d80 00000100:00100000:3.0:1746065140.783279:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3395 00000100:00100000:3.0:1746065140.783285:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263250560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065140.784968:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263250048:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9728us (9829us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.784974:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3393 00002000:00100000:3.0:1746065140.784980:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880098dd9c00 x1830881263250048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.784986:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9c00 with x1830881263250048 ext(1048576->2097151) 00002000:00010000:3.0:1746065140.784992:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9c00 00000100:00100000:1.0:1746065140.787903:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.787982:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250816 00000100:00100000:3.0:1746065140.787989:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250816 00002000:00100000:3.0:1746065140.788034:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1662976->1667071) req@ffff8800907bdf80 x1830881263250816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.788044:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881263250816 ext(1662976->1667071) 00002000:00010000:3.0:1746065140.788048:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bdf80 00000100:00100000:3.0:1746065140.788150:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3396 00000100:00100000:3.0:1746065140.788158:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263250816:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065140.788281:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263250816:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 123us (388us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065140.788287:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3396 00002000:00100000:3.0:1746065140.788293:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1662976->1667071) req@ffff8800907bdf80 x1830881263250816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.788300:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881263250816 ext(1662976->1667071) 00002000:00010000:3.0:1746065140.788302:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bdf80 00000100:00100000:3.0:1746065140.789463:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263250560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 6175us (6366us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.789470:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3395 00002000:00100000:3.0:1746065140.789476:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800a4e52d80 x1830881263250560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.789483:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52d80 with x1830881263250560 ext(1048576->2097151) 00002000:00010000:3.0:1746065140.789487:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e52d80 00000100:00100000:0.0:1746065140.794126:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.795436:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12545 00000100:00100000:3.0:1746065140.795447:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:31879:x1830881263250944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.795465:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.795479:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932774 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.795501:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.795503:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.795509:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 38 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.795521:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 38 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.795530:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45c00, rc 0) 00000100:00100000:3.0:1746065140.795738:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+38:31879:x1830881263250944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 291us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.795744:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12545 00000100:00100000:0.0:1746065140.796088:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.796185:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251072 00000100:00100000:3.0:1746065140.796190:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251072 00000100:00100000:3.0:1746065140.796272:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12546 00000100:00100000:3.0:1746065140.796278:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+33:31880:x1830881263251072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.796285:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.796291:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93277b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.796303:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.796304:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065140.796308:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.796317:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.796323:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45e00, rc 0) 00000100:00100000:3.0:1746065140.796439:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+34:31880:x1830881263251072:12345-192.168.202.27@tcp:101:cat.0 Request processed in 160us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065140.796445:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12546 00000100:00100000:0.0:1746065140.798793:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.798878:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251328 00000100:00100000:3.0:1746065140.798885:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251328 00002000:00100000:3.0:1746065140.798918:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009aced880 x1830881263251328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.798932:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aced880 with x1830881263251328 ext(1048576->2097151) 00002000:00010000:3.0:1746065140.798936:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aced880 00000100:00100000:3.0:1746065140.798952:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3397 00000100:00100000:3.0:1746065140.798959:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263251328:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065140.799871:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.800146:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251584 00000100:00100000:1.0:1746065140.800151:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251584 00002000:00100000:1.0:1746065140.800173:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009acece00 x1830881263251584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.800181:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acece00 with x1830881263251584 ext(1048576->2097151) 00002000:00010000:1.0:1746065140.800184:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acece00 00000100:00100000:1.0:1746065140.800210:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3398 00000100:00100000:1.0:1746065140.800216:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+34:2004:x1830881263251584:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065140.804765:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263251328:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 5797us (5988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.804797:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3397 00002000:00100000:3.0:1746065140.804807:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009aced880 x1830881263251328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.804816:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aced880 with x1830881263251328 ext(1048576->2097151) 00002000:00010000:3.0:1746065140.804821:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aced880 00000100:00100000:1.0:1746065140.806279:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+34:2004:x1830881263251584:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 6059us (6405us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065140.806287:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3398 00002000:00100000:1.0:1746065140.806293:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009acece00 x1830881263251584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.806304:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acece00 with x1830881263251584 ext(1048576->2097151) 00002000:00010000:1.0:1746065140.806307:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acece00 00000100:00100000:0.0:1746065140.812463:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.812510:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.812580:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251840 00000100:00100000:3.0:1746065140.812583:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251840 00000100:00100000:3.0:1746065140.812608:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12548 00000100:00100000:3.0:1746065140.812611:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263251840:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065140.812623:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.812636:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc146db85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932789 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065140.812674:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263233408:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065140.812834:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.814693:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:3.0:1746065140.815820:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065140 -> 1746065141 00000100:00100000:3.0:1746065140.815837:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263233408:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065140.815868:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc146db85 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932789 expref: 43 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.815880:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc146db85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932789 expref: 43 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065140.815895:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45800, rc 0) 00000100:00100000:3.0:1746065140.815937:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263251840:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3325us (3427us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065140.815942:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12548 00000100:00100000:0.0:1746065140.820645:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.820746:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252224 00000100:00100000:1.0:1746065140.820755:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252224 00002000:00100000:1.0:1746065140.820816:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88009856dc00 x1830881263252224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.820825:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856dc00 with x1830881263252224 ext(2097152->3145727) 00002000:00010000:1.0:1746065140.820829:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856dc00 00000100:00100000:1.0:1746065140.820924:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3399 00000100:00100000:1.0:1746065140.820932:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263252224:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065140.828278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.828400:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252608 00000100:00100000:3.0:1746065140.828407:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252608 00002000:00100000:3.0:1746065140.828439:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009856c380 x1830881263252608/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.828448:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c380 with x1830881263252608 ext(2097152->4194303) 00002000:00010000:3.0:1746065140.828452:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c380 00000100:00100000:3.0:1746065140.829912:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3400 00000100:00100000:3.0:1746065140.829927:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+35:2005:x1830881263252608:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065140.830844:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.831491:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252736 00000100:00100000:0.0:1746065140.831498:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252736 00002000:00100000:0.0:1746065140.831530:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff8800907bd880 x1830881263252736/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 504/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065140.831539:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd880 with x1830881263252736 ext(2097152->4194303) 00002000:00010000:0.0:1746065140.831544:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bd880 00000100:00100000:0.0:1746065140.831574:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3401 00000100:00100000:0.0:1746065140.831580:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263252736:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065140.832822:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263252224:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11888us (12181us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065140.832830:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3399 00002000:00100000:1.0:1746065140.832836:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88009856dc00 x1830881263252224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.832843:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856dc00 with x1830881263252224 ext(2097152->3145727) 00002000:00010000:1.0:1746065140.832846:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856dc00 00000100:00100000:0.0:1746065140.842053:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.843088:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+35:2005:x1830881263252608:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13162us (14814us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065140.843096:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3400 00002000:00100000:3.0:1746065140.843105:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009856c380 x1830881263252608/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.843113:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c380 with x1830881263252608 ext(2097152->4194303) 00002000:00010000:3.0:1746065140.843117:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c380 00000100:00100000:0.0:1746065140.847984:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.848178:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263252736:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16595us (17334us total) trans 0 rc 1830912/1830912 00000100:00100000:1.0:1746065140.848187:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3401 00002000:00100000:1.0:1746065140.848196:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff8800907bd880 x1830881263252736/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 504/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1830912/1830912 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.848205:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd880 with x1830881263252736 ext(2097152->4194303) 00010000:00010000:1.0:1746065140.848213:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 17 pid: 1880 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.848226:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 17 pid: 1880 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065140.848232:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bd880 00000100:00100000:1.0:1746065140.848249:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252992 00000100:00100000:1.0:1746065140.848254:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252992 00002000:00100000:1.0:1746065140.848278:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2691072->2957311) req@ffff88008f3e5880 x1830881263252992/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.848289:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5880 with x1830881263252992 ext(2691072->2957311) 00010000:00010000:1.0:1746065140.848293:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 17 pid: 1880 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.848299:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 17 pid: 1880 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065140.848304:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e5880 00000100:00100000:1.0:1746065140.848330:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1210 00000100:00100000:1.0:1746065140.848337:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263252992:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065140.848865:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.851608:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263252992:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3261us (3618us total) trans 17179873364 rc 0/0 00000100:00100000:1.0:1746065140.851616:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1210 00002000:00100000:1.0:1746065140.851625:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2691072->2957311) req@ffff88008f3e5880 x1830881263252992/t17179873364(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/448 e 0 to 0 dl 1746065151 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.851632:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5880 with x1830881263252992 ext(2691072->2957311) 00010000:00010000:1.0:1746065140.851640:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 20 pid: 1880 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746065140.851651:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 20 pid: 1880 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746065140.851657:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e5880 00000100:00100000:1.0:1746065140.855074:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.855134:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263253248 00000100:00100000:0.0:1746065140.855143:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263253248 00010000:00010000:0.0:1746065140.855172:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 20 pid: 1880 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746065140.855192:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5559 00000100:00100000:0.0:1746065140.855199:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263253248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065140.855209:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065140.855223:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 20 pid: 1880 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.855232:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 20 pid: 1880 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.855250:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146db54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2691072->2957311) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932758 expref: 20 pid: 1880 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746065140.855274:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.855275:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.855281:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146db93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932797 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.855288:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146db93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932797 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.855293:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.855294:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065140.855296:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146db9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93279e expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.855302:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146db9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93279e expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065140.855324:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146db9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93279e expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.855331:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263233664:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065140.855404:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146db93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932797 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065140.855411:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097faad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263233792:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065140.855427:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065140.861617:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.861687:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263253504 00000100:00100000:1.0:1746065140.861694:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263253504 00002000:00100000:1.0:1746065140.861730:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880097fa9f80 x1830881263253504/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.861738:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9f80 with x1830881263253504 ext(2097152->4194303) 00002000:00010000:1.0:1746065140.861743:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa9f80 00000100:00100000:1.0:1746065140.861768:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3402 00000100:00100000:1.0:1746065140.861799:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263253504:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065140.863733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.863787:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.863804:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263253888 00000100:00100000:3.0:1746065140.863810:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263253888 00002000:00100000:3.0:1746065140.863841:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097faad80 x1830881263253888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.863850:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faad80 with x1830881263253888 ext(3145728->4194303) 00002000:00010000:3.0:1746065140.863854:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097faad80 00000100:00100000:3.0:1746065140.863910:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263254016 00000100:00100000:3.0:1746065140.863913:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263254016 00002000:00100000:3.0:1746065140.863927:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099e11c00 x1830881263254016/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.863933:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11c00 with x1830881263254016 ext(2097152->4194303) 00002000:00010000:3.0:1746065140.863937:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e11c00 00000100:00100000:3.0:1746065140.863957:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3403 00000100:00100000:3.0:1746065140.863963:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263253888:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.864472:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3404 00000100:00100000:3.0:1746065140.864477:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263254016:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.879578:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263253888:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15605us (15840us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065140.879588:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3403 00002000:00100000:3.0:1746065140.879598:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097faad80 x1830881263253888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.879608:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faad80 with x1830881263253888 ext(3145728->4194303) 00002000:00010000:3.0:1746065140.879614:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097faad80 00010000:00010000:3.0:1746065140.887174:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065140.887350:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.888642:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263254016:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24163us (24868us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065140.888649:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3404 00002000:00100000:3.0:1746065140.888655:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099e11c00 x1830881263254016/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065140.888663:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11c00 with x1830881263254016 ext(2097152->4194303) 00002000:00010000:3.0:1746065140.888667:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e11c00 00000100:00100000:0.0:1746065140.898004:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.901492:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.902235:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.902358:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263254912 00000100:00100000:1.0:1746065140.902362:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263254912 00002000:00100000:1.0:1746065140.902378:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88009a6dc000 x1830881263254912/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/0 e 0 to 0 dl 1746065151 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065140.902386:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881263254912 ext(4194304->5021695) 00002000:00010000:1.0:1746065140.902389:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:1.0:1746065140.902410:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3406 00000100:00100000:1.0:1746065140.902416:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+35:2006:x1830881263254912:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065140.909965:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.910109:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263255168 00000100:00100000:1.0:1746065140.910116:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263255168 00000100:00100000:1.0:1746065140.910154:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4835 00000100:00100000:1.0:1746065140.910161:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+12:31884:x1830881263255168:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065140.910361:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+13:31884:x1830881263255168:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 199us (401us total) trans 8589935797 rc 0/0 00000100:00100000:1.0:1746065140.910367:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4835 00000100:00100000:0.0:1746065140.911108:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+35:2006:x1830881263254912:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8691us (8877us total) trans 0 rc 827392/827392 00000100:00100000:0.0:1746065140.911116:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3406 00002000:00100000:0.0:1746065140.911123:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88009a6dc000 x1830881263254912/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:56/0 lens 488/440 e 0 to 0 dl 1746065151 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065140.911131:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881263254912 ext(4194304->5021695) 00002000:00010000:0.0:1746065140.911136:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:1.0:1746065140.920599:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.923424:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.923536:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263255552 00000100:00100000:3.0:1746065140.923544:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263255552 00000100:00100000:3.0:1746065140.923584:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13500 00000100:00100000:3.0:1746065140.923592:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+28:31886:x1830881263255552:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065140.923609:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065140.923626:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc146dbcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9327ba expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.923686:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923698:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923707:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923717:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923722:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923727:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923824:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923832:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923837:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065140.923844:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065140.923900:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923905:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923910:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923915:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923919:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065140.923923:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923928:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923936:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065140.923939:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065140.923942:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.923947:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146dbd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.924075:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.924081:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.924085:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.924088:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065140.924090:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.924095:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.924101:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800ac4f4b00) 00010000:00010000:3.0:1746065140.924103:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065140.924105:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.924108:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146dbd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065140.924141:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc146dbcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 31 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.924150:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065140.924155:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065140.924157:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065140.924159:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:3.0:1746065140.925414:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+30:31886:x1830881263255552:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1818us (1992us total) trans 8589935798 rc 0/0 00000100:00100000:3.0:1746065140.925421:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13500 00000100:00100000:0.0:1746065140.928676:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065140.928757:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263255808 00000100:00100000:3.0:1746065140.928764:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263255808 00000100:00100000:3.0:1746065140.928936:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4836 00000100:00100000:3.0:1746065140.928945:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+30:31879:x1830881263255808:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065140.930169:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+31:31879:x1830881263255808:12345-192.168.202.27@tcp:35:cat.0 Request processed in 1222us (1496us total) trans 8589935799 rc 0/0 00000100:00100000:3.0:1746065140.930177:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4836 00000100:00100000:0.0:1746065140.936426:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.945535:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263256448 00000100:00100000:0.0:1746065140.945543:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263256448 00000100:00100000:0.0:1746065140.945890:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4838 00000100:00100000:0.0:1746065140.945898:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+13:31880:x1830881263256448:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065140.946084:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+14:31880:x1830881263256448:12345-192.168.202.27@tcp:35:cat.0 Request processed in 187us (633us total) trans 8589935801 rc 0/0 00000100:00100000:0.0:1746065140.946090:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4838 00000100:00100000:0.0:1746065140.990168:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.999178:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065140.999268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065140.999490:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263256704 00000100:00100000:1.0:1746065140.999499:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263256704 00010000:00010000:1.0:1746065140.999528:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146db9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93279e expref: 19 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065140.999610:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263256832 00000100:00100000:1.0:1746065140.999612:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263256832 00010000:00010000:1.0:1746065140.999624:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146db93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932797 expref: 44 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065140.999894:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5560 00000100:00100000:1.0:1746065140.999953:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263256704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065140.999965:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065140.999981:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146db9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93279e expref: 19 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065140.999992:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146db9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93279e expref: 19 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.000010:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc146db9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93279e expref: 19 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.002509:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.003130:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263256704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3227us (3955us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.003142:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5560 00000100:00100000:0.0:1746065141.006237:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.006275:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263257088 00000100:00100000:0.0:1746065141.006282:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263257088 00002000:00100000:0.0:1746065141.006323:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3178496->3182591) req@ffff880136a7b800 x1830881263257088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.006332:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b800 with x1830881263257088 ext(3178496->3182591) 00002000:00010000:0.0:1746065141.006336:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7b800 00000100:00100000:0.0:1746065141.006352:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3407 00000100:00100000:0.0:1746065141.006359:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881263257088:12345-192.168.202.27@tcp:3:multiop.0 00000100:00080000:1.0:1746065141.006373:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065141.006470:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881263257088:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 111us (240us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.006479:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3407 00002000:00100000:0.0:1746065141.006485:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3178496->3182591) req@ffff880136a7b800 x1830881263257088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.006492:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b800 with x1830881263257088 ext(3178496->3182591) 00002000:00010000:0.0:1746065141.006494:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7b800 00000100:00100000:0.0:1746065141.012671:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.026898:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065141.028218:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065141.035181:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc146da2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326d3 expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.035194:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc146da2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326d3 expref: 14 pid: 12260 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.035204:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263234944:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.035235:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.038754:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263234688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.038765:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263234816:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.038801:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263234944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.038827:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146dc03 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1806336->2097151] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327cf expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.038841:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd80a00, rc 0) 00000100:00100000:3.0:1746065141.038873:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+19:31884:x1830881263257472:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8911us (11983us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.038880:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12556 00000100:00100000:0.0:1746065141.039151:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.040258:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065141.040551:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065141.041103:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.045052:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.050696:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.050830:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263258240 00000100:00100000:3.0:1746065141.050837:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263258240 00000100:00100000:3.0:1746065141.050905:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12557 00000100:00100000:3.0:1746065141.050913:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+35:31884:x1830881263258240:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065141.050929:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.050943:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9327d6 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.050966:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 19 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.050974:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 36 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.050981:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 38 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.050986:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.050988:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.050991:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->1675263] (req 1048576->1675263) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.051027:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 38 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.051037:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 38 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.051048:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263235200:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.051126:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 36 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.051134:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 36 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.051142:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263235328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.051164:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 19 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.051171:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 19 pid: 12260 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.051179:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263235456:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.051192:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809540 going to sleep for 11 seconds 00000100:00080000:1.0:1746065141.051201:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065141.053462:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263235200:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.053523:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.053583:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263235328:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.053594:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263235456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.053618:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->1675263] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.053630:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00080000:1.0:1746065141.053658:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065141.053662:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+36:31884:x1830881263258240:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2750us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.053668:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12557 00000100:00100000:0.0:1746065141.055226:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263258752 00000100:00100000:0.0:1746065141.055230:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263258752 00010000:00010000:0.0:1746065141.055256:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 20 pid: 12260 timeout: 837 lvb_type: 1 00000100:00100000:0.0:1746065141.055284:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263258624 00000100:00100000:0.0:1746065141.055286:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263258624 00010000:00010000:0.0:1746065141.055296:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 39 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.055311:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263258880 00000100:00100000:0.0:1746065141.055313:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263258880 00010000:00010000:0.0:1746065141.055319:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 36 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.055334:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5565 00000100:00100000:0.0:1746065141.055339:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2004:x1830881263258752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.055347:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.055361:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 20 pid: 12260 timeout: 837 lvb_type: 1 00010000:00010000:0.0:1746065141.055373:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 20 pid: 12260 timeout: 837 lvb_type: 1 00010000:00010000:0.0:1746065141.055388:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc146da35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326da expref: 20 pid: 12260 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.055400:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5566 00010000:00010000:0.0:1746065141.055400:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.055406:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263258624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.055413:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065141.055421:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2004:x1830881263258752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (708us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065141.055423:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 39 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.055426:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5565 00010000:00010000:3.0:1746065141.055431:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 39 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.055438:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5567 00010000:00010000:3.0:1746065141.055442:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146db70 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932774 expref: 39 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.055443:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+36:2004:x1830881263258880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.055457:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.055460:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065141.055464:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 36 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.055472:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 36 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.055476:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263258624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.055484:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5566 00010000:00010000:0.0:1746065141.055487:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146db77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93277b expref: 36 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.055494:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.055496:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.055501:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.055509:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.055538:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.055548:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263235584:192.168.202.27@tcp:105: 00000100:00080000:3.0:1746065141.055560:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065141.055591:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.055819:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.055868:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259008 00000100:00100000:1.0:1746065141.055871:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259008 00000100:00100000:0.0:1746065141.056175:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.056224:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.056538:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 707 00000100:00100000:1.0:1746065141.056546:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263259008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.056553:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.056566:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a54ae00/0xad6b7ddc146dc26 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327dd expref: 34 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.056580:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.056583:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.056603:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263259008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.056608:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 707 00000100:00100000:3.0:1746065141.057229:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259264 00000100:00100000:3.0:1746065141.057233:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259264 00000100:00100000:0.0:1746065141.057236:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263235584:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065141.057247:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.057256:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259136 00000100:00100000:3.0:1746065141.057258:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259136 00000100:00100000:0.0:1746065141.057263:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+35:2004:x1830881263258880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1820us (2206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.057270:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5567 00000100:00100000:3.0:1746065141.057271:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12558 00000100:00100000:3.0:1746065141.057275:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263259264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.057287:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.057295:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc146dc34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9327eb expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.057323:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263235712:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065141.057359:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809540 going to sleep for 11 seconds 00002000:00010000:3.0:1746065141.059646:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746065140 -> 1746065141 00002000:00010000:3.0:1746065141.059651:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065140 -> 1746065141 00002000:00010000:3.0:1746065141.059653:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746065140 -> 1746065141 00000100:00100000:3.0:1746065141.059668:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263235712:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065141.059690:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc146dc34 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327eb expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.059701:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc146dc34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327eb expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.059710:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488600, rc 0) 00000100:00100000:3.0:1746065141.059740:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263259264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2464us (3564us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065141.059749:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12558 00000100:00100000:0.0:1746065141.062215:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.070537:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.070568:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.070621:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263260032 00000100:00100000:3.0:1746065141.070630:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263260032 00002000:00100000:3.0:1746065141.070662:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880135223480 x1830881263260032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.070671:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223480 with x1830881263260032 ext(0->1048575) 00002000:00010000:3.0:1746065141.070676:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135223480 00000100:00100000:3.0:1746065141.070689:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259904 00000100:00100000:3.0:1746065141.070692:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259904 00002000:00100000:3.0:1746065141.070702:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880135220a80 x1830881263259904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 504/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.070708:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220a80 with x1830881263259904 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.070711:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220a80 00000100:00100000:3.0:1746065141.070922:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3411 00000100:00100000:3.0:1746065141.070929:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263260032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065141.078460:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263260032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7524us (7922us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.078513:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3411 00002000:00100000:3.0:1746065141.078523:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880135223480 x1830881263260032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.078530:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223480 with x1830881263260032 ext(0->1048575) 00002000:00010000:3.0:1746065141.078535:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135223480 00000100:00100000:0.0:1746065141.088113:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.092321:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.092383:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263260288 00000100:00100000:3.0:1746065141.092390:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263260288 00002000:00100000:3.0:1746065141.092427:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1806336->2097151) req@ffff8800907bc380 x1830881263260288/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.092435:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc380 with x1830881263260288 ext(1806336->2097151) 00010000:00010000:3.0:1746065141.092441:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146dc03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327cf expref: 18 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.092454:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146dc03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327cf expref: 18 pid: 13375 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.092460:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bc380 00000100:00100000:3.0:1746065141.092483:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1211 00000100:00100000:3.0:1746065141.092490:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263260288:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065141.096684:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263260288:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 4186us (4362us total) trans 17179873365 rc 0/0 00000100:00100000:3.0:1746065141.096693:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1211 00002000:00100000:3.0:1746065141.096702:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1806336->2097151) req@ffff8800907bc380 x1830881263260288/t17179873365(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.096710:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc380 with x1830881263260288 ext(1806336->2097151) 00010000:00010000:3.0:1746065141.096719:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146dc03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327cf expref: 20 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.096731:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd80a00/0xad6b7ddc146dc03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327cf expref: 20 pid: 13375 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.096736:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bc380 00000100:00100000:0.0:1746065141.102990:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.107103:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.107189:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263260672 00000100:00100000:3.0:1746065141.107195:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263260672 00002000:00100000:3.0:1746065141.107233:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88008c528380 x1830881263260672/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.107242:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528380 with x1830881263260672 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.107246:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c528380 00000100:00100000:3.0:1746065141.107738:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3413 00000100:00100000:3.0:1746065141.107747:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263260672:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065141.114219:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263260672:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6464us (7112us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.114230:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3413 00002000:00100000:3.0:1746065141.114240:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88008c528380 x1830881263260672/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.114249:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528380 with x1830881263260672 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.114254:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c528380 00000100:00100000:0.0:1746065141.118227:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.121330:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.121416:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263260928 00000100:00100000:3.0:1746065141.121422:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263260928 00002000:00100000:3.0:1746065141.121455:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1675263) req@ffff88008c529180 x1830881263260928/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.121462:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529180 with x1830881263260928 ext(1048576->1675263) 00010000:00010000:3.0:1746065141.121469:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 35 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.121481:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 35 pid: 13375 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.121490:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c529180 00000100:00100000:3.0:1746065141.121504:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1212 00000100:00100000:3.0:1746065141.121510:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+35:2004:x1830881263260928:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065141.130035:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263260928:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 8506us (8689us total) trans 21474840807 rc 0/0 00000100:00100000:3.0:1746065141.130045:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1212 00002000:00100000:3.0:1746065141.130054:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1675263) req@ffff88008c529180 x1830881263260928/t21474840807(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.130064:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529180 with x1830881263260928 ext(1048576->1675263) 00010000:00010000:3.0:1746065141.130073:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 37 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.130086:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146dc0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327d6 expref: 37 pid: 13375 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.130093:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c529180 00000100:00100000:0.0:1746065141.134815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065141.135281:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.135292:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.135322:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.135334:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263236352:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065141.135942:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.137373:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263236352:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065141.137387:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.137498:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+36:2005:x1830881263261056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2314us (3291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.137506:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5569 00000100:00100000:0.0:1746065141.140269:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.140369:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261312 00000100:00100000:3.0:1746065141.140376:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261312 00002000:00100000:3.0:1746065141.140415:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009077ca80 x1830881263261312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.140423:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ca80 with x1830881263261312 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.140428:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ca80 00000100:00100000:3.0:1746065141.140482:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3414 00000100:00100000:3.0:1746065141.140489:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263261312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065141.147088:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263261312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6590us (6818us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.147099:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3414 00002000:00100000:3.0:1746065141.147108:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009077ca80 x1830881263261312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.147117:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ca80 with x1830881263261312 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.147122:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ca80 00000100:00100000:0.0:1746065141.157511:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.158114:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261568 00000100:00100000:3.0:1746065141.158122:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261568 00002000:00100000:3.0:1746065141.158158:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009077dc00 x1830881263261568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 504/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.158166:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881263261568 ext(2097152->4194303) 00002000:00010000:3.0:1746065141.158171:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:3.0:1746065141.158188:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3415 00000100:00100000:3.0:1746065141.158194:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263261568:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065141.170601:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263261568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12398us (13088us total) trans 0 rc 1548288/1548288 00000100:00100000:3.0:1746065141.170610:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3415 00002000:00100000:3.0:1746065141.170620:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009077dc00 x1830881263261568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 504/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1548288/1548288 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.170629:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881263261568 ext(2097152->4194303) 00002000:00010000:3.0:1746065141.170634:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:0.0:1746065141.171819:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.171952:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261824 00000100:00100000:2.0:1746065141.171960:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261824 00000100:00100000:2.0:1746065141.172399:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13502 00000100:00100000:2.0:1746065141.172407:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+14:31896:x1830881263261824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.172426:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.172441:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146dc50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932800 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.172503:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172514:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172523:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172534:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172538:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172543:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172617:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146dc65 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172626:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146dc65 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172631:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146dc65 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065141.172639:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065141.172692:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172698:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172702:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172707:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172712:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065141.172715:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172721:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172730:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065141.172733:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065141.172736:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.172740:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146dc57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00000100:00080000:3.0:1746065141.173451:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065141.174517:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.174527:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.174533:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.174538:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993fc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065141.174541:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.174545:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.174556:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091b5d600) 00010000:00010000:2.0:1746065141.174558:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065141.174561:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.174569:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146dc5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.174614:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e400/0xad6b7ddc146dc50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932800 expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.174625:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146dc65 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932800 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.174630:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065141.174632:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065141.174634:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fe00, rc 0) 00000100:00100000:2.0:1746065141.174701:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+16:31896:x1830881263261824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2294us (2884us total) trans 8589935803 rc 0/0 00000100:00100000:2.0:1746065141.174710:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13502 00000100:00100000:0.0:1746065141.179888:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.180551:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.180924:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261952 00000100:00100000:2.0:1746065141.180931:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261952 00000100:00100000:2.0:1746065141.180979:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 708 00000100:00100000:2.0:1746065141.180985:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a850ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263261952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.181000:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.181028:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146dc65 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932800 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.181050:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065141.181053:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.181087:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a850ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263261952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.181096:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 708 00000100:00100000:3.0:1746065141.181880:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262080 00000100:00100000:3.0:1746065141.181885:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262080 00000100:00100000:3.0:1746065141.181977:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12562 00000100:00100000:3.0:1746065141.181982:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263262080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.181993:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.182005:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc146dc73 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932807 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.182053:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263236480:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065141.182321:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.182981:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.183513:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.183552:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.183616:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262208 00000100:00100000:3.0:1746065141.183622:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262208 00000100:00100000:3.0:1746065141.183653:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262336 00000100:00100000:3.0:1746065141.183656:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262336 00000100:00100000:3.0:1746065141.183667:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262464 00000100:00100000:3.0:1746065141.183669:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262464 00000100:00100000:3.0:1746065141.184207:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12563 00000100:00100000:3.0:1746065141.184215:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263262208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.184227:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.184238:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93280e expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.184255:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.184256:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.184263:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.184276:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.184286:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45600, rc 0) 00000100:00100000:3.0:1746065141.184321:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263262208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 106us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.184326:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12563 00000100:00100000:3.0:1746065141.184340:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12564 00000100:00100000:3.0:1746065141.184344:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+36:2004:x1830881263262336:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.184350:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.184357:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932815 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.184369:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.184370:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.184374:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.184384:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.184390:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45e00, rc 0) 00000100:00100000:3.0:1746065141.184404:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263262336:12345-192.168.202.27@tcp:101:cat.0 Request processed in 60us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.184409:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12564 00000100:00100000:3.0:1746065141.184418:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12565 00000100:00100000:3.0:1746065141.184422:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263262464:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.184429:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.184435:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146dc88 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93281c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.184464:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263236608:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065141.184497:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.184994:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263236480:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065141.185013:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc146dc73 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932807 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.185034:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc146dc73 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932807 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.185043:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd81200, rc 0) 00000100:00100000:2.0:1746065141.185075:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263262080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3092us (4524us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065141.185080:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12562 00000100:00100000:0.0:1746065141.186798:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.186960:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262720 00000100:00100000:2.0:1746065141.186966:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262720 00000100:00100000:2.0:1746065141.186997:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4839 00000100:00100000:2.0:1746065141.187004:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+33:31892:x1830881263262720:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065141.187165:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+34:31892:x1830881263262720:12345-192.168.202.27@tcp:35:cat.0 Request processed in 160us (395us total) trans 8589935804 rc 0/0 00000100:00100000:2.0:1746065141.187171:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4839 00002000:00010000:3.0:1746065141.187448:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065140 -> 1746065141 00002000:00010000:3.0:1746065141.187452:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065140 -> 1746065141 00000100:00100000:3.0:1746065141.187464:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263236608:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065141.187484:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146dc88 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93281c expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.187495:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146dc88 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93281c expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.187515:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45c00, rc 0) 00000100:00100000:3.0:1746065141.187546:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263262464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3123us (3993us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065141.187552:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12565 00000100:00100000:0.0:1746065141.194848:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.197326:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262976 00000100:00100000:3.0:1746065141.197337:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262976 00002000:00100000:3.0:1746065141.197379:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880099cf1880 x1830881263262976/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.197387:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1880 with x1830881263262976 ext(0->1048575) 00002000:00010000:3.0:1746065141.197392:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf1880 00000100:00100000:3.0:1746065141.197418:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3416 00000100:00100000:3.0:1746065141.197425:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263262976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.198795:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.198830:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.198850:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263360 00000100:00100000:0.0:1746065141.198854:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263360 00000100:00100000:0.0:1746065141.198889:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263104 00000100:00100000:0.0:1746065141.198891:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263104 00000100:00100000:0.0:1746065141.198911:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13503 00000100:00100000:0.0:1746065141.198917:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+15:31898:x1830881263263360:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065141.198932:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.198946:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146dc8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93282a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.199007:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199031:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199040:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199050:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199056:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199060:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199136:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146dca4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199145:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199150:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:0.0:1746065141.199157:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:1.0:1746065141.199188:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13504 00000100:00100000:1.0:1746065141.199195:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:31900:x1830881263263104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065141.199205:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.199212:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04a000/0xad6b7ddc146dcb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932823 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.199213:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199219:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199228:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199234:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065141.199238:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.199238:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065141.199241:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065141.199244:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.199250:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.199251:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065141.199256:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.199259:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065141.199260:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.199261:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065141.199264:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.199264:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199266:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146dc96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199276:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199278:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199281:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199283:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bfe00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065141.199285:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065141.199288:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.199292:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065141.199295:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93270b expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.199297:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098c65e00) 00010000:00010000:0.0:1746065141.199299:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065141.199300:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.199300:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065141.199304:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfe00/0xad6b7ddc146dc9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065141.199305:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.199328:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.199329:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146dc8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93282a expref: 18 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.199336:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 17 pid: 9571 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.199343:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146dca4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93282a expref: 17 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.199345:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263236736:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065141.199348:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065141.199350:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065141.199352:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.199357:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.199361:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:0.0:1746065141.199383:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+17:31898:x1830881263263360:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 465us (592us total) trans 8589935805 rc 0/0 00000100:00100000:0.0:1746065141.199388:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13503 00010000:00010000:1.0:1746065141.199403:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93270b expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.199410:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93270b expref: 33 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.199417:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263236864:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065141.199433:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b000 going to sleep for 11 seconds 00000100:00080000:3.0:1746065141.199513:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065141.207520:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.208278:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.208474:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263616 00000100:00100000:2.0:1746065141.208482:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263616 00000100:00100000:2.0:1746065141.208516:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263872 00000100:00100000:2.0:1746065141.208518:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263872 00000100:00100000:2.0:1746065141.208528:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4840 00000100:00100000:2.0:1746065141.208535:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+17:30399:x1830881263263616:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065141.208557:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4841 00000100:00100000:3.0:1746065141.208566:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+34:30397:x1830881263263872:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065141.208729:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263236736:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065141.208738:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263236864:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.208758:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065141.208812:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+35:30397:x1830881263263872:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 246us (532us total) trans 8589935807 rc 0/0 00000100:00100000:3.0:1746065141.208818:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4841 00000100:00100000:0.0:1746065141.208973:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.209001:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263262976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11575us (14161us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.209008:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3416 00002000:00100000:3.0:1746065141.209026:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880099cf1880 x1830881263262976/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.209034:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1880 with x1830881263262976 ext(0->1048575) 00002000:00010000:3.0:1746065141.209039:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf1880 00000100:00100000:3.0:1746065141.209062:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264000 00000100:00100000:3.0:1746065141.209065:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264000 00000100:00100000:3.0:1746065141.209085:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 709 00000100:00100000:3.0:1746065141.209090:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263264000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.209097:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.209113:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146dca4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93282a expref: 19 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.209125:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.209129:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.209136:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.209140:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.209145:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.209162:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263264000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.209167:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 709 00000100:00100000:2.0:1746065141.209345:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+17:30399:x1830881263263616:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 809us (1831us total) trans 8589935806 rc 0/0 00000100:00100000:2.0:1746065141.209351:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4840 00000100:00100000:1.0:1746065141.212382:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.212449:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.212498:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264128 00000100:00100000:3.0:1746065141.212506:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264128 00010000:00010000:3.0:1746065141.212531:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93270b expref: 35 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.212560:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264256 00000100:00100000:3.0:1746065141.212563:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264256 00010000:00010000:3.0:1746065141.212573:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 17 pid: 9571 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.212588:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5570 00000100:00100000:3.0:1746065141.212594:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263264128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.212605:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.212611:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93270b expref: 35 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.212620:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93270b expref: 35 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.212642:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc146dae4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93270b expref: 35 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.212653:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.212657:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212664:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212668:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212672:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.212703:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263264128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.212709:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5570 00000100:00100000:3.0:1746065141.212721:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5571 00000100:00100000:3.0:1746065141.212726:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263264256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.212734:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.212738:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 17 pid: 9571 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.212746:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 17 pid: 9571 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.212755:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6000/0xad6b7ddc146db00 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932719 expref: 17 pid: 9571 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.212767:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.212770:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212793:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212798:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212814:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.212828:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263264256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.212834:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5571 00010000:00010000:3.0:1746065141.212848:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212853:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065141.212891:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065141.212894:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065141.212907:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212916:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212926:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212931:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212936:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212940:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212944:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f04b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065141.212947:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212952:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212960:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065141.212962:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065141.212964:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212969:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc146dcb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212976:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212980:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212984:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212988:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dda00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065141.212990:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.212996:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.213001:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098c65e00) 00010000:00010000:3.0:1746065141.213003:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065141.213005:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.213008:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dcc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.213043:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04a000/0xad6b7ddc146dcb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.213052:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.213057:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.213059:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065141.213060:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd200, rc 0) 00000100:00100000:3.0:1746065141.213082:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31900:x1830881263263104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 13888us (14253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.213087:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13504 00000100:00100000:0.0:1746065141.215142:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.215278:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264384 00000100:00100000:3.0:1746065141.215284:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264384 00000100:00100000:3.0:1746065141.215320:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12566 00000100:00100000:3.0:1746065141.215325:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263264384:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065141.215338:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.215350:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc146dcce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932831 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.215395:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263236992:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065141.215969:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.215987:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264512 00000100:00100000:0.0:1746065141.215990:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264512 00000100:00100000:0.0:1746065141.216009:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12567 00000100:00100000:0.0:1746065141.216023:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263264512:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065141.216031:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.216040:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932838 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.216770:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.216791:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.216799:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.216811:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.216819:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112400, rc 0) 00000100:00100000:0.0:1746065141.216841:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263264512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 826us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.216847:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12567 00000100:00100000:0.0:1746065141.216904:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.216919:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264640 00000100:00100000:0.0:1746065141.216921:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264640 00000100:00100000:0.0:1746065141.216941:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12568 00000100:00100000:0.0:1746065141.216947:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2006:x1830881263264640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065141.216955:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.216964:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93283f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.216976:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.216977:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.216981:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.216990:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.216996:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4400, rc 0) 00000100:00100000:0.0:1746065141.217009:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2006:x1830881263264640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 62us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.217013:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12568 00000100:00100000:3.0:1746065141.218222:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.218390:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.218431:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264768 00000100:00100000:2.0:1746065141.218435:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264768 00000100:00100000:1.0:1746065141.218456:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.218649:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264896 00000100:00100000:2.0:1746065141.218652:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264896 00000100:00100000:2.0:1746065141.218667:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12569 00000100:00100000:2.0:1746065141.218672:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2007:x1830881263264768:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065141.218680:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.218688:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc146dce3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932846 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.218721:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263237120:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065141.218765:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.218796:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12570 00000100:00100000:2.0:1746065141.218803:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+20:31896:x1830881263264896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.218810:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.218817:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93284d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.218833:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 42 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.218839:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.218841:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.218844:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.218860:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 42 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.218870:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 42 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.218878:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263237248:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.218907:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.219973:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263236992:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065141.219993:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc146dcce lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932831 expref: 18 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.220001:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc146dcce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932831 expref: 18 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.220009:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44600, rc 0) 00000100:00100000:3.0:1746065141.220055:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2007:x1830881263264384:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4728us (4917us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065141.220061:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12566 00000100:00100000:2.0:1746065141.221147:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263237120:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065141.221163:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc146dce3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932846 expref: 16 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.221172:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc146dce3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932846 expref: 16 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.221178:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fe00, rc 0) 00000100:00100000:2.0:1746065141.221507:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263264768:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2833us (3209us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065141.221513:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12569 00000100:00100000:1.0:1746065141.221656:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.221798:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265024 00000100:00100000:3.0:1746065141.221803:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265024 00002000:00100000:3.0:1746065141.221831:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1183744->1667071) req@ffff8800907bfb80 x1830881263265024/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.221840:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bfb80 with x1830881263265024 ext(1183744->1667071) 00010000:00010000:3.0:1746065141.221845:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 43 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.221856:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 43 pid: 9550 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.221866:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bfb80 00000100:00100000:3.0:1746065141.221882:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1213 00000100:00100000:2.0:1746065141.221886:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263237248:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.221888:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263265024:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:2.0:1746065141.222360:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.222376:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:2.0:1746065141.222413:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+21:31896:x1830881263264896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3611us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.222418:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12570 00000100:00100000:0.0:1746065141.224855:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.226218:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265280 00000100:00100000:2.0:1746065141.226227:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265280 00000100:00100000:2.0:1746065141.226279:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13505 00000100:00100000:2.0:1746065141.226287:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:31900:x1830881263265280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065141.226302:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.226317:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146dcf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932854 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.226401:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065141.226414:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.226422:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065141.226448:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.226456:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 8 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.226466:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263237376:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.226540:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.227051:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881263265024:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5161us (5395us total) trans 17179873366 rc 0/0 00000100:00100000:3.0:1746065141.227059:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1213 00002000:00100000:3.0:1746065141.227067:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1183744->1667071) req@ffff8800907bfb80 x1830881263265024/t17179873366(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.227075:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bfb80 with x1830881263265024 ext(1183744->1667071) 00010000:00010000:3.0:1746065141.227081:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 45 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.227090:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 45 pid: 9550 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.227095:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bfb80 00000100:00100000:2.0:1746065141.228762:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263237376:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.228801:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065141.228921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.229388:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.229671:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265408 00000100:00100000:2.0:1746065141.229676:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265408 00010000:00010000:2.0:1746065141.229702:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.229914:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265536 00000100:00100000:2.0:1746065141.229917:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265536 00010000:00010000:2.0:1746065141.229930:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 45 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.229986:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5572 00000100:00100000:1.0:1746065141.229995:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263265408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.230006:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.230012:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.230030:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.230053:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dcc7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932823 expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.230077:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.230081:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.230090:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.230096:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.230111:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.230141:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263265408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 148us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.230147:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5572 00000100:00100000:1.0:1746065141.230161:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5573 00000100:00100000:1.0:1746065141.230166:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881263265536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.230172:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.230188:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 45 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.230196:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 45 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.230208:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc146db5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1183744->1667071) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932766 expref: 45 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.230222:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.230224:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.230228:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.230235:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.230254:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.230265:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263237504:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065141.230306:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b000 going to sleep for 11 seconds 00010000:00010000:1.0:1746065141.230317:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.230323:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065141.230335:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065141.230421:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146dcf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.230431:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.230436:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.230439:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065141.230441:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4a00, rc 0) 00000100:00100000:1.0:1746065141.230463:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31900:x1830881263265280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4178us (5613us total) trans 8589935808 rc 0/0 00000100:00100000:1.0:1746065141.230468:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13505 00000100:00100000:1.0:1746065141.238813:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263237504:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065141.238831:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.238868:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881263265536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8701us (9479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.238878:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5573 00000100:00100000:0.0:1746065141.239089:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.239421:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265664 00000100:00100000:1.0:1746065141.239426:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265664 00000100:00100000:1.0:1746065141.239524:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13506 00000100:00100000:1.0:1746065141.239531:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31900:x1830881263265664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065141.239548:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.239563:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146dd06 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93285b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.239632:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.239644:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.239650:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.239672:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.239687:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.239696:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263237632:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065141.240717:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.247405:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.249155:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.249284:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265920 00000100:00100000:3.0:1746065141.249293:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265920 00002000:00100000:3.0:1746065141.249331:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012dc3f480 x1830881263265920/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.249340:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f480 with x1830881263265920 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.249344:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3f480 00000100:00100000:3.0:1746065141.249377:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3417 00000100:00100000:3.0:1746065141.249385:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263265920:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.250284:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.250310:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266176 00000100:00100000:0.0:1746065141.250314:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266176 00002000:00100000:0.0:1746065141.250330:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88008f7fed80 x1830881263266176/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.250342:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881263266176 ext(1048576->2097151) 00002000:00010000:0.0:1746065141.250345:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fed80 00000100:00100000:0.0:1746065141.250355:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266432 00000100:00100000:0.0:1746065141.250357:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266432 00002000:00100000:0.0:1746065141.250374:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88008f7fd880 x1830881263266432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.250380:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd880 with x1830881263266432 ext(1048576->2097151) 00002000:00010000:0.0:1746065141.250383:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd880 00000100:00100000:0.0:1746065141.251615:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3418 00000100:00100000:0.0:1746065141.251626:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263266176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065141.251800:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3419 00000100:00100000:2.0:1746065141.251807:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+37:2007:x1830881263266432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065141.256148:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.256220:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263237632:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065141.256245:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065141.257167:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266560 00000100:00100000:1.0:1746065141.257176:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266560 00010000:00010000:1.0:1746065141.257222:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 10 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.257271:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5574 00000100:00100000:1.0:1746065141.257281:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263266560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.257300:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.257307:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 10 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.257320:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 10 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.257345:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146dcf8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932854 expref: 10 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.257380:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.257385:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.257395:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.257404:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.257419:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.257476:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263266560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 196us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.257484:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5574 00010000:00010000:0.0:1746065141.257583:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.257589:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065141.257640:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:0.0:1746065141.257644:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065141.257661:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.257691:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146dd06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.257721:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.257727:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065141.257730:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065141.257732:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bef600, rc 0) 00000100:00100000:0.0:1746065141.257755:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31900:x1830881263265664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 18225us (18667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.257761:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13506 00000100:00100000:3.0:1746065141.261705:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263265920:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12309us (14296us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.261715:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3417 00002000:00100000:3.0:1746065141.261726:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012dc3f480 x1830881263265920/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.261736:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f480 with x1830881263265920 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.261742:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3f480 00000100:00100000:2.0:1746065141.265337:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+37:2007:x1830881263266432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13521us (15045us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065141.265348:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3419 00002000:00100000:2.0:1746065141.265358:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88008f7fd880 x1830881263266432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.265376:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd880 with x1830881263266432 ext(1048576->2097151) 00002000:00010000:2.0:1746065141.265382:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd880 00000100:00100000:2.0:1746065141.270197:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263266176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18566us (21039us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065141.270207:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3418 00002000:00100000:2.0:1746065141.270218:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88008f7fed80 x1830881263266176/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.270227:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881263266176 ext(1048576->2097151) 00002000:00010000:2.0:1746065141.270232:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fed80 00000100:00100000:0.0:1746065141.272992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.273040:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.273076:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.273109:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266816 00000100:00100000:0.0:1746065141.273116:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266816 00000100:00100000:0.0:1746065141.273144:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266688 00000100:00100000:0.0:1746065141.273145:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266688 00000100:00100000:0.0:1746065141.273156:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12571 00000100:00100000:0.0:1746065141.273162:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263266816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065141.273175:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.273187:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc146dd14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932869 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.273229:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263237760:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065141.273289:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.273306:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12572 00000100:00100000:0.0:1746065141.273311:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263266688:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065141.273318:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.273325:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932862 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.273335:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.273336:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.273343:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.273355:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.273364:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa8ea00, rc 0) 00000100:00100000:0.0:1746065141.273383:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2006:x1830881263266688:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.273388:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12572 00000100:00100000:1.0:1746065141.273447:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267072 00000100:00100000:1.0:1746065141.273450:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267072 00000100:00100000:1.0:1746065141.273484:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13507 00000100:00100000:1.0:1746065141.273489:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+34:31902:x1830881263267072:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065141.273500:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.273511:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932870 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.273564:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273574:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273581:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273590:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273595:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273600:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273670:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273677:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273682:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065141.273689:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065141.273739:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273745:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273750:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273755:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273759:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065141.273762:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273767:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273797:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065141.273800:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065141.273803:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273811:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273822:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273827:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273831:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273835:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065141.273837:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273841:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273846:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5800) 00010000:00010000:1.0:1746065141.273848:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065141.273850:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273854:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.273881:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 37 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.273889:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 36 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.273904:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.273906:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065141.273908:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524000, rc 0) 00000100:00100000:1.0:1746065141.273926:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+36:31902:x1830881263267072:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 437us (940us total) trans 8589935809 rc 0/0 00000100:00100000:1.0:1746065141.273931:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13507 00000100:00100000:2.0:1746065141.279622:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263237760:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065141.279653:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc146dd14 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932869 expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.279667:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc146dd14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932869 expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.279680:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5600, rc 0) 00000100:00100000:2.0:1746065141.279932:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263266816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6767us (6889us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065141.279941:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12571 00000100:00100000:0.0:1746065141.290278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.290485:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267328 00000100:00100000:1.0:1746065141.290494:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267328 00000100:00100000:1.0:1746065141.290548:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13508 00000100:00100000:1.0:1746065141.290555:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31900:x1830881263267328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065141.290571:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.290587:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932877 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.290674:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290687:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290694:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290703:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290708:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290715:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290719:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835d000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065141.290721:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290726:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290734:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.290736:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065141.290739:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290744:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc146dd4c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.290800:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd45 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932877 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.290806:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc146dd45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932877 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.290813:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:1.0:1746065141.290851:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31900:x1830881263267328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 297us (582us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.290856:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13508 00000100:00100000:0.0:1746065141.291185:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.291452:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267456 00000100:00100000:2.0:1746065141.291457:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267456 00000100:00100000:2.0:1746065141.291485:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12573 00000100:00100000:2.0:1746065141.291491:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+21:31896:x1830881263267456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.291499:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.291508:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93287e expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.291523:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 43 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.291531:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.291533:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.291536:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.291559:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 43 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.291568:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 43 pid: 13375 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.291578:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263237888:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.291625:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.295514:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.295558:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267712 00000100:00100000:2.0:1746065141.295566:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267712 00000100:00100000:2.0:1746065141.295616:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4842 00000100:00100000:2.0:1746065141.295624:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+36:31902:x1830881263267712:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065141.297394:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:31902:x1830881263267712:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1765us (1879us total) trans 8589935810 rc 0/0 00000100:00100000:2.0:1746065141.297403:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4842 00000100:00100000:0.0:1746065141.297474:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.297756:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263237888:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.297805:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.297820:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b800, rc 0) 00000100:00100000:3.0:1746065141.297851:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:31896:x1830881263267456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6360us (6666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.297857:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12573 00000100:00100000:2.0:1746065141.297980:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267968 00000100:00100000:2.0:1746065141.297985:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267968 00000100:00100000:2.0:1746065141.298007:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4843 00000100:00100000:2.0:1746065141.298012:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31900:x1830881263267968:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065141.298137:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31900:x1830881263267968:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 124us (664us total) trans 8589935811 rc 0/0 00000100:00100000:2.0:1746065141.298143:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4843 00000100:00100000:0.0:1746065141.308518:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.308854:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268096 00000100:00100000:2.0:1746065141.308861:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268096 00002000:00100000:2.0:1746065141.308898:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3178496->3948543) req@ffff880097241880 x1830881263268096/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.308907:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097241880 with x1830881263268096 ext(3178496->3948543) 00010000:00010000:2.0:1746065141.308916:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 44 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.308927:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 44 pid: 13375 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.308933:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097241880 00000100:00100000:2.0:1746065141.309027:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1214 00000100:00100000:2.0:1746065141.309035:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263268096:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065141.325804:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.325894:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268224 00000100:00100000:3.0:1746065141.325903:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268224 00000100:00100000:3.0:1746065141.325955:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12574 00000100:00100000:3.0:1746065141.325962:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+37:31898:x1830881263268224:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065141.325977:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.325992:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932885 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.326025:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.326033:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.326038:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 38 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.326044:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.326046:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.326048:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1323008->2002943] (req 1323008->2002943) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.326071:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 38 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.326079:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 38 pid: 9549 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.326089:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263238016:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.326164:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.326171:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 19 pid: 13375 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.326193:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263238144:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.327142:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.327153:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 38 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.327162:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263238272:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.327197:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.327656:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263238016:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.330728:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263238144:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.330739:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263238272:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.330767:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1323008->2002943] (req 1323008->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.330813:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9eb7000, rc 0) 00000100:00100000:3.0:1746065141.331248:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+38:31898:x1830881263268224:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5284us (5448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.331248:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881263268096:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 22212us (22735us total) trans 17179873367 rc 0/0 00000100:00100000:3.0:1746065141.331255:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12574 00000100:00100000:2.0:1746065141.331257:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1214 00002000:00100000:2.0:1746065141.331265:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3178496->3948543) req@ffff880097241880 x1830881263268096/t17179873367(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.331275:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097241880 with x1830881263268096 ext(3178496->3948543) 00010000:00010000:2.0:1746065141.331282:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 46 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.331297:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 46 pid: 13375 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.331304:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097241880 00000100:00100000:0.0:1746065141.333287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.333318:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.333349:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.333420:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268352 00000100:00100000:2.0:1746065141.333427:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268352 00010000:00010000:2.0:1746065141.333453:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 38 pid: 9549 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.333473:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268608 00000100:00100000:2.0:1746065141.333475:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268608 00010000:00010000:2.0:1746065141.333486:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.333498:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268480 00000100:00100000:2.0:1746065141.333499:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268480 00010000:00010000:2.0:1746065141.333507:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 20 pid: 13375 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.333520:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5575 00000100:00100000:2.0:1746065141.333525:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+38:2004:x1830881263268352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.333536:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.333552:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 38 pid: 9549 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.333560:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 38 pid: 9549 timeout: 837 lvb_type: 1 00000100:00100000:1.0:1746065141.333569:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5576 00000100:00100000:1.0:1746065141.333577:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263268608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.333578:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146dc81 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932815 expref: 38 pid: 9549 timeout: 837 lvb_type: 1 00010000:00010000:1.0:1746065141.333585:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.333591:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065141.333594:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.333603:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.333614:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146dc49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f9 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.333627:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.333637:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263268352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.333643:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5575 00000100:00100000:1.0:1746065141.333643:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263268608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.333648:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5576 00000100:00100000:1.0:1746065141.333659:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5577 00000100:00100000:1.0:1746065141.333664:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2004:x1830881263268480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.333669:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.333674:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 20 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:1.0:1746065141.333680:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 20 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:1.0:1746065141.333690:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc146dcdc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93283f expref: 20 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:1.0:1746065141.333701:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.333702:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.333708:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.333714:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.333736:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.333745:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263238400:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065141.333800:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.336713:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.337047:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.337158:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268736 00000100:00100000:3.0:1746065141.337166:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268736 00010000:00010000:3.0:1746065141.337192:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 46 pid: 13375 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.337317:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263238400:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065141.337331:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065141.337361:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2004:x1830881263268480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3696us (4011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.337368:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5577 00000100:00100000:0.0:1746065141.337386:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5578 00000100:00100000:0.0:1746065141.337392:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881263268736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.337402:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.337417:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 46 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.337427:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 46 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.337444:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146dbfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->3727359) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327c8 expref: 46 pid: 13375 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.337465:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.337467:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.337473:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.337480:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.337504:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.337514:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263238528:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065141.337550:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.338146:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268992 00000100:00100000:2.0:1746065141.338150:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268992 00002000:00100000:2.0:1746065141.338175:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->1327103) req@ffff8800907bd180 x1830881263268992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.338183:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd180 with x1830881263268992 ext(1323008->1327103) 00002000:00010000:2.0:1746065141.338187:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bd180 00000100:00100000:2.0:1746065141.338210:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3420 00000100:00100000:2.0:1746065141.338216:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+37:2005:x1830881263268992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065141.338530:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+37:2005:x1830881263268992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 312us (1481us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.338536:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3420 00002000:00100000:2.0:1746065141.338542:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->1327103) req@ffff8800907bd180 x1830881263268992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.338548:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd180 with x1830881263268992 ext(1323008->1327103) 00002000:00010000:2.0:1746065141.338551:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bd180 00000100:00100000:2.0:1746065141.340167:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263238528:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065141.340181:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.340219:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881263268736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2827us (3513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.340227:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5578 00000100:00100000:0.0:1746065141.346987:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.347056:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263269248 00000100:00100000:2.0:1746065141.347064:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263269248 00002000:00100000:2.0:1746065141.347104:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009aeca680 x1830881263269248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.347118:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeca680 with x1830881263269248 ext(2097152->4194303) 00002000:00010000:2.0:1746065141.347123:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeca680 00000100:00100000:2.0:1746065141.347150:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3421 00000100:00100000:0.0:1746065141.347153:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.347158:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263269248:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065141.347736:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263269504 00000100:00100000:1.0:1746065141.347740:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263269504 00002000:00100000:1.0:1746065141.347759:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1998848->2002943) req@ffff88009aec8700 x1830881263269504/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065141.347766:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8700 with x1830881263269504 ext(1998848->2002943) 00002000:00010000:1.0:1746065141.347770:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec8700 00000100:00100000:1.0:1746065141.347814:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3422 00000100:00100000:1.0:1746065141.347819:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+37:2005:x1830881263269504:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065141.347900:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+37:2005:x1830881263269504:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 80us (746us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065141.347908:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3422 00002000:00100000:1.0:1746065141.347912:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1998848->2002943) req@ffff88009aec8700 x1830881263269504/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065141.347918:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8700 with x1830881263269504 ext(1998848->2002943) 00002000:00010000:1.0:1746065141.347921:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec8700 00000100:00100000:0.0:1746065141.358078:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.358136:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263269760 00000100:00100000:3.0:1746065141.358143:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263269760 00000100:00100000:3.0:1746065141.358188:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4844 00000100:00100000:3.0:1746065141.358194:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+16:31898:x1830881263269760:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065141.358415:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+17:31898:x1830881263269760:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 220us (344us total) trans 8589935812 rc 0/0 00000100:00100000:3.0:1746065141.358421:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4844 00000100:00100000:2.0:1746065141.362641:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263269248:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 15477us (15653us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065141.362652:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3421 00002000:00100000:2.0:1746065141.362662:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009aeca680 x1830881263269248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.362671:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeca680 with x1830881263269248 ext(2097152->4194303) 00002000:00010000:2.0:1746065141.362676:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeca680 00000100:00100000:0.0:1746065141.376202:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.376268:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270016 00000100:00100000:2.0:1746065141.376276:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270016 00000100:00100000:2.0:1746065141.376324:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4845 00000100:00100000:2.0:1746065141.376331:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+17:31896:x1830881263270016:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065141.376505:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+18:31896:x1830881263270016:12345-192.168.202.27@tcp:35:cat.0 Request processed in 174us (310us total) trans 8589935813 rc 0/0 00000100:00100000:2.0:1746065141.376511:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4845 00000100:00100000:0.0:1746065141.407175:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.407276:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270272 00000100:00100000:1.0:1746065141.407284:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270272 00000100:00100000:1.0:1746065141.408579:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13509 00000100:00100000:1.0:1746065141.408590:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+37:31909:x1830881263270272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065141.408611:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.408627:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146dd61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93288c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.408722:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.408734:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.408742:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065141.408752:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065141.408851:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146dd61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 40 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.408880:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 39 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.408891:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.408893:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065141.408896:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4400, rc 0) 00000100:00100000:1.0:1746065141.409674:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+39:31909:x1830881263270272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1085us (2505us total) trans 8589935814 rc 0/0 00000100:00100000:1.0:1746065141.409681:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13509 00000100:00100000:0.0:1746065141.413227:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.413264:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.413290:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270400 00000100:00100000:3.0:1746065141.413298:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270400 00000100:00100000:0.0:1746065141.413302:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.413330:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270528 00000100:00100000:3.0:1746065141.413333:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270528 00000100:00100000:3.0:1746065141.413350:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270656 00000100:00100000:3.0:1746065141.413352:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270656 00000100:00100000:3.0:1746065141.413365:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12575 00000100:00100000:3.0:1746065141.413372:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881263270400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.413386:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.413399:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932893 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.413417:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.413419:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.413426:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 47 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.413438:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 47 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065141.413444:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12576 00010000:00010000:3.0:1746065141.413447:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:2.0:1746065141.413453:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263270528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.413465:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.413474:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146dd7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93289a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.413483:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881263270400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.413492:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12575 00000100:00100000:3.0:1746065141.413504:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12577 00000100:00100000:3.0:1746065141.413509:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881263270656:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065141.413513:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263238656:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065141.413514:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.413520:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328a1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.413529:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.413530:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.413534:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 47 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.413541:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 47 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.413548:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad600, rc 0) 00000100:00100000:3.0:1746065141.413561:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881263270656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 52us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.413565:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12577 00000100:00100000:2.0:1746065141.413966:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.415487:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263238656:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065141.415509:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146dd7d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93289a expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.415520:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146dd7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93289a expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.415545:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7600, rc 0) 00000100:00100000:2.0:1746065141.415585:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263270528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2133us (2320us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065141.415592:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12576 00000100:00100000:0.0:1746065141.428577:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.429235:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270912 00000100:00100000:2.0:1746065141.429243:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270912 00002000:00100000:2.0:1746065141.429280:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880091a90700 x1830881263270912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.429289:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90700 with x1830881263270912 ext(1048576->2097151) 00002000:00010000:2.0:1746065141.429295:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90700 00000100:00100000:2.0:1746065141.429324:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3423 00000100:00100000:2.0:1746065141.429335:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881263270912:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.432706:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.433751:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271040 00000100:00100000:1.0:1746065141.433760:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271040 00000100:00100000:1.0:1746065141.433829:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13510 00000100:00100000:1.0:1746065141.433837:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31911:x1830881263271040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065141.433857:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.433878:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146dd8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328a8 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.433931:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.433942:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.433952:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.433963:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.433968:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.433973:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434041:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0bba00/0xad6b7ddc146dda0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434050:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0bba00/0xad6b7ddc146dda0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434055:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0bba00/0xad6b7ddc146dda0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065141.434083:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065141.434087:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065141.434099:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0bba00/0xad6b7ddc146dda0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434106:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0bba00/0xad6b7ddc146dda0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434113:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434118:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434122:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434127:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434132:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065141.434136:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434141:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434149:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065141.434152:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065141.434155:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434159:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc146dd92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434188:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434193:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434197:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434201:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009580fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065141.434203:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434207:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434213:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5b00) 00010000:00010000:1.0:1746065141.434215:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065141.434217:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434221:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc146dd99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.434247:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146dd8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a8 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.434258:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0bba00/0xad6b7ddc146dda0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a8 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.434263:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.434265:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065141.434267:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0bba00, rc 0) 00000100:00100000:1.0:1746065141.434314:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:31911:x1830881263271040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 478us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.434319:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13510 00000100:00100000:0.0:1746065141.437814:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881263270912:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8476us (9238us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065141.437824:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3423 00002000:00100000:0.0:1746065141.437833:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880091a90700 x1830881263270912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.437840:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90700 with x1830881263270912 ext(1048576->2097151) 00002000:00010000:0.0:1746065141.437845:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90700 00000100:00100000:0.0:1746065141.439081:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.439116:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.439139:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271296 00000100:00100000:2.0:1746065141.439146:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271296 00000100:00100000:0.0:1746065141.439688:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.439728:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271552 00000100:00100000:0.0:1746065141.439731:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271552 00000100:00100000:2.0:1746065141.439918:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 710 00000100:00100000:2.0:1746065141.439927:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263271296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.439940:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.439962:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0bba00/0xad6b7ddc146dda0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a8 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.439976:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271424 00010000:00010000:2.0:1746065141.439979:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00000100:00100000:3.0:1746065141.439980:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271424 00010000:00010000:2.0:1746065141.439983:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.440011:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263271296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.440027:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 710 00000100:00100000:0.0:1746065141.440051:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12578 00000100:00100000:0.0:1746065141.440058:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263271552:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065141.440070:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.440080:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc146dda7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328b6 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.440119:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263238784:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065141.440167:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.441497:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13511 00000100:00100000:3.0:1746065141.441506:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+39:31912:x1830881263271424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065141.441521:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.441531:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146ddae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328af expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.441852:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.442057:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271680 00000100:00100000:1.0:1746065141.442062:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271680 00000100:00100000:1.0:1746065141.442192:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12579 00000100:00100000:1.0:1746065141.442198:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263271680:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065141.442206:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.442214:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328bd expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.442226:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.442228:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.442235:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 17 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.442245:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 17 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.442253:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4a00, rc 0) 00000100:00100000:1.0:1746065141.442285:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263271680:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.442291:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12579 00000100:00100000:0.0:1746065141.442363:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065141.442469:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.442482:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.442487:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 40 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.442493:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.442514:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 40 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.442523:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 40 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.442533:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263238912:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.442576:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.442583:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 8 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.442589:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263239040:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.442604:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.442660:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271808 00000100:00100000:2.0:1746065141.442664:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271808 00000100:00100000:2.0:1746065141.442693:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12580 00000100:00100000:2.0:1746065141.442699:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+38:31909:x1830881263271808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.442706:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.442714:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328c4 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.442727:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.442732:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.442738:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.442741:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.442756:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.442763:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 36 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.442801:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263239168:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.443098:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.444503:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263238784:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065141.444523:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc146dda7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328b6 expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.444532:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc146dda7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328b6 expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.444542:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3800, rc 0) 00000100:00100000:1.0:1746065141.444565:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263271552:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4508us (4878us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.444571:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12578 00000100:00100000:3.0:1746065141.445050:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263238912:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.445060:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263239040:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.445074:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065141.445491:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.445524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.445694:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271936 00000100:00100000:2.0:1746065141.445699:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271936 00010000:00010000:2.0:1746065141.445724:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 41 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.445743:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272064 00000100:00100000:2.0:1746065141.445744:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272064 00010000:00010000:2.0:1746065141.445753:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.445767:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5579 00000100:00100000:2.0:1746065141.445790:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263271936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.445801:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.445806:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 41 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.445815:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 41 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.445837:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc146dd37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932870 expref: 41 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.445849:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065141.445853:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.445861:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065141.445866:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.445888:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263271936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.445888:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5580 00000100:00100000:2.0:1746065141.445894:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5579 00000100:00100000:0.0:1746065141.445894:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263272064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.445901:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.445905:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.445912:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.445922:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146dd0d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93285b expref: 9 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.445932:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065141.445935:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065141.445941:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065141.445947:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00000100:00100000:1.0:1746065141.445958:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263239168:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065141.445964:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065141.445973:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.445980:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263272064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (455us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065141.445983:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927200, rc 0) 00000100:00100000:0.0:1746065141.445986:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5580 00010000:00010000:3.0:1746065141.446075:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.446081:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065141.446096:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:1.0:1746065141.446130:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+39:31909:x1830881263271808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3429us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.446135:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12580 00010000:00010000:3.0:1746065141.448040:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146ddae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.448074:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.448082:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.448085:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065141.448087:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac800, rc 0) 00000100:00100000:3.0:1746065141.448134:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+40:31912:x1830881263271424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6629us (9055us total) trans 8589935815 rc 0/0 00000100:00100000:3.0:1746065141.448141:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13511 00000100:00100000:0.0:1746065141.448623:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.448668:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.448731:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272192 00000100:00100000:2.0:1746065141.448737:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272192 00002000:00100000:2.0:1746065141.448793:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->2002943) req@ffff88012edaf100 x1830881263272192/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.448802:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881263272192 ext(1323008->2002943) 00010000:00010000:2.0:1746065141.448809:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 37 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.448823:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 37 pid: 1880 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.448830:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012edaf100 00000100:00100000:3.0:1746065141.448848:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272320 00000100:00100000:2.0:1746065141.448851:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1215 00000100:00100000:3.0:1746065141.448852:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272320 00000100:00100000:2.0:1746065141.448857:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+37:2004:x1830881263272192:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065141.448873:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13512 00000100:00100000:3.0:1746065141.448878:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:31911:x1830881263272320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065141.448886:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.448897:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc146ddd1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328cb expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.448928:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc146ddd1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328cb expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.448937:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc146ddd1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328cb expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.448949:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.448951:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065141.448953:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73600, rc 0) 00000100:00100000:3.0:1746065141.448984:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31911:x1830881263272320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 106us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.448989:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13512 00000100:00100000:0.0:1746065141.455977:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.456009:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272704 00000100:00100000:1.0:1746065141.456030:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272704 00000100:00100000:1.0:1746065141.456077:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12581 00000100:00100000:1.0:1746065141.456084:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+47:31912:x1830881263272704:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065141.456102:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.456119:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328d9 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.456147:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146dc42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f2 expref: 48 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.456155:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.456161:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.456166:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.456168:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.456170:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1396736->1589247] (req 1396736->1589247) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.456195:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.456215:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 21 pid: 9549 timeout: 837 lvb_type: 1 00000100:00100000:1.0:1746065141.456225:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263239296:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.456306:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.456318:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 16 pid: 13375 timeout: 837 lvb_type: 1 00000100:00100000:1.0:1746065141.456325:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263239424:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.456352:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146dc42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f2 expref: 48 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.456358:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146dc42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f2 expref: 48 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.456365:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263239552:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065141.456379:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.456488:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.456668:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272576 00000100:00100000:3.0:1746065141.456673:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272576 00000100:00100000:3.0:1746065141.456701:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13513 00000100:00100000:3.0:1746065141.456706:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:31911:x1830881263272576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065141.456714:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.456724:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146dddf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328d2 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.456793:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456803:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456811:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456825:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456830:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456834:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456915:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ddf4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456923:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ddf4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456928:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ddf4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065141.456936:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065141.456989:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456994:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.456999:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457004:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457009:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065141.457011:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457031:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457040:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065141.457042:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065141.457045:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457050:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146dde6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457059:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457063:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457067:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457071:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065141.457073:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457077:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457082:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a000) 00010000:00010000:3.0:1746065141.457084:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065141.457086:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457089:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146dded lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.457117:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146dddf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d2 expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.457127:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ddf4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d2 expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.457132:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.457134:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065141.457136:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00000100:00100000:3.0:1746065141.457165:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:31911:x1830881263272576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 459us (677us total) trans 8589935816 rc 0/0 00000100:00100000:3.0:1746065141.457171:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13513 00000100:00100000:0.0:1746065141.458625:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263239296:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.458635:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263239424:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.458641:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263239552:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065141.458661:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1396736->1589247] (req 1396736->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.458673:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8800, rc 0) 00000100:00100000:0.0:1746065141.458707:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+48:31912:x1830881263272704:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2623us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.458713:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12581 00000100:00100000:3.0:1746065141.459528:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+39:2004:x1830881263272192:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10668us (10903us total) trans 21474840808 rc 0/0 00000100:00100000:3.0:1746065141.459536:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1215 00002000:00100000:3.0:1746065141.459543:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1323008->2002943) req@ffff88012edaf100 x1830881263272192/t21474840808(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.459551:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881263272192 ext(1323008->2002943) 00010000:00010000:3.0:1746065141.459558:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.459568:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.459573:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012edaf100 00000100:00100000:0.0:1746065141.462278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.462313:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.462334:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272960 00000100:00100000:0.0:1746065141.462338:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.462342:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272960 00000100:00100000:0.0:1746065141.462354:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273088 00000100:00100000:0.0:1746065141.462357:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273088 00010000:00010000:2.0:1746065141.462372:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 22 pid: 9549 timeout: 837 lvb_type: 1 00000100:00100000:0.0:1746065141.462381:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12582 00000100:00100000:0.0:1746065141.462387:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263273088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065141.462400:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065141.462403:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272832 00000100:00100000:2.0:1746065141.462406:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272832 00010000:00010000:0.0:1746065141.462411:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc146de02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328e0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.462414:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 18 pid: 13375 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.462429:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5581 00010000:00010000:0.0:1746065141.462431:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065141.462433:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263272960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.462440:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc146de02 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328e0 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.462441:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.462449:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc146de02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328e0 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.462455:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 22 pid: 9549 timeout: 837 lvb_type: 1 00010000:00010000:0.0:1746065141.462461:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3600, rc 0) 00010000:00010000:2.0:1746065141.462463:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 22 pid: 9549 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.462476:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc146dc7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93280e expref: 22 pid: 9549 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.462491:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065141.462491:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263273088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 104us (151us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065141.462497:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12582 00000100:00100000:2.0:1746065141.462509:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263272960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.462515:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5581 00000100:00100000:2.0:1746065141.462544:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5582 00000100:00100000:2.0:1746065141.462549:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263272832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.462555:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.462561:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 17 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.462568:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 17 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.462576:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146dcd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932838 expref: 17 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.462583:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.462596:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263272832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.462600:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5582 00000100:00100000:0.0:1746065141.462622:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.462634:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273216 00000100:00100000:0.0:1746065141.462637:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273216 00000100:00100000:1.0:1746065141.462713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.462899:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273344 00000100:00100000:3.0:1746065141.462903:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273344 00010000:00010000:3.0:1746065141.462919:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146dc42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f2 expref: 48 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.462934:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5583 00000100:00100000:3.0:1746065141.462938:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263273344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.462943:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.462950:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146dc42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f2 expref: 48 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.462957:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146dc42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f2 expref: 48 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.462968:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146dc42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327f2 expref: 48 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.462977:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.462979:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.462984:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.462991:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.463024:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.463040:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263239680:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065141.463077:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.464106:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12583 00000100:00100000:0.0:1746065141.464115:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263273216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065141.464124:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.464133:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146de09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328e7 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.464160:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263239808:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065141.464191:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.464202:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.464208:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273472 00000100:00100000:1.0:1746065141.464211:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273472 00010000:00010000:1.0:1746065141.464235:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.464252:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5584 00000100:00100000:1.0:1746065141.464257:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+39:2006:x1830881263273472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.464263:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.464274:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.464490:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.464503:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.464505:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.464510:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.464516:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.464680:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.464693:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263239936:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065141.464714:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.467616:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.467699:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263239936:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065141.467717:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065141.467751:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+39:2006:x1830881263273472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3494us (3560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.467760:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5584 00000100:00100000:2.0:1746065141.467934:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273728 00000100:00100000:2.0:1746065141.467939:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273728 00002000:00100000:2.0:1746065141.467966:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1396736->1400831) req@ffff880129f43800 x1830881263273728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.467973:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43800 with x1830881263273728 ext(1396736->1400831) 00002000:00010000:2.0:1746065141.467977:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f43800 00000100:00100000:2.0:1746065141.467990:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3424 00000100:00100000:2.0:1746065141.467995:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881263273728:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065141.468098:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881263273728:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 102us (489us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065141.468102:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3424 00002000:00100000:2.0:1746065141.468106:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1396736->1400831) req@ffff880129f43800 x1830881263273728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.468112:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43800 with x1830881263273728 ext(1396736->1400831) 00002000:00010000:2.0:1746065141.468115:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f43800 00000100:00100000:3.0:1746065141.468267:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263239680:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065141.468278:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.468297:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881263273344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5359us (5585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.468302:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5583 00010000:00010000:1.0:1746065141.468383:0:9549:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880129f43100 x1830881263239808) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 38 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.468405:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9eb7000/0xad6b7ddc146dd5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932885 expref: 38 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.468419:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263239808:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065141.468438:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146de09 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328e7 expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.468451:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146de09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328e7 expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.468458:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:1.0:1746065141.468475:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263273216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4363us (5853us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.468481:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12583 00000100:00100000:0.0:1746065141.469077:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.469525:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273984 00000100:00100000:1.0:1746065141.469530:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273984 00002000:00100000:1.0:1746065141.469553:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880129f43100 x1830881263273984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065141.469560:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43100 with x1830881263273984 ext(1048576->2097151) 00002000:00010000:1.0:1746065141.469563:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f43100 00000100:00100000:1.0:1746065141.469587:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3425 00000100:00100000:1.0:1746065141.469592:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263273984:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065141.471277:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.471364:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274240 00000100:00100000:0.0:1746065141.471370:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274240 00000100:00100000:0.0:1746065141.471406:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13514 00000100:00100000:0.0:1746065141.471412:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:31911:x1830881263274240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065141.471429:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.471444:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146de10 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328ee expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.471517:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.471530:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.471536:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065141.471558:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.471568:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 39 pid: 9571 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.471582:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263240064:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.471623:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.471694:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.471792:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274496 00000100:00100000:3.0:1746065141.471796:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274496 00002000:00100000:3.0:1746065141.471815:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1585152->1589247) req@ffff8800907be300 x1830881263274496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.471823:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907be300 with x1830881263274496 ext(1585152->1589247) 00002000:00010000:3.0:1746065141.471827:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907be300 00000100:00100000:3.0:1746065141.471839:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3426 00000100:00100000:3.0:1746065141.471843:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881263274496:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065141.471921:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881263274496:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 76us (225us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.471927:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3426 00002000:00100000:3.0:1746065141.471931:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1585152->1589247) req@ffff8800907be300 x1830881263274496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.471937:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907be300 with x1830881263274496 ext(1585152->1589247) 00002000:00010000:3.0:1746065141.471939:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907be300 00000100:00100000:0.0:1746065141.477059:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.477120:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274624 00000100:00100000:3.0:1746065141.477127:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274624 00010000:00010000:3.0:1746065141.477157:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 40 pid: 9571 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.477183:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5585 00000100:00100000:0.0:1746065141.477185:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263273984:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 7591us (8107us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.477189:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263274624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065141.477193:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3425 00010000:00010000:3.0:1746065141.477200:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746065141.477201:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880129f43100 x1830881263273984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746065141.477205:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 40 pid: 9571 timeout: 837 lvb_type: 0 00002000:00100000:0.0:1746065141.477210:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43100 with x1830881263273984 ext(1048576->2097151) 00010000:00010000:3.0:1746065141.477214:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 40 pid: 9571 timeout: 837 lvb_type: 0 00002000:00010000:0.0:1746065141.477214:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f43100 00010000:00010000:3.0:1746065141.477230:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.477234:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.477242:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.477248:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.477659:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146ddb5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328af expref: 40 pid: 9571 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.477687:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263240064:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.477894:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065141.478352:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.478377:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263274624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1187us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.478384:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5585 00010000:00010000:1.0:1746065141.478431:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478437:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478452:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478457:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478461:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478465:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065141.478468:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478473:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478481:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.478483:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065141.478485:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478490:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc146de17 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.478518:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146de10 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328ee expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.478525:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146de10 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328ee expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.478534:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2200, rc 0) 00000100:00100000:1.0:1746065141.478552:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:31911:x1830881263274240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7140us (7279us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.478557:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13514 00000100:00100000:0.0:1746065141.481528:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.481741:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274880 00000100:00100000:3.0:1746065141.481748:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274880 00000100:00100000:3.0:1746065141.481881:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4846 00000100:00100000:3.0:1746065141.481888:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+39:31912:x1830881263274880:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065141.482667:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+40:31912:x1830881263274880:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 777us (1142us total) trans 8589935817 rc 0/0 00000100:00100000:3.0:1746065141.482674:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4846 00000100:00100000:0.0:1746065141.486769:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.486998:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275136 00000100:00100000:3.0:1746065141.487006:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275136 00000100:00100000:3.0:1746065141.487050:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4847 00000100:00100000:3.0:1746065141.487057:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:31911:x1830881263275136:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065141.487202:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:31911:x1830881263275136:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 144us (440us total) trans 8589935818 rc 0/0 00000100:00100000:3.0:1746065141.487209:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4847 00000100:00100000:0.0:1746065141.490914:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.491524:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275648 00000100:00100000:2.0:1746065141.491532:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275648 00002000:00100000:2.0:1746065141.491570:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880134b00e00 x1830881263275648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.491580:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00e00 with x1830881263275648 ext(2097152->4194303) 00002000:00010000:2.0:1746065141.491585:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00e00 00000100:00100000:2.0:1746065141.491613:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3427 00000100:00100000:2.0:1746065141.491620:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881263275648:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.492810:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.492893:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275520 00000100:00100000:1.0:1746065141.492897:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275520 00000100:00100000:1.0:1746065141.492936:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13515 00000100:00100000:1.0:1746065141.492942:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+18:31914:x1830881263275520:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065141.492957:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.492972:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328f5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.493035:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493046:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493054:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493065:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493070:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493075:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493156:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493164:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493170:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065141.493178:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065141.493231:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493237:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493242:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493246:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493250:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065141.493253:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493258:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493265:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065141.493267:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065141.493270:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493277:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493291:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493294:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493298:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493301:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065141.493303:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493307:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493311:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5600) 00010000:00010000:1.0:1746065141.493312:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065141.493314:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493317:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146de2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065141.493343:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.493350:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.493359:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.493361:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065141.493363:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac400, rc 0) 00000100:00100000:1.0:1746065141.493395:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+20:31914:x1830881263275520:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 454us (589us total) trans 8589935819 rc 0/0 00000100:00100000:1.0:1746065141.493400:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13515 00000100:00100000:0.0:1746065141.507406:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.507610:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275776 00000100:00100000:1.0:1746065141.507619:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275776 00000100:00100000:1.0:1746065141.507666:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12584 00000100:00100000:1.0:1746065141.507673:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:31914:x1830881263275776:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065141.507689:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.507704:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9328fc expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.507727:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.507734:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.507736:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.507739:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1638400->1830911] (req 1638400->1830911) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.507763:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.507798:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 48 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.507809:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263240192:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065141.508692:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.509047:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881263275648:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17426us (18140us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065141.509055:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3427 00002000:00100000:2.0:1746065141.509063:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880134b00e00 x1830881263275648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.509076:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00e00 with x1830881263275648 ext(2097152->4194303) 00002000:00010000:2.0:1746065141.509080:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00e00 00000100:00100000:1.0:1746065141.509571:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263240192:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.509589:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1638400->1830911] (req 1638400->1830911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.509600:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718400, rc 0) 00000100:00100000:1.0:1746065141.509627:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:31914:x1830881263275776:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1954us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.509632:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12584 00000100:00100000:0.0:1746065141.512770:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.512923:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275904 00000100:00100000:2.0:1746065141.512930:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275904 00002000:00100000:2.0:1746065141.512964:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1396736->1589247) req@ffff880135221180 x1830881263275904/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.512973:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221180 with x1830881263275904 ext(1396736->1589247) 00010000:00010000:2.0:1746065141.512981:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 47 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.512994:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 47 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.513000:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135221180 00000100:00100000:2.0:1746065141.513027:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1216 00000100:00100000:2.0:1746065141.513033:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881263275904:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065141.514734:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.514831:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276032 00000100:00100000:1.0:1746065141.514836:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276032 00000100:00100000:1.0:1746065141.514869:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12585 00000100:00100000:1.0:1746065141.514874:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263276032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065141.514885:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.514898:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146de48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932903 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.514933:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263240320:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065141.514994:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.517442:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881263275904:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4403us (4672us total) trans 17179873368 rc 0/0 00000100:00100000:3.0:1746065141.517451:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1216 00002000:00100000:3.0:1746065141.517461:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1396736->1589247) req@ffff880135221180 x1830881263275904/t17179873368(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.517468:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221180 with x1830881263275904 ext(1396736->1589247) 00010000:00010000:3.0:1746065141.517476:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 51 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.517488:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 51 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.517493:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135221180 00000100:00100000:0.0:1746065141.518986:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.518995:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263240320:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065141.519032:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146de48 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932903 expref: 50 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.519048:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146de48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932903 expref: 50 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065141.519070:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276160 00010000:00010000:1.0:1746065141.519075:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718200, rc 0) 00000100:00100000:1.0:1746065141.519102:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263276032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4228us (4372us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.519109:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12585 00000100:00100000:3.0:1746065141.519154:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276160 00010000:00010000:3.0:1746065141.519174:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 49 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.519201:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5586 00000100:00100000:3.0:1746065141.519207:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263276160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.519217:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.519225:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 49 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.519268:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 49 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.519283:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc146ddd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1589247) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d9 expref: 49 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.519382:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.519383:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.519390:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.519397:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.519424:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.519438:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263240448:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065141.519723:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.521125:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263240448:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065141.521138:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.521170:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263276160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1961us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.521177:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5586 00000100:00100000:0.0:1746065141.521285:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.521448:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276416 00000100:00100000:3.0:1746065141.521453:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276416 00002000:00100000:3.0:1746065141.521646:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1638400->1642495) req@ffff880099cf3b80 x1830881263276416/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.521656:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3b80 with x1830881263276416 ext(1638400->1642495) 00002000:00010000:3.0:1746065141.521660:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf3b80 00000100:00100000:3.0:1746065141.521682:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3428 00000100:00100000:3.0:1746065141.521688:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263276416:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065141.521766:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263276416:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 78us (482us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.521860:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3428 00002000:00100000:3.0:1746065141.521867:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1638400->1642495) req@ffff880099cf3b80 x1830881263276416/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.521874:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3b80 with x1830881263276416 ext(1638400->1642495) 00002000:00010000:3.0:1746065141.521877:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf3b80 00000100:00100000:0.0:1746065141.522555:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.522679:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276544 00000100:00100000:1.0:1746065141.522683:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276544 00000100:00100000:1.0:1746065141.522716:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12586 00000100:00100000:1.0:1746065141.522721:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263276544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065141.522730:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.522951:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146de4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93290a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.522986:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263240576:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065141.523203:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.525407:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263240576:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065141.525429:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146de4f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93290a expref: 49 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.525440:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146de4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93290a expref: 49 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.525463:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719c00, rc 0) 00000100:00100000:1.0:1746065141.525795:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263276544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3073us (3240us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.525802:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12586 00000100:00100000:0.0:1746065141.526138:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.526274:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276800 00000100:00100000:3.0:1746065141.526279:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276800 00002000:00100000:3.0:1746065141.526304:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1826816->1830911) req@ffff88008f7ffb80 x1830881263276800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.526313:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ffb80 with x1830881263276800 ext(1826816->1830911) 00002000:00010000:3.0:1746065141.526316:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7ffb80 00000100:00100000:3.0:1746065141.526327:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3429 00000100:00100000:3.0:1746065141.526331:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263276800:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065141.526427:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263276800:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 95us (290us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.526433:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3429 00002000:00100000:3.0:1746065141.526437:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1826816->1830911) req@ffff88008f7ffb80 x1830881263276800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.526443:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ffb80 with x1830881263276800 ext(1826816->1830911) 00002000:00010000:3.0:1746065141.526446:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7ffb80 00000100:00100000:0.0:1746065141.529335:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.529510:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276928 00000100:00100000:1.0:1746065141.529517:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276928 00000100:00100000:0.0:1746065141.529525:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.529648:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12587 00000100:00100000:1.0:1746065141.529655:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263276928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065141.529668:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.529681:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146de56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932911 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.529718:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263240704:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065141.535821:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.536514:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277184 00000100:00100000:2.0:1746065141.536522:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277184 00000100:00100000:2.0:1746065141.536899:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4848 00000100:00100000:2.0:1746065141.536906:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+20:31914:x1830881263277184:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065141.537084:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+21:31914:x1830881263277184:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 178us (7557us total) trans 8589935820 rc 0/0 00000100:00100000:2.0:1746065141.537091:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4848 00000100:00100000:1.0:1746065141.539048:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263240704:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065141.539074:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146de56 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932911 expref: 49 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.539087:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146de56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932911 expref: 49 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.539096:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:1.0:1746065141.539124:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263276928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9470us (9795us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.539135:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12587 00000100:00100000:0.0:1746065141.598245:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.598351:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277440 00000100:00100000:3.0:1746065141.598358:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277440 00000100:00100000:3.0:1746065141.598407:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13516 00000100:00100000:3.0:1746065141.598414:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+21:31921:x1830881263277440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.598431:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.598444:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932918 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.598515:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.598529:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.598537:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065141.598545:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065141.598624:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146de5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 24 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.598654:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 23 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.598661:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.598664:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065141.598666:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73a00, rc 0) 00000100:00100000:3.0:1746065141.598716:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+23:31921:x1830881263277440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 302us (478us total) trans 8589935821 rc 0/0 00000100:00100000:3.0:1746065141.598722:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13516 00000100:00100000:0.0:1746065141.601494:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.601572:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277568 00000100:00100000:1.0:1746065141.601577:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277568 00000100:00100000:1.0:1746065141.601613:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12588 00000100:00100000:1.0:1746065141.601620:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+38:2006:x1830881263277568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065141.601632:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.601646:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93291f expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.601662:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.601664:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.601676:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 39 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.601688:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 39 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.601696:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683ac00, rc 0) 00000100:00100000:1.0:1746065141.601738:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+39:2006:x1830881263277568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 118us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.601744:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12588 00000100:00100000:0.0:1746065141.609595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.609646:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.609677:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277824 00000100:00100000:2.0:1746065141.609686:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277824 00002000:00100000:2.0:1746065141.609720:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880098dd9880 x1830881263277824/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 504/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.609728:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9880 with x1830881263277824 ext(1048576->2097151) 00002000:00010000:2.0:1746065141.609733:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9880 00000100:00100000:2.0:1746065141.609745:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278080 00000100:00100000:2.0:1746065141.609747:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278080 00002000:00100000:2.0:1746065141.609755:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098ddaa00 x1830881263278080/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.609761:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddaa00 with x1830881263278080 ext(1048576->2097151) 00002000:00010000:2.0:1746065141.609764:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098ddaa00 00000100:00100000:2.0:1746065141.609796:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3430 00000100:00100000:2.0:1746065141.609801:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263277824:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065141.609803:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3431 00000100:00100000:3.0:1746065141.609811:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+39:2007:x1830881263278080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065141.616183:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263277824:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6372us (6586us total) trans 0 rc 856064/856064 00000100:00100000:2.0:1746065141.616193:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3430 00002000:00100000:2.0:1746065141.616204:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880098dd9880 x1830881263277824/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 504/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 856064/856064 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.616212:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9880 with x1830881263277824 ext(1048576->2097151) 00002000:00010000:2.0:1746065141.616217:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9880 00000100:00100000:3.0:1746065141.617142:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+39:2007:x1830881263278080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7329us (7492us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.617150:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3431 00002000:00100000:3.0:1746065141.617156:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098ddaa00 x1830881263278080/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.617170:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddaa00 with x1830881263278080 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.617174:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098ddaa00 00000100:00100000:0.0:1746065141.618737:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.618834:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278336 00000100:00100000:3.0:1746065141.618840:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278336 00000100:00100000:3.0:1746065141.618882:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13517 00000100:00100000:3.0:1746065141.618888:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+40:31923:x1830881263278336:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065141.618906:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.618921:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146de79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932926 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.618998:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.619010:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.619352:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.619384:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.619395:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 22 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.619405:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263240832:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.619485:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.621585:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263240832:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.621603:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065141.622400:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.622620:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278464 00000100:00100000:3.0:1746065141.622627:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278464 00010000:00010000:3.0:1746065141.622654:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 23 pid: 7231 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.622675:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5587 00000100:00100000:3.0:1746065141.622682:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263278464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.622693:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.622698:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 23 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.622707:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 23 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.622724:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146de33 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328f5 expref: 23 pid: 7231 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.622748:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065141.622752:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.622761:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.622766:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065141.622803:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065141.622822:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065141.622829:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:3.0:1746065141.622835:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263278464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 153us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.622842:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5587 00000004:00200000:1.0:1746065141.622845:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065141.622944:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146de79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.622963:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 42 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.622969:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.622972:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065141.622974:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c4600, rc 0) 00000100:00100000:1.0:1746065141.622995:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+42:31923:x1830881263278336:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4107us (4262us total) trans 8589935822 rc 0/0 00000100:00100000:1.0:1746065141.623000:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13517 00000100:00100000:0.0:1746065141.662443:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.662606:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278592 00000100:00100000:1.0:1746065141.662614:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278592 00000100:00100000:1.0:1746065141.662670:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12589 00000100:00100000:1.0:1746065141.662677:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+39:31923:x1830881263278592:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065141.662693:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.662710:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93292d expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.662734:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.662742:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc146db8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932790 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.662747:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146db7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932782 expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.662759:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.662760:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065141.662764:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.662811:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146db7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932782 expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.662821:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146db7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932782 expref: 40 pid: 1880 timeout: 837 lvb_type: 1 00000100:00100000:1.0:1746065141.662832:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263240960:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.662919:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc146db8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932790 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.662927:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc146db8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932790 expref: 38 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.662934:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263241088:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.662957:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.662964:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 18 pid: 12260 timeout: 837 lvb_type: 1 00000100:00100000:1.0:1746065141.662975:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263241216:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065141.662989:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.668958:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.669076:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263240960:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.669085:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263241088:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.669092:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263241216:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065141.669124:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.669138:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a200, rc 0) 00000100:00100000:0.0:1746065141.669175:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+40:31923:x1830881263278592:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6498us (6739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.669183:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12589 00000100:00100000:1.0:1746065141.669904:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278848 00000100:00100000:1.0:1746065141.669911:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278848 00000100:00100000:1.0:1746065141.669944:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13518 00000100:00100000:1.0:1746065141.669950:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+22:31926:x1830881263278848:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065141.669968:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.669982:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146de95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932934 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.670066:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065141.670078:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065141.670087:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065141.670096:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065141.670169:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146de95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.670184:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 24 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.670191:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065141.670193:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065141.670196:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718800, rc 0) 00000100:00100000:1.0:1746065141.670216:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+24:31926:x1830881263278848:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 267us (1265us total) trans 8589935823 rc 0/0 00000100:00100000:1.0:1746065141.670221:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13518 00000100:00100000:2.0:1746065141.671713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.671754:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.671796:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278976 00000100:00100000:3.0:1746065141.671801:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278976 00000100:00100000:0.0:1746065141.671810:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279104 00000100:00100000:0.0:1746065141.671814:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279104 00010000:00010000:3.0:1746065141.671824:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc146db8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932790 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746065141.671828:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 19 pid: 12260 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.671854:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5588 00000100:00100000:3.0:1746065141.671860:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+39:2005:x1830881263278976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.671871:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.671885:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc146db8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932790 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.671904:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc146db8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932790 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.672408:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5589 00000100:00100000:2.0:1746065141.672416:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263279104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.672425:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.672553:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2000/0xad6b7ddc146db8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932790 expref: 39 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.672555:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 19 pid: 12260 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.672564:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 19 pid: 12260 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.672576:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc146da3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326e1 expref: 19 pid: 12260 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746065141.672580:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065141.672588:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.672608:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+38:2005:x1830881263278976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 747us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.672614:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5588 00000100:00100000:2.0:1746065141.672646:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263279104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 231us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.672652:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5589 00000100:00100000:0.0:1746065141.677671:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.677764:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279232 00000100:00100000:2.0:1746065141.677881:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279232 00010000:00010000:2.0:1746065141.677913:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146db7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932782 expref: 40 pid: 1880 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.677944:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5590 00000100:00100000:2.0:1746065141.677951:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263279232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.677970:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.677986:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146db7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932782 expref: 40 pid: 1880 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.677996:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146db7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932782 expref: 40 pid: 1880 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.678027:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146db7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932782 expref: 40 pid: 1880 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.678047:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.678049:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.678054:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.678061:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.678087:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.678097:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263241344:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065141.678806:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.680388:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263241344:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065141.680404:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.680434:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263279232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2482us (2770us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.680441:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5590 00000100:00100000:0.0:1746065141.684096:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.684237:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279360 00000100:00100000:2.0:1746065141.684244:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279360 00000100:00100000:2.0:1746065141.684293:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12590 00000100:00100000:2.0:1746065141.684301:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+48:31923:x1830881263279360:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065141.684321:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.684336:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93293b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.684362:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.684370:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 15 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.684377:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 49 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.684383:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.684385:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.684388:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->3522559] (req 3145728->3522559) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.684414:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 49 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.684425:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 49 pid: 3067 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.684436:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263241472:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.684523:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 15 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.684536:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 15 pid: 10219 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.685813:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263241600:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.686606:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.686617:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 21 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.686627:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263241728:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.686652:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.687832:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263241472:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.689870:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.689935:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279488 00000100:00100000:3.0:1746065141.689942:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279488 00010000:00010000:3.0:1746065141.690097:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 16 pid: 10219 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.690122:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5591 00000100:00100000:3.0:1746065141.690129:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263279488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065141.690131:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263241600:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.690140:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065141.690141:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263241728:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.690156:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 16 pid: 10219 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746065141.690164:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 16 pid: 10219 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.690237:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->3522559] (req 3145728->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.690250:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00010000:00010000:3.0:1746065141.690346:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146ddbc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328bd expref: 16 pid: 10219 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746065141.690370:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.690469:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263279488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 339us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.690469:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+49:31923:x1830881263279360:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6167us (6379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.690475:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12590 00000100:00100000:3.0:1746065141.690476:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5591 00000100:00100000:2.0:1746065141.691347:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.691595:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279616 00000100:00100000:3.0:1746065141.691599:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279616 00010000:00010000:3.0:1746065141.691613:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 49 pid: 3067 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.691627:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5592 00000100:00100000:3.0:1746065141.691631:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881263279616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.691639:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.691648:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 49 pid: 3067 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746065141.691655:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 49 pid: 3067 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746065141.691667:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc146dd84 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328a1 expref: 49 pid: 3067 timeout: 837 lvb_type: 1 00010000:00010000:3.0:1746065141.691675:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.691702:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881263279616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.691708:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5592 00000100:00100000:3.0:1746065141.691792:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.693057:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279744 00000100:00100000:2.0:1746065141.693063:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279744 00010000:00010000:2.0:1746065141.693085:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 22 pid: 1880 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.693114:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5593 00000100:00100000:2.0:1746065141.693121:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263279744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.693129:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.693140:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 22 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.693148:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 22 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.693161:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc146dd53 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93287e expref: 22 pid: 1880 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.693173:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.693175:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.693180:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.693186:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.693211:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.693226:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263241856:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065141.693289:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000001:00080000:2.0:1746065141.695924:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840808 is committed 00000001:00080000:2.0:1746065141.695945:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840806 is committed 00000001:00080000:2.0:1746065141.695974:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840788 is committed 00000001:00080000:2.0:1746065141.695999:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840775 is committed 00000100:00100000:2.0:1746065141.700763:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263241856:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065141.700800:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.700852:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263279744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7730us (9058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.700860:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5593 00000100:00100000:0.0:1746065141.702274:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.702578:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280000 00000100:00100000:3.0:1746065141.702585:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280000 00002000:00100000:3.0:1746065141.702616:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3518464->3522559) req@ffff880098dd9f80 x1830881263280000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.702625:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9f80 with x1830881263280000 ext(3518464->3522559) 00002000:00010000:3.0:1746065141.702630:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9f80 00000100:00100000:3.0:1746065141.702655:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3432 00000100:00100000:3.0:1746065141.702660:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881263280000:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065141.703602:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881263280000:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 937us (1327us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.703613:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3432 00002000:00100000:3.0:1746065141.703619:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3518464->3522559) req@ffff880098dd9f80 x1830881263280000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.703626:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9f80 with x1830881263280000 ext(3518464->3522559) 00002000:00010000:3.0:1746065141.703629:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9f80 00000100:00100000:0.0:1746065141.729373:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.731214:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280128 00000100:00100000:2.0:1746065141.731224:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280128 00000100:00100000:2.0:1746065141.732050:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12591 00000100:00100000:2.0:1746065141.732155:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+7:31926:x1830881263280128:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065141.732225:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.732481:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932942 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.732510:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.732519:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146daf2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932712 expref: 8 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.732530:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.732535:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.732537:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.732539:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [823296->1048575] (req 823296->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.732565:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.732576:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 20 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.732586:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263241984:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.734485:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146daf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932712 expref: 8 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.734498:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146daf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932712 expref: 8 pid: 3067 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.734507:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263242112:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.734540:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.734551:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 9 pid: 10219 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.734558:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263242240:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.734573:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.739261:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.739297:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.739337:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.739358:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280256 00000100:00100000:1.0:1746065141.739359:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280512 00000100:00100000:1.0:1746065141.739364:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280512 00000100:00100000:0.0:1746065141.739364:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280256 00010000:00010000:0.0:1746065141.739398:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146daf2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932712 expref: 9 pid: 3067 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.739418:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280384 00000100:00100000:0.0:1746065141.739420:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280384 00000100:00100000:2.0:1746065141.739493:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263241984:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.739502:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263242112:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.739550:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5594 00000100:00100000:3.0:1746065141.739557:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263280256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.739569:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.739586:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146daf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932712 expref: 9 pid: 3067 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.739595:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146daf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932712 expref: 9 pid: 3067 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.739613:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146daf2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932712 expref: 9 pid: 3067 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.739629:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.739662:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263280256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.739667:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5594 00000100:00100000:2.0:1746065141.739691:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263242240:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.739700:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 21 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.739716:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [823296->1048575] (req 823296->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.739726:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac800, rc 0) 00000100:00100000:1.0:1746065141.739727:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5595 00000100:00100000:1.0:1746065141.739733:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881263280512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.739740:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.739748:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 21 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.739756:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 21 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.739766:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146daeb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932704 expref: 21 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.739799:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065141.739826:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 10 pid: 10219 timeout: 837 lvb_type: 1 00000100:00100000:1.0:1746065141.739833:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881263280512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.739839:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5595 00000100:00100000:0.0:1746065141.739842:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5596 00000100:00100000:0.0:1746065141.739848:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263280384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065141.739854:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065141.739862:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 10 pid: 10219 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.740058:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+8:31926:x1830881263280128:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8000us (10693us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065141.740084:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 10 pid: 10219 timeout: 837 lvb_type: 1 00010000:00010000:0.0:1746065141.740097:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146da20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9326c5 expref: 10 pid: 10219 timeout: 837 lvb_type: 1 00010000:00010000:0.0:1746065141.740113:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.740114:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.740120:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.740127:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.740149:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.740159:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263242368:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065141.740204:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.740487:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12591 00000100:00100000:2.0:1746065141.745187:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263242368:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065141.745205:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.745243:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263280384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5394us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.745251:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5596 00000100:00100000:0.0:1746065141.748149:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.748661:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280768 00000100:00100000:3.0:1746065141.748669:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280768 00002000:00100000:3.0:1746065141.748707:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8a:0x0] (823296->827391) req@ffff88009aecb100 x1830881263280768/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.748720:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb100 with x1830881263280768 ext(823296->827391) 00002000:00010000:3.0:1746065141.748725:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aecb100 00000100:00100000:3.0:1746065141.748751:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3433 00000100:00100000:3.0:1746065141.748758:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263280768:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065141.749245:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263280768:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 485us (1101us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.749251:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3433 00002000:00100000:3.0:1746065141.749256:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8a:0x0] (823296->827391) req@ffff88009aecb100 x1830881263280768/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.749262:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb100 with x1830881263280768 ext(823296->827391) 00002000:00010000:3.0:1746065141.749265:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aecb100 00000100:00100000:0.0:1746065141.753365:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.753873:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280896 00000100:00100000:2.0:1746065141.753880:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280896 00000100:00100000:2.0:1746065141.753922:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12592 00000100:00100000:2.0:1746065141.753930:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:31926:x1830881263280896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065141.753943:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.753959:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932949 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.753982:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.753990:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 47 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.753997:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.754003:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.754005:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.754008:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.754042:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.754051:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 14 pid: 13375 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.754062:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263242496:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.754138:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 47 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.754146:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 47 pid: 3067 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.754154:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263242624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.754176:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.754183:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 22 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.754191:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263242752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.754203:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.756566:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263242496:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.756578:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263242624:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.756586:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263242752:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.756612:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.756625:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abadc00, rc 0) 00000100:00100000:2.0:1746065141.756671:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:31926:x1830881263280896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2741us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.756678:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12592 00000100:00100000:0.0:1746065141.759371:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.759442:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.760167:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.760766:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.760816:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.760841:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281408 00000100:00100000:0.0:1746065141.760848:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281408 00000100:00100000:0.0:1746065141.760881:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281536 00000100:00100000:0.0:1746065141.760883:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281536 00000100:00100000:0.0:1746065141.760897:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12593 00000100:00100000:0.0:1746065141.760903:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263281408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065141.760919:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.760932:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f47600/0xad6b7ddc146debf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932950 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.760955:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065141.760964:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f47600/0xad6b7ddc146debf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932950 expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.760973:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f47600/0xad6b7ddc146debf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932950 expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.760987:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47600, rc 0) 00000100:00100000:0.0:1746065141.761041:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263281408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 137us (274us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065141.762079:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281152 00000100:00100000:2.0:1746065141.762086:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281152 00010000:00010000:2.0:1746065141.762110:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 48 pid: 3067 timeout: 837 lvb_type: 1 00000100:00100000:1.0:1746065141.762111:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281024 00000100:00100000:1.0:1746065141.762115:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281024 00000100:00100000:2.0:1746065141.762131:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281280 00010000:00010000:1.0:1746065141.762132:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 15 pid: 13375 timeout: 837 lvb_type: 1 00000100:00100000:2.0:1746065141.762133:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281280 00010000:00010000:2.0:1746065141.762142:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 23 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.762153:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5597 00000100:00100000:2.0:1746065141.762158:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5598 00000100:00100000:1.0:1746065141.762159:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881263281152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065141.762163:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263281024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065141.762167:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.762170:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065141.762182:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 48 pid: 3067 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.762183:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 15 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:1.0:1746065141.762191:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 48 pid: 3067 timeout: 837 lvb_type: 1 00000100:00100000:3.0:1746065141.762263:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5599 00000100:00100000:3.0:1746065141.762271:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263281280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.762279:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.762488:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 15 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:1.0:1746065141.762507:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146dd76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932893 expref: 48 pid: 3067 timeout: 837 lvb_type: 1 00010000:00010000:1.0:1746065141.762524:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.762550:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881263281152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 391us (3184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.762555:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5597 00000100:00100000:1.0:1746065141.762579:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12594 00000100:00100000:1.0:1746065141.762585:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263281536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065141.762593:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.762602:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146dec6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932957 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065141.762634:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263242880:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065141.762669:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.762698:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12593 00000100:00100000:0.0:1746065141.762800:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.762842:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.762864:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.762878:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281664 00000100:00100000:0.0:1746065141.762881:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281664 00000100:00100000:0.0:1746065141.762895:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281792 00000100:00100000:0.0:1746065141.762897:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281792 00000100:00100000:0.0:1746065141.762908:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281920 00000100:00100000:0.0:1746065141.762910:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281920 00010000:00010000:3.0:1746065141.762915:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 23 pid: 9550 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.762916:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12595 00000100:00100000:1.0:1746065141.762923:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263281664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.762929:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 23 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.762931:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.762938:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929fa000/0xad6b7ddc146decd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93295e expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.762939:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc146dcea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93284d expref: 23 pid: 9550 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.762954:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065141.762962:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263243008:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065141.762970:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263281280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 701us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.762976:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5599 00000100:00100000:1.0:1746065141.762988:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065141.763040:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc146dd1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932862 expref: 15 pid: 13375 timeout: 837 lvb_type: 1 00010000:00010000:2.0:1746065141.763052:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.763054:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.763059:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.763065:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.763084:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.763092:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263243136:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065141.763110:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.763114:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12596 00000100:00100000:0.0:1746065141.763120:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881263281792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065141.763127:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065141.763131:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12597 00010000:00010000:0.0:1746065141.763134:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc146ded4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932965 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.763136:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881263281920:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.763143:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.763149:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146dedb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93296c expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.763156:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263243264:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065141.763174:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263243392:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065141.763177:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.763194:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.763223:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.763235:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282048 00000100:00100000:0.0:1746065141.763238:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282048 00000100:00100000:0.0:1746065141.763253:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12598 00000100:00100000:0.0:1746065141.763258:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881263282048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065141.763263:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.763270:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146dee2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932973 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065141.763289:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263243520:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065141.763307:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746065141.764888:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065140 -> 1746065141 00002000:00010000:0.0:1746065141.764892:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065140 -> 1746065141 00002000:00010000:0.0:1746065141.764894:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065140 -> 1746065141 00000100:00100000:0.0:1746065141.764908:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263243264:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065141.764929:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc146ded4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932965 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.764939:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc146ded4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932965 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065141.764946:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46400, rc 0) 00000100:00100000:2.0:1746065141.765085:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263243136:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065141.765096:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065141.765096:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881263281792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1975us (2252us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065141.765103:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12596 00000100:00100000:2.0:1746065141.765115:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263281024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2951us (5671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.765122:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5598 00002000:00010000:2.0:1746065141.765162:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065140 -> 1746065141 00002000:00010000:2.0:1746065141.765164:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065140 -> 1746065141 00002000:00010000:2.0:1746065141.765166:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065140 -> 1746065141 00000100:00100000:2.0:1746065141.765174:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263242880:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065141.765188:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146dec6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932957 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.765198:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146dec6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932957 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.765205:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:2.0:1746065141.765222:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263281536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2637us (4406us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065141.765227:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12594 00000100:00100000:1.0:1746065141.765505:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263243008:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065141.765522:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929fa000/0xad6b7ddc146decd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93295e expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.765533:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929fa000/0xad6b7ddc146decd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93295e expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.765541:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929fa000, rc 0) 00000100:00100000:1.0:1746065141.765572:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263281664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2649us (2772us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.765578:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12595 00000100:00100000:2.0:1746065141.765616:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263243392:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065141.765631:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146dedb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93296c expref: 50 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.765641:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146dedb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93296c expref: 50 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.765647:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:2.0:1746065141.765667:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881263281920:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2531us (2801us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065141.765672:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12597 00000100:00100000:1.0:1746065141.765829:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263243520:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065141.765840:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146dee2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932973 expref: 48 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.765848:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146dee2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932973 expref: 48 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065141.765867:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:1.0:1746065141.765887:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881263282048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2629us (2664us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065141.765891:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12598 00000100:00100000:3.0:1746065141.768170:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.768634:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282304 00000100:00100000:0.0:1746065141.768641:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282304 00002000:00100000:0.0:1746065141.768674:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1409024->1413119) req@ffff88012f09c380 x1830881263282304/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.768683:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881263282304 ext(1409024->1413119) 00002000:00010000:0.0:1746065141.768687:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09c380 00000100:00100000:0.0:1746065141.768712:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3434 00000100:00100000:0.0:1746065141.768717:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263282304:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.768850:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263282304:12345-192.168.202.27@tcp:3:cat.0 Request processed in 131us (684us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065141.768856:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3434 00002000:00100000:0.0:1746065141.768861:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1409024->1413119) req@ffff88012f09c380 x1830881263282304/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.768868:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881263282304 ext(1409024->1413119) 00002000:00010000:0.0:1746065141.768870:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09c380 00000100:00100000:0.0:1746065141.770711:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.771794:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282560 00000100:00100000:2.0:1746065141.771801:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282560 00002000:00100000:2.0:1746065141.771833:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->823295) req@ffff880099cc1f80 x1830881263282560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.771842:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1f80 with x1830881263282560 ext(0->823295) 00002000:00010000:2.0:1746065141.771846:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1f80 00000100:00100000:2.0:1746065141.771872:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3435 00000100:00100000:2.0:1746065141.771880:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263282560:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.776336:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.776416:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282688 00000100:00100000:1.0:1746065141.776423:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282688 00000100:00100000:1.0:1746065141.776549:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12599 00000100:00100000:1.0:1746065141.776556:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:31934:x1830881263282688:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065141.776570:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.776974:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93297a expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.777005:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.777025:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.777026:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.777029:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.777054:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.777065:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 8 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746065141.777079:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263243648:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065141.777150:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.780624:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.780688:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263243648:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065141.780709:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.780723:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3400, rc 0) 00000100:00100000:1.0:1746065141.781479:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:31934:x1830881263282688:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4921us (5148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065141.781487:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12599 00000100:00100000:2.0:1746065141.781548:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263282560:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9669us (10841us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746065141.781554:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3435 00002000:00100000:2.0:1746065141.781560:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->823295) req@ffff880099cc1f80 x1830881263282560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.781568:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1f80 with x1830881263282560 ext(0->823295) 00010000:00010000:2.0:1746065141.781577:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 7 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.781588:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 7 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.781594:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cc1f80 00000100:00100000:2.0:1746065141.781607:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282816 00000100:00100000:2.0:1746065141.781611:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282816 00002000:00100000:2.0:1746065141.781632:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (823296->1048575) req@ffff88012f09e300 x1830881263282816/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.781638:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881263282816 ext(823296->1048575) 00010000:00010000:2.0:1746065141.781642:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 7 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.781648:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 7 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.781657:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09e300 00000100:00100000:2.0:1746065141.781669:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1217 00000100:00100000:2.0:1746065141.781674:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263282816:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065141.786041:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.786123:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283072 00000100:00100000:1.0:1746065141.786133:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283072 00002000:00100000:1.0:1746065141.786181:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1413120->2097151) req@ffff88009c5f0a80 x1830881263283072/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065141.786191:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0a80 with x1830881263283072 ext(1413120->2097151) 00002000:00010000:1.0:1746065141.786196:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f0a80 00000100:00100000:1.0:1746065141.786563:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3436 00000100:00100000:1.0:1746065141.786571:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263283072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065141.787299:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263282816:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5621us (6677us total) trans 21474840809 rc 0/0 00000100:00100000:2.0:1746065141.787307:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1217 00002000:00100000:2.0:1746065141.787314:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (823296->1048575) req@ffff88012f09e300 x1830881263282816/t21474840809(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.787321:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881263282816 ext(823296->1048575) 00010000:00010000:2.0:1746065141.787328:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 9 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.787341:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 9 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.787347:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09e300 00000100:00100000:1.0:1746065141.794095:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263283072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7513us (8051us total) trans 0 rc 684032/684032 00000100:00100000:1.0:1746065141.794105:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3436 00002000:00100000:1.0:1746065141.794115:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1413120->2097151) req@ffff88009c5f0a80 x1830881263283072/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065141.794131:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0a80 with x1830881263283072 ext(1413120->2097151) 00002000:00010000:1.0:1746065141.794136:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f0a80 00000100:00100000:0.0:1746065141.798345:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.799158:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283200 00000100:00100000:2.0:1746065141.799177:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283200 00010000:00010000:2.0:1746065141.799242:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 9 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.799438:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5600 00000100:00100000:2.0:1746065141.799449:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263283200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.799469:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065141.799499:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 9 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.799515:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 9 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.799545:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146deb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932942 expref: 9 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.799584:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.799586:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.799597:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 20 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.799606:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 20 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.799644:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 20 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.799657:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263243776:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065141.800502:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.803398:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263243776:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065141.803421:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.803470:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263283200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4021us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.803480:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5600 00000100:00100000:0.0:1746065141.805508:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.805756:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.805809:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.805854:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.806649:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283328 00000100:00100000:3.0:1746065141.806662:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283328 00000100:00100000:3.0:1746065141.806703:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283712 00000100:00100000:3.0:1746065141.806705:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283712 00000100:00100000:3.0:1746065141.806716:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283840 00000100:00100000:3.0:1746065141.806717:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283840 00000100:00100000:3.0:1746065141.806731:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12600 00000100:00100000:3.0:1746065141.806738:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263283328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.806753:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.806769:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932981 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.806806:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.806808:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.806815:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.806830:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.806840:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046a00, rc 0) 00000100:00100000:3.0:1746065141.806878:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263283328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 140us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.806884:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12600 00000100:00100000:3.0:1746065141.806896:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12601 00000100:00100000:3.0:1746065141.806901:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263283712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.806907:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.806912:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc146def7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932988 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.806946:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263243904:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065141.806984:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.807000:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12602 00000100:00100000:3.0:1746065141.807005:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263283840:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.807024:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.807033:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146defe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93298f expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.807054:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263244032:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065141.807072:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.807097:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283584 00000100:00100000:3.0:1746065141.807101:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283584 00002000:00100000:3.0:1746065141.807121:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009c5f0380 x1830881263283584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.807130:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881263283584 ext(0->1048575) 00002000:00010000:3.0:1746065141.807133:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0380 00000100:00100000:3.0:1746065141.807149:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3437 00000100:00100000:3.0:1746065141.807154:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263283584:12345-192.168.202.27@tcp:3:cat.0 00002000:00010000:3.0:1746065141.811701:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065141 -> 1746065142 00000100:00100000:3.0:1746065141.811725:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263243904:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065141.811753:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc146def7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932988 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.811766:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc146def7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932988 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.812346:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:3.0:1746065141.812396:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263283712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5493us (6585us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065141.812404:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12601 00002000:00010000:2.0:1746065141.812503:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065141 -> 1746065142 00000100:00100000:2.0:1746065141.812514:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263244032:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065141.812532:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146defe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93298f expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.812548:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146defe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93298f expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.812573:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047000, rc 0) 00000100:00100000:2.0:1746065141.812591:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263283840:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5586us (6736us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065141.812596:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12602 00000100:00100000:3.0:1746065141.813878:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263283584:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6720us (8119us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.813886:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3437 00002000:00100000:3.0:1746065141.813894:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009c5f0380 x1830881263283584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.813903:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881263283584 ext(0->1048575) 00002000:00010000:3.0:1746065141.813908:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0380 00000100:00100000:2.0:1746065141.820604:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.821270:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283968 00000100:00100000:0.0:1746065141.821280:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283968 00000100:00100000:0.0:1746065141.821334:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12603 00000100:00100000:0.0:1746065141.821343:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+9:31932:x1830881263283968:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065141.821359:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065141.821374:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932996 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.821402:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.821410:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065141.821411:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065141.821414:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.821440:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.821451:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 20 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746065141.821463:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263244160:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.821552:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.822325:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.822453:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284096 00000100:00100000:3.0:1746065141.822457:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284096 00000100:00100000:3.0:1746065141.822491:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12604 00000100:00100000:3.0:1746065141.822496:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+47:31934:x1830881263284096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.822505:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.822515:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93299d expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.822532:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.822538:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.822539:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.822542:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 48 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.822558:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.822566:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 20 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.822574:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263244288:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.823269:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.823833:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263244160:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065141.823852:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.823861:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c5400, rc 0) 00000100:00100000:2.0:1746065141.823891:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+10:31932:x1830881263283968:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2549us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.823898:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12603 00000100:00100000:0.0:1746065141.826363:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.826391:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263244288:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.826397:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065141.826410:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 48 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.826423:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70a600, rc 0) 00000100:00100000:3.0:1746065141.826456:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+48:31934:x1830881263284096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3959us (4132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.826463:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12604 00000100:00100000:3.0:1746065141.826489:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284224 00000100:00100000:3.0:1746065141.826572:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284224 00002000:00100000:3.0:1746065141.826599:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (4096000->4194303) req@ffff88012f1a4e00 x1830881263284224/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.826607:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4e00 with x1830881263284224 ext(4096000->4194303) 00010000:00010000:3.0:1746065141.826613:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 21 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.826622:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 21 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.826626:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1a4e00 00000100:00100000:3.0:1746065141.826638:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284352 00000100:00100000:3.0:1746065141.826640:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284352 00002000:00100000:3.0:1746065141.826648:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1413119) req@ffff88012f1a4000 x1830881263284352/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.826654:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4000 with x1830881263284352 ext(1048576->1413119) 00010000:00010000:3.0:1746065141.826657:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 21 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.826663:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 21 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.826668:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1a4000 00000100:00100000:3.0:1746065141.826682:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1218 00000100:00100000:3.0:1746065141.826688:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263284224:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065141.826712:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1219 00000100:00100000:2.0:1746065141.826721:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263284352:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065141.830427:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263284224:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3729us (4059us total) trans 21474840810 rc 0/0 00000100:00100000:3.0:1746065141.830438:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1218 00002000:00100000:3.0:1746065141.830534:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4096000->4194303) req@ffff88012f1a4e00 x1830881263284224/t21474840810(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.830544:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4e00 with x1830881263284224 ext(4096000->4194303) 00010000:00010000:3.0:1746065141.830553:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.830563:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.830569:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1a4e00 00000100:00100000:3.0:1746065141.834281:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.834309:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284480 00000100:00100000:3.0:1746065141.834315:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284480 00000100:00100000:2.0:1746065141.834383:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263284352:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7458us (7779us total) trans 17179873369 rc 0/0 00000100:00100000:2.0:1746065141.834394:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1219 00002000:00100000:2.0:1746065141.834406:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1413119) req@ffff88012f1a4000 x1830881263284352/t17179873369(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.834421:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4000 with x1830881263284352 ext(1048576->1413119) 00010000:00010000:2.0:1746065141.834430:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.834598:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.834606:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1a4000 00010000:00010000:3.0:1746065141.834666:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.835084:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5601 00000100:00100000:3.0:1746065141.835092:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263284480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.835104:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.835119:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.835128:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.835147:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146de8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93292d expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.835161:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.835163:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.835168:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.835176:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.835198:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.835207:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263244416:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065141.836630:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.839864:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263244416:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065141.839885:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.839929:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263284480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4836us (5647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.839938:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5601 00000100:00100000:0.0:1746065141.842423:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.842485:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284608 00000100:00100000:3.0:1746065141.842492:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284608 00010000:00010000:3.0:1746065141.842522:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.842551:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5602 00000100:00100000:3.0:1746065141.842557:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263284608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.842569:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065141.842584:0:8352:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065141 -> 1746065142 00010000:00010000:3.0:1746065141.842590:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.842601:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.842621:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146deb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932949 expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.842634:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.842635:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.842641:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 47 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.842649:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 47 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.842677:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 47 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.842687:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263244544:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065141.844250:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065141.844435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.844472:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284864 00000100:00100000:2.0:1746065141.844477:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284864 00002000:00100000:2.0:1746065141.844507:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800907bca80 x1830881263284864/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.844515:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bca80 with x1830881263284864 ext(2097152->3145727) 00002000:00010000:2.0:1746065141.844519:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bca80 00000100:00100000:2.0:1746065141.844925:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3438 00000100:00100000:2.0:1746065141.844932:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263284864:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065141.847305:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263244544:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065141.847323:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065141.847353:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263284608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4794us (4937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.847361:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5602 00000100:00100000:0.0:1746065141.853134:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.853196:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285120 00000100:00100000:3.0:1746065141.853203:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285120 00002000:00100000:3.0:1746065141.853241:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012f1a5500 x1830881263285120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.853251:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5500 with x1830881263285120 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.853256:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5500 00000100:00100000:3.0:1746065141.853813:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3439 00000100:00100000:3.0:1746065141.853823:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881263285120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.866590:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263284864:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21650us (22148us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065141.866599:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3438 00002000:00100000:0.0:1746065141.866609:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800907bca80 x1830881263284864/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.866617:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bca80 with x1830881263284864 ext(2097152->3145727) 00002000:00010000:0.0:1746065141.866623:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bca80 00000100:00100000:3.0:1746065141.871463:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881263285120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17633us (18328us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.871473:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3439 00002000:00100000:3.0:1746065141.871483:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012f1a5500 x1830881263285120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.871491:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5500 with x1830881263285120 ext(1048576->2097151) 00002000:00010000:3.0:1746065141.871496:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5500 00000100:00100000:0.0:1746065141.876478:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.876938:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285248 00000100:00100000:3.0:1746065141.876947:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285248 00000100:00100000:3.0:1746065141.877840:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12605 00000100:00100000:3.0:1746065141.877850:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+22:31932:x1830881263285248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.877868:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.877884:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329a4 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.877908:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.877915:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.877917:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065141.877920:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 23 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.877945:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.877956:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 47 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.877966:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263244672:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065141.878892:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.879167:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285376 00000100:00100000:2.0:1746065141.879172:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285376 00000100:00100000:2.0:1746065141.879197:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12606 00000100:00100000:2.0:1746065141.879203:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+48:31934:x1830881263285376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.879213:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.879222:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329ab expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.879240:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 23 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.879246:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.879247:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065141.879250:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 49 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.879267:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 23 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.879276:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.879284:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263244800:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065141.879427:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.879483:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.881226:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263244672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.881247:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 23 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.881261:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047000, rc 0) 00000100:00100000:3.0:1746065141.881289:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+23:31932:x1830881263285248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3441us (4818us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.881296:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12605 00000100:00100000:0.0:1746065141.882105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.882176:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285504 00000100:00100000:3.0:1746065141.882181:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285504 00002000:00100000:3.0:1746065141.882211:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3522559) req@ffff880099bd5180 x1830881263285504/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.882220:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5180 with x1830881263285504 ext(3145728->3522559) 00010000:00010000:3.0:1746065141.882226:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 50 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.882235:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 50 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.882241:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd5180 00000100:00100000:3.0:1746065141.882254:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1220 00000100:00100000:3.0:1746065141.882259:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263285504:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065141.887481:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.887599:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285632 00000100:00100000:1.0:1746065141.887606:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285632 00002000:00100000:1.0:1746065141.887637:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1638400->1830911) req@ffff8800954bea00 x1830881263285632/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065141.887646:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bea00 with x1830881263285632 ext(1638400->1830911) 00010000:00010000:1.0:1746065141.887653:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746065141.887664:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 23 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:1.0:1746065141.887671:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800954bea00 00000100:00100000:1.0:1746065141.887688:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1221 00000100:00100000:1.0:1746065141.887695:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263285632:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065141.887884:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263244800:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065141.887904:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 51 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065141.887915:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:0.0:1746065141.887934:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+51:31934:x1830881263285376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8731us (9044us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.887940:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12606 00010000:00010000:2.0:1746065141.888904:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065141.898757:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881263285504:12345-192.168.202.27@tcp:4:cat.0 Request processed in 16488us (16644us total) trans 17179873370 rc 0/0 00000100:00100000:3.0:1746065141.898768:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1220 00002000:00100000:3.0:1746065141.898803:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3522559) req@ffff880099bd5180 x1830881263285504/t17179873370(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.898811:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5180 with x1830881263285504 ext(3145728->3522559) 00010000:00010000:3.0:1746065141.898821:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 51 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.898836:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 51 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:3.0:1746065141.898843:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd5180 00000100:00100000:2.0:1746065141.898950:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263285632:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11254us (11477us total) trans 17179873371 rc 0/0 00000100:00100000:2.0:1746065141.898957:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1221 00002000:00100000:2.0:1746065141.898963:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1638400->1830911) req@ffff8800954bea00 x1830881263285632/t17179873371(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/448 e 0 to 0 dl 1746065152 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.898969:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bea00 with x1830881263285632 ext(1638400->1830911) 00010000:00010000:2.0:1746065141.898975:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 25 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.898982:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 25 pid: 9549 timeout: 837 lvb_type: 0 00002000:00010000:2.0:1746065141.898987:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800954bea00 00000100:00100000:0.0:1746065141.902523:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.902579:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285760 00000100:00100000:0.0:1746065141.902581:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.902587:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285760 00010000:00010000:3.0:1746065141.902613:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 51 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.902645:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285888 00000100:00100000:3.0:1746065141.902647:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285888 00010000:00010000:3.0:1746065141.902658:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 25 pid: 9549 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.902681:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5603 00000100:00100000:3.0:1746065141.902686:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881263285760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.902696:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.902712:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 51 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.902721:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 51 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.902736:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146deaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93293b expref: 51 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.902755:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.902757:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.902762:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.902769:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.902830:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.902876:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5604 00000100:00100000:2.0:1746065141.902883:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263285888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065141.902890:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065141.902898:0:7192:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065141 -> 1746065142 00010000:00010000:2.0:1746065141.902902:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 25 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.902910:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 25 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.902921:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146de41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1830911) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328fc expref: 25 pid: 9549 timeout: 837 lvb_type: 0 00010000:00010000:2.0:1746065141.902933:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.902934:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.902937:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 50 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.902948:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 50 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.902963:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 50 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065141.902971:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263245056:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065141.903034:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.903067:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263244928:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065141.903092:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.911358:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263245056:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065141.911382:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065141.911421:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.911457:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263285888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8571us (8872us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065141.911468:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5604 00000100:00100000:3.0:1746065141.911484:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263244928:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065141.911496:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065141.911527:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286144 00000100:00100000:0.0:1746065141.911535:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286144 00002000:00100000:0.0:1746065141.911581:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800954bf800 x1830881263286144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065141.911587:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881263285760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8900us (9068us total) trans 0 rc 0/0 00002000:00100000:0.0:1746065141.911590:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bf800 with x1830881263286144 ext(1048576->2097151) 00000100:00100000:3.0:1746065141.911594:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5603 00002000:00010000:0.0:1746065141.911595:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954bf800 00000100:00100000:3.0:1746065141.911615:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3440 00000100:00100000:3.0:1746065141.911622:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263286144:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.920912:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.920946:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.921019:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286528 00000100:00100000:2.0:1746065141.921026:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286528 00002000:00100000:2.0:1746065141.921059:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880092744380 x1830881263286528/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.921069:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744380 with x1830881263286528 ext(2097152->4194303) 00002000:00010000:2.0:1746065141.921074:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092744380 00000100:00100000:2.0:1746065141.921099:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286656 00000100:00100000:2.0:1746065141.921101:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286656 00002000:00100000:2.0:1746065141.921111:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880092744700 x1830881263286656/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.921117:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744700 with x1830881263286656 ext(3145728->4194303) 00002000:00010000:2.0:1746065141.921119:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092744700 00000100:00100000:2.0:1746065141.921803:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3441 00000100:00100000:2.0:1746065141.921811:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263286528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065141.922482:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3442 00000100:00100000:3.0:1746065141.922488:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263286656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.922752:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263286144:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11129us (11330us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065141.922758:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3440 00002000:00100000:0.0:1746065141.922764:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800954bf800 x1830881263286144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065141.922771:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bf800 with x1830881263286144 ext(1048576->2097151) 00002000:00010000:0.0:1746065141.922789:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954bf800 00000100:00100000:3.0:1746065141.951368:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263286656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28869us (30410us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065141.951380:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3442 00002000:00100000:3.0:1746065141.951391:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880092744700 x1830881263286656/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.951399:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744700 with x1830881263286656 ext(3145728->4194303) 00002000:00010000:3.0:1746065141.951405:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092744700 00000100:00100000:0.0:1746065141.952509:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.952560:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.952648:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286784 00000100:00100000:2.0:1746065141.952656:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286784 00000100:00100000:2.0:1746065141.952688:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286912 00000100:00100000:2.0:1746065141.952690:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286912 00000100:00100000:2.0:1746065141.952886:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12607 00000100:00100000:2.0:1746065141.952894:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881263286784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.952910:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.952925:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329b2 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.952943:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.952945:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.952952:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.952964:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.952974:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b21f5600, rc 0) 00000100:00100000:2.0:1746065141.953018:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263286784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 115us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.953025:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12607 00000100:00100000:2.0:1746065141.953039:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12608 00000100:00100000:2.0:1746065141.953044:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263286912:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065141.953050:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.953059:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329b9 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.953069:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.953071:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.953075:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 51 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.953084:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 51 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065141.953090:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656ee00, rc 0) 00000100:00100000:2.0:1746065141.953104:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881263286912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 61us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.953109:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12608 00000100:00100000:0.0:1746065141.957970:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.958320:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263286528:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36508us (37413us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065141.958329:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3441 00002000:00100000:3.0:1746065141.958337:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880092744380 x1830881263286528/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.958346:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744380 with x1830881263286528 ext(2097152->4194303) 00002000:00010000:3.0:1746065141.958351:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092744380 00000100:00100000:2.0:1746065141.958634:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287040 00000100:00100000:2.0:1746065141.958640:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287040 00000100:00100000:2.0:1746065141.958671:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12609 00000100:00100000:2.0:1746065141.958676:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+24:31938:x1830881263287040:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065141.958688:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065141.958701:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329c0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.958722:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 50 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.958729:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.958730:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065141.958733:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.958753:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 50 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065141.958762:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 50 pid: 3068 timeout: 837 lvb_type: 0 00000100:00100000:2.0:1746065141.958791:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263245184:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065141.958836:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065141.963072:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263245184:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065141.963100:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.963113:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:3.0:1746065141.963147:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+25:31938:x1830881263287040:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4469us (5184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.963155:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12609 00000100:00100000:0.0:1746065141.966521:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.966577:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287168 00000100:00100000:3.0:1746065141.966584:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287168 00010000:00010000:3.0:1746065141.967417:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 51 pid: 3068 timeout: 837 lvb_type: 0 00000100:00100000:3.0:1746065141.967455:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5605 00000100:00100000:3.0:1746065141.967463:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881263287168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065141.967476:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065141.967490:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 51 pid: 3068 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.967500:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 51 pid: 3068 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.967518:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146df0c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93299d expref: 51 pid: 3068 timeout: 837 lvb_type: 0 00010000:00010000:3.0:1746065141.967539:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.967541:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.967547:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.967554:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.967586:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065141.967597:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263245312:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065141.970335:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065141.971890:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065141.971929:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065141.971988:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287424 00000100:00100000:2.0:1746065141.971996:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287424 00000100:00100000:0.0:1746065141.972022:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263245312:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065141.972039:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065141.972047:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880092745880 x1830881263287424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.972056:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745880 with x1830881263287424 ext(2097152->4194303) 00002000:00010000:2.0:1746065141.972060:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092745880 00000100:00100000:0.0:1746065141.972091:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263287168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4628us (5576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065141.972093:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287680 00000100:00100000:2.0:1746065141.972096:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287680 00000100:00100000:0.0:1746065141.972100:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5605 00002000:00100000:2.0:1746065141.972110:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880092745c00 x1830881263287680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.972116:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745c00 with x1830881263287680 ext(2097152->4194303) 00002000:00010000:2.0:1746065141.972118:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092745c00 00000100:00100000:2.0:1746065141.972129:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3443 00000100:00100000:0.0:1746065141.972134:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3444 00000100:00100000:2.0:1746065141.972135:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263287424:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.972140:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881263287680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065141.983974:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.988077:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287936 00000100:00100000:3.0:1746065141.988089:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287936 00002000:00100000:3.0:1746065141.988135:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1683456->1687551) req@ffff880092745f80 x1830881263287936/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/0 e 0 to 0 dl 1746065152 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.988145:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745f80 with x1830881263287936 ext(1683456->1687551) 00002000:00010000:3.0:1746065141.988150:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092745f80 00000100:00100000:3.0:1746065141.988189:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3445 00000100:00100000:3.0:1746065141.988197:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263287936:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065141.988315:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263287936:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 118us (4347us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065141.988321:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3445 00002000:00100000:3.0:1746065141.988326:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1683456->1687551) req@ffff880092745f80 x1830881263287936/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065141.988333:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745f80 with x1830881263287936 ext(1683456->1687551) 00002000:00010000:3.0:1746065141.988336:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092745f80 00000100:00100000:3.0:1746065141.988389:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065141.988406:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288064 00000100:00100000:3.0:1746065141.988409:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288064 00000100:00100000:3.0:1746065141.988442:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12610 00000100:00100000:3.0:1746065141.988447:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263288064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065141.988455:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065141.988471:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329c7 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065141.988491:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.988493:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065141.988501:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 26 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.988516:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 26 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065141.988524:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130113600, rc 0) 00000100:00100000:3.0:1746065141.988544:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263288064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 97us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065141.988549:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12610 00000100:00100000:1.0:1746065141.988792:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065141.988808:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288192 00000100:00100000:1.0:1746065141.988811:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288192 00000100:00100000:1.0:1746065141.988835:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12611 00000100:00100000:1.0:1746065141.988840:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+52:31940:x1830881263288192:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065141.988847:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065141.988854:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329ce expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.988869:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.988875:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.988876:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065141.988879:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1888256->2068479] (req 1888256->2068479) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 53 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.988899:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065141.988909:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 25 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065141.988919:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263245440:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065141.989593:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065141.990921:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+52:2006:x1830881263287680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18774us (18984us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065141.990930:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3444 00002000:00100000:2.0:1746065141.990937:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880092745c00 x1830881263287680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065141.990946:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745c00 with x1830881263287680 ext(2097152->4194303) 00002000:00010000:2.0:1746065141.990950:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092745c00 00000100:00100000:0.0:1746065142.000142:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.000228:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288448 00000100:00100000:2.0:1746065142.000237:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288448 00000100:00100000:1.0:1746065142.000527:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263245440:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.000553:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1888256->2068479] (req 1888256->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.000569:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166e00, rc 0) 00000100:00100000:1.0:1746065142.000606:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+51:31940:x1830881263288192:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11765us (11833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.000614:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12611 00002000:00100000:2.0:1746065142.000704:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092746300 x1830881263288448/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.000714:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746300 with x1830881263288448 ext(4194304->5021695) 00002000:00010000:2.0:1746065142.000719:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092746300 00000100:00100000:2.0:1746065142.000812:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3446 00000100:00100000:2.0:1746065142.000819:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263288448:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.004881:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263287424:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32737us (32990us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065142.004892:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3443 00002000:00100000:3.0:1746065142.004902:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880092745880 x1830881263287424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:57/0 lens 488/440 e 0 to 0 dl 1746065152 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.004911:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745880 with x1830881263287424 ext(2097152->4194303) 00002000:00010000:3.0:1746065142.004916:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092745880 00000100:00100000:0.0:1746065142.015597:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.015877:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.016023:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288832 00000100:00100000:1.0:1746065142.016030:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288832 00000100:00100000:1.0:1746065142.016066:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12612 00000100:00100000:1.0:1746065142.016073:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+26:31938:x1830881263288832:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065142.016089:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.016103:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329d5 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.016130:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 50 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.016138:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 27 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.016144:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.016145:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.016148:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.016171:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 27 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.016180:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 27 pid: 10219 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746065142.016189:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263245568:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.016269:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 50 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.016280:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 50 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.016287:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263245696:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.016304:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.016480:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263288448:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15660us (16344us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065142.016487:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3446 00002000:00100000:2.0:1746065142.016496:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092746300 x1830881263288448/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.016504:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746300 with x1830881263288448 ext(4194304->5021695) 00002000:00010000:2.0:1746065142.016507:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092746300 00000100:00100000:2.0:1746065142.016521:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288704 00000100:00100000:2.0:1746065142.016523:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288704 00002000:00100000:2.0:1746065142.016540:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1683456->2097151) req@ffff880092746680 x1830881263288704/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.016546:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746680 with x1830881263288704 ext(1683456->2097151) 00010000:00010000:2.0:1746065142.016550:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 28 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.016558:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 28 pid: 10219 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.016563:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092746680 00000100:00100000:2.0:1746065142.016575:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1222 00000100:00100000:2.0:1746065142.016580:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+28:2006:x1830881263288704:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065142.020653:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263245568:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.020665:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263245696:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.020692:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 29 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.020706:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:1.0:1746065142.020742:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+29:31938:x1830881263288832:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4668us (4863us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.020749:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12612 00000100:00100000:0.0:1746065142.021429:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.022205:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288960 00000100:00100000:2.0:1746065142.022212:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288960 00010000:00010000:2.0:1746065142.022237:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 31 pid: 10219 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746065142.022267:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5606 00000100:00100000:2.0:1746065142.022273:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+31:2005:x1830881263288960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.022284:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.022299:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 31 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.022308:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 31 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.022325:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc146df36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c7 expref: 31 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.022356:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.022394:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881263288960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 121us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.022400:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5606 00000100:00100000:0.0:1746065142.024283:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.024316:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.024325:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289088 00000100:00100000:1.0:1746065142.024333:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289088 00000100:00100000:0.0:1746065142.024342:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065142.024354:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 51 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.024369:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289216 00000100:00100000:0.0:1746065142.024372:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289216 00000100:00100000:0.0:1746065142.024392:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289344 00000100:00100000:0.0:1746065142.024393:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289344 00000100:00100000:0.0:1746065142.024416:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12613 00000100:00100000:0.0:1746065142.024422:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881263289216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.024434:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.024445:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc146df4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329dc expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.024485:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263245824:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065142.024539:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.024554:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12614 00000100:00100000:0.0:1746065142.024925:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881263289344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.024932:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.024938:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc146df52 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329e3 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.024953:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.024959:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc146df52 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329e3 expref: 55 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065142.024967:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5607 00010000:00010000:0.0:1746065142.024969:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc146df52 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329e3 expref: 55 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065142.024973:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881263289088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.024980:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60a00, rc 0) 00010000:00010000:1.0:1746065142.024981:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.024995:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 54 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.025000:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881263289344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 77us (656us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065142.025003:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 54 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.025209:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+28:2006:x1830881263288704:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8627us (9623us total) trans 17179873372 rc 0/0 00000100:00100000:3.0:1746065142.025217:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1222 00002000:00100000:3.0:1746065142.025224:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1683456->2097151) req@ffff880092746680 x1830881263288704/t17179873372(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.025233:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746680 with x1830881263288704 ext(1683456->2097151) 00010000:00010000:3.0:1746065142.025238:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 28 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.025248:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 28 pid: 10219 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065142.025253:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092746680 00010000:00010000:1.0:1746065142.025286:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146df1a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ab expref: 54 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.025758:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.025760:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.025767:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.025796:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.026441:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.026452:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263245952:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065142.026679:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.026685:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12614 00000100:00100000:0.0:1746065142.026738:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.026827:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.027241:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289472 00000100:00100000:1.0:1746065142.027246:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289472 00000100:00100000:2.0:1746065142.027252:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289600 00000100:00100000:2.0:1746065142.027254:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289600 00000100:00100000:1.0:1746065142.027279:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12615 00000100:00100000:2.0:1746065142.027282:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12616 00000100:00100000:1.0:1746065142.027284:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263289472:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065142.027286:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263289600:12345-192.168.202.27@tcp:101:cat.0 00002000:00010000:0.0:1746065142.027294:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065141 -> 1746065142 00010000:00010000:2.0:1746065142.027297:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.027297:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746065142.027297:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065141 -> 1746065142 00000100:00100000:0.0:1746065142.027302:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263245824:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065142.027306:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc146df59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329f1 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.027306:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc146df60 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329ea expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.027319:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc146df4b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329dc expref: 52 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.027328:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc146df4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329dc expref: 52 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065142.027333:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246208:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065142.027333:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263246080:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065142.027335:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60800, rc 0) 00000100:00100000:0.0:1746065142.027357:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881263289216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2935us (3040us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065142.027365:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12613 00000100:00100000:1.0:1746065142.027370:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.027371:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.029445:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.030437:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289728 00000100:00100000:2.0:1746065142.030444:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289728 00010000:00010000:2.0:1746065142.030469:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 32 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.030501:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5608 00000100:00100000:2.0:1746065142.030507:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+32:2004:x1830881263289728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.030516:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.030530:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 32 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.030540:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 32 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.030564:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.030566:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.030572:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 50 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.030580:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 50 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.030603:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 50 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.030612:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263246336:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065142.031040:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.031669:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.031934:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290112 00000100:00100000:3.0:1746065142.031938:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290112 00002000:00100000:3.0:1746065142.031968:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1089536->1093631) req@ffff880097243480 x1830881263290112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.031976:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243480 with x1830881263290112 ext(1089536->1093631) 00002000:00010000:3.0:1746065142.031980:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097243480 00000100:00100000:3.0:1746065142.031995:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3447 00000100:00100000:3.0:1746065142.032000:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+33:2007:x1830881263290112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.032114:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+33:2007:x1830881263290112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 113us (446us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.032124:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3447 00002000:00100000:3.0:1746065142.032129:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1089536->1093631) req@ffff880097243480 x1830881263290112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.032136:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243480 with x1830881263290112 ext(1089536->1093631) 00002000:00010000:3.0:1746065142.032138:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097243480 00010000:00010000:0.0:1746065142.032316:0:3067:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff8800907bc700 x1830881263246080) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 32 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.032321:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263245952:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065142.032335:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065142.032336:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146df2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329c0 expref: 32 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.032345:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263246080:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065142.032354:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263289088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7382us (8076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.032360:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5607 00010000:00010000:0.0:1746065142.032363:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc146df60 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ea expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.032371:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc146df60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ea expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.032377:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:0.0:1746065142.032395:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+30:2004:x1830881263289472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5110us (5656us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065142.032400:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12615 00000100:00100000:0.0:1746065142.032431:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263246336:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065142.032441:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.032471:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263289728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1964us (3033us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.032477:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5608 00002000:00010000:0.0:1746065142.032504:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime: 1746065141 -> 1746065142 00002000:00010000:0.0:1746065142.032507:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime: 1746065141 -> 1746065142 00000100:00100000:0.0:1746065142.032512:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246208:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065142.032525:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc146df59 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329f1 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.032532:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc146df59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329f1 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.032538:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ae00, rc 0) 00000100:00100000:0.0:1746065142.032555:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263289600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5268us (5728us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065142.032560:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12616 00000100:00100000:3.0:1746065142.033073:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.033102:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.033103:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290496 00000100:00100000:0.0:1746065142.033106:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290496 00000100:00100000:3.0:1746065142.033112:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290624 00000100:00100000:3.0:1746065142.033114:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290624 00002000:00100000:0.0:1746065142.033124:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1888256->1892351) req@ffff88012f09d500 x1830881263290496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.033125:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012f09e680 x1830881263290624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.033131:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881263290496 ext(1888256->1892351) 00002000:00100000:3.0:1746065142.033132:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e680 with x1830881263290624 ext(4194304->5021695) 00002000:00010000:3.0:1746065142.033134:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09e680 00002000:00010000:0.0:1746065142.033134:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d500 00000100:00100000:0.0:1746065142.033145:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3448 00000100:00100000:0.0:1746065142.033150:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263290496:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.033153:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3449 00000100:00100000:3.0:1746065142.033157:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263290624:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.033217:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263290496:12345-192.168.202.27@tcp:3:cat.0 Request processed in 67us (144us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065142.033222:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3448 00002000:00100000:0.0:1746065142.033226:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1888256->1892351) req@ffff88012f09d500 x1830881263290496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.033233:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881263290496 ext(1888256->1892351) 00002000:00010000:0.0:1746065142.033235:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d500 00000100:00100000:0.0:1746065142.045022:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.045069:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290880 00000100:00100000:2.0:1746065142.045076:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290880 00002000:00100000:2.0:1746065142.045110:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (2064384->2068479) req@ffff8800983b8a80 x1830881263290880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.045119:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8a80 with x1830881263290880 ext(2064384->2068479) 00002000:00010000:2.0:1746065142.045124:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983b8a80 00000100:00100000:2.0:1746065142.045151:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3450 00000100:00100000:2.0:1746065142.045158:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263290880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.045282:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263290880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 123us (277us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.045289:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3450 00002000:00100000:2.0:1746065142.045295:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (2064384->2068479) req@ffff8800983b8a80 x1830881263290880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.045302:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8a80 with x1830881263290880 ext(2064384->2068479) 00002000:00010000:2.0:1746065142.045304:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983b8a80 00000100:00100000:0.0:1746065142.047171:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.048292:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291008 00000100:00100000:2.0:1746065142.048298:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291008 00000100:00100000:2.0:1746065142.048340:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12617 00000100:00100000:2.0:1746065142.048346:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263291008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065142.048360:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.048374:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc146df67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329f8 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.048514:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263290624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15354us (15409us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065142.048522:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3449 00002000:00100000:3.0:1746065142.048530:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012f09e680 x1830881263290624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.048539:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e680 with x1830881263290624 ext(4194304->5021695) 00002000:00010000:3.0:1746065142.048543:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09e680 00000100:00100000:2.0:1746065142.048552:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246464:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065142.050544:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.050586:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246464:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065142.050608:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc146df67 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329f8 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.050619:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc146df67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329f8 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.051070:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04a000, rc 0) 00000100:00100000:2.0:1746065142.051570:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263291008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3220us (4399us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065142.051578:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12617 00000100:00100000:0.0:1746065142.052505:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.052572:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291136 00000100:00100000:2.0:1746065142.052578:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291136 00000100:00100000:2.0:1746065142.052606:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12618 00000100:00100000:2.0:1746065142.052611:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881263291136:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065142.052624:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.052638:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc146df6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9329ff expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.052684:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246592:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065142.053843:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.058623:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246592:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065142.058649:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc146df6e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ff expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.058661:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc146df6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ff expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.058673:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd200, rc 0) 00000100:00100000:2.0:1746065142.059555:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881263291136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6941us (7048us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065142.059563:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12618 00000100:00100000:2.0:1746065142.064083:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.064166:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291264 00000100:00100000:0.0:1746065142.064173:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291264 00000100:00100000:0.0:1746065142.064469:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12619 00000100:00100000:0.0:1746065142.064475:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881263291264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.064490:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.064503:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc146df75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a06 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.064543:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246720:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065142.064607:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.066340:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246720:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065142.066363:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc146df75 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a06 expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.066375:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc146df75 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a06 expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.066396:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61200, rc 0) 00000100:00100000:2.0:1746065142.066531:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881263291264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2054us (2455us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065142.066537:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12619 00000100:00100000:0.0:1746065142.215729:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.215925:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291392 00000100:00100000:2.0:1746065142.215933:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291392 00000100:00100000:2.0:1746065142.215985:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12620 00000100:00100000:2.0:1746065142.215992:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263291392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065142.216017:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.216031:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146df7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a0d expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.216077:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246848:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065142.216652:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.219194:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246848:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065142.219222:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146df7c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a0d expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.219354:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146df7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a0d expref: 51 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.219368:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dce00, rc 0) 00000100:00100000:2.0:1746065142.219412:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263291392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3419us (3691us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065142.219423:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12620 00000100:00100000:0.0:1746065142.244059:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.244146:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291648 00000100:00100000:3.0:1746065142.244155:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291648 00002000:00100000:3.0:1746065142.244194:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff8800983b9c00 x1830881263291648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 504/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.244202:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9c00 with x1830881263291648 ext(1048576->2097151) 00002000:00010000:3.0:1746065142.244207:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983b9c00 00000100:00100000:3.0:1746065142.244236:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3451 00000100:00100000:3.0:1746065142.244242:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881263291648:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.257874:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881263291648:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13623us (13815us total) trans 0 rc 868352/868352 00000100:00100000:3.0:1746065142.257884:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3451 00002000:00100000:3.0:1746065142.257894:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff8800983b9c00 x1830881263291648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 504/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.257901:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9c00 with x1830881263291648 ext(1048576->2097151) 00002000:00010000:3.0:1746065142.257906:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983b9c00 00000100:00100000:0.0:1746065142.274687:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.274803:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291776 00000100:00100000:2.0:1746065142.274812:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291776 00000100:00100000:2.0:1746065142.274863:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12621 00000100:00100000:2.0:1746065142.274870:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+50:31949:x1830881263291776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065142.274887:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.274901:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a14 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.274924:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.274931:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.274932:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.274935:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.274959:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.274970:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 26 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.274980:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246976:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065142.275086:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.279258:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263246976:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065142.279284:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.279299:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd600, rc 0) 00000100:00100000:2.0:1746065142.279334:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+51:31949:x1830881263291776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4464us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.279341:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12621 00000100:00100000:0.0:1746065142.282602:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.282975:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291904 00000100:00100000:3.0:1746065142.282983:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291904 00002000:00100000:3.0:1746065142.283031:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1093631) req@ffff8800983ba300 x1830881263291904/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.283040:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983ba300 with x1830881263291904 ext(1048576->1093631) 00010000:00010000:3.0:1746065142.283047:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 27 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.283059:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 27 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065142.283065:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800983ba300 00000100:00100000:3.0:1746065142.283094:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1223 00000100:00100000:3.0:1746065142.283102:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+27:2006:x1830881263291904:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065142.286564:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.287819:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292032 00000100:00100000:1.0:1746065142.287827:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292032 00000100:00100000:1.0:1746065142.287864:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12622 00000100:00100000:1.0:1746065142.287871:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+23:31946:x1830881263292032:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065142.287885:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.287899:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a1b expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.287924:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.287930:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.287936:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.287938:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.287941:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2691072->3145727] (req 2691072->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 24 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.287968:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.287977:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 24 pid: 10219 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746065142.287987:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263247104:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065142.288325:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.288340:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292160 00000100:00100000:0.0:1746065142.288343:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292160 00000100:00100000:3.0:1746065142.288546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.288561:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292288 00000100:00100000:3.0:1746065142.288564:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292288 00000100:00100000:3.0:1746065142.288583:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12623 00000100:00100000:3.0:1746065142.288588:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+30:2006:x1830881263292288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.288596:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.288604:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45400/0xad6b7ddc146df91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a29 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.288635:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263247232:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065142.289132:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12624 00000100:00100000:0.0:1746065142.289138:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+31:2006:x1830881263292160:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.289146:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.289152:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc146df98 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a22 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.289172:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263247360:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065142.289241:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.289406:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292416 00000100:00100000:3.0:1746065142.289410:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292416 00000100:00100000:3.0:1746065142.289429:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12625 00000100:00100000:3.0:1746065142.289433:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+10:31951:x1830881263292416:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065142.289439:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.289447:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a30 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.289459:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.289460:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.289463:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3559424->3624959] (req 3559424->3624959) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.289471:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3559424->3624959] (req 3559424->3624959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.289478:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44a00, rc 0) 00000100:00100000:3.0:1746065142.289499:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+11:31951:x1830881263292416:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.289504:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12625 00000100:00100000:3.0:1746065142.291689:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+33:2006:x1830881263291904:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8389us (8895us total) trans 17179873373 rc 0/0 00000100:00100000:3.0:1746065142.291699:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1223 00002000:00100000:3.0:1746065142.291708:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1093631) req@ffff8800983ba300 x1830881263291904/t17179873373(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.291718:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983ba300 with x1830881263291904 ext(1048576->1093631) 00010000:00010000:3.0:1746065142.291726:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 33 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.291737:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 33 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065142.291743:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800983ba300 00010000:00010000:1.0:1746065142.293522:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.293540:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 10 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.293551:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263247488:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.293595:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.293872:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.293901:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263247232:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065142.293920:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45400/0xad6b7ddc146df91 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a29 expref: 32 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.293929:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45400/0xad6b7ddc146df91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a29 expref: 32 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.293951:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45400, rc 0) 00000100:00100000:3.0:1746065142.293971:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+31:2006:x1830881263292288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5382us (5425us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065142.293977:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12623 00000100:00100000:1.0:1746065142.294116:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.294312:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263247360:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065142.294320:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263247104:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.294327:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc146df98 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a22 expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.294336:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc146df98 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a22 expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.294355:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda400, rc 0) 00000100:00100000:1.0:1746065142.294379:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+29:2006:x1830881263292160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5241us (6054us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065142.294384:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12624 00000100:00100000:0.0:1746065142.297154:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.297239:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292544 00000100:00100000:2.0:1746065142.297246:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292544 00010000:00010000:2.0:1746065142.297272:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 29 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.297309:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5609 00000100:00100000:2.0:1746065142.297315:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2007:x1830881263292544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.297326:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.297342:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 29 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.297351:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 29 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.297524:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2a00/0xad6b7ddc146df44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329d5 expref: 29 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.298484:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.298486:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.298493:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 50 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.298501:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 50 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.298530:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 50 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.298540:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263247616:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065142.298619:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.304387:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.304423:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.304462:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.304472:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292928 00000100:00100000:1.0:1746065142.304480:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292928 00000100:00100000:0.0:1746065142.304488:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293056 00000100:00100000:0.0:1746065142.304491:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293056 00010000:00010000:1.0:1746065142.304507:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 25 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.304507:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 11 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.304532:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5610 00000100:00100000:1.0:1746065142.304538:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263292928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.304549:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.304564:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 25 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.304572:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 25 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.304589:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc146df21 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b2 expref: 25 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.304604:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.304636:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263292928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.304651:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263247488:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065142.304674:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2691072->3145727] (req 2691072->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 24 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.304683:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3400, rc 0) 00000100:00100000:2.0:1746065142.304710:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+24:31946:x1830881263292032:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 16840us (18154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.304717:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12622 00000100:00100000:2.0:1746065142.304754:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292800 00000100:00100000:2.0:1746065142.304757:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292800 00002000:00100000:2.0:1746065142.304799:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800983bb480 x1830881263292800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.304806:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bb480 with x1830881263292800 ext(0->1048575) 00002000:00010000:2.0:1746065142.304809:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bb480 00000100:00100000:2.0:1746065142.304821:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3452 00000100:00100000:2.0:1746065142.304826:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263292800:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.304866:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5611 00000100:00100000:0.0:1746065142.304873:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263293056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.304880:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.304888:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.304897:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.304908:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc146df05 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932996 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.304926:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.304928:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.304933:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.304940:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.304947:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.304948:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.304950:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.304956:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.304977:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.304987:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263247744:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065142.305045:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.305053:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263247872:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065142.305067:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.305360:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5610 00000100:00100000:2.0:1746065142.308733:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263247616:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065142.308750:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.308801:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+28:2007:x1830881263292544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11485us (11652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.308812:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5609 00000100:00100000:1.0:1746065142.312053:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263247744:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065142.312065:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263247872:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065142.312084:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.312145:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263293056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7270us (7680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.312158:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5611 00000100:00100000:0.0:1746065142.313368:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.313457:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.313500:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293312 00000100:00100000:1.0:1746065142.313507:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293312 00002000:00100000:1.0:1746065142.313538:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3559424->3563519) req@ffff8800983b9500 x1830881263293312/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.313546:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9500 with x1830881263293312 ext(3559424->3563519) 00002000:00010000:1.0:1746065142.313550:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b9500 00000100:00100000:1.0:1746065142.313569:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293568 00000100:00100000:1.0:1746065142.313571:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293568 00002000:00100000:1.0:1746065142.313582:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2691072->2695167) req@ffff8800983bad80 x1830881263293568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.313588:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bad80 with x1830881263293568 ext(2691072->2695167) 00002000:00010000:1.0:1746065142.313590:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bad80 00000100:00100000:1.0:1746065142.313601:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3453 00000100:00100000:1.0:1746065142.313607:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263293312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.313636:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3454 00000100:00100000:0.0:1746065142.313643:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263293568:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065142.313844:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263293312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 235us (477us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065142.313844:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263293568:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 201us (386us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065142.313849:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3454 00000100:00100000:1.0:1746065142.313852:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3453 00002000:00100000:0.0:1746065142.313854:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2691072->2695167) req@ffff8800983bad80 x1830881263293568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.313855:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3559424->3563519) req@ffff8800983b9500 x1830881263293312/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.313861:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9500 with x1830881263293312 ext(3559424->3563519) 00002000:00100000:0.0:1746065142.313861:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bad80 with x1830881263293568 ext(2691072->2695167) 00002000:00010000:1.0:1746065142.313863:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b9500 00002000:00010000:0.0:1746065142.313863:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bad80 00000100:00100000:0.0:1746065142.313893:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.313940:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.313997:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293696 00000100:00100000:2.0:1746065142.314001:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293696 00000100:00100000:2.0:1746065142.314035:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13519 00000100:00100000:2.0:1746065142.314040:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:31955:x1830881263293696:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065142.314052:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.314065:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146dfa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a37 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.314103:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263292800:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9276us (9723us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746065142.314108:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065142.314109:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3452 00002000:00100000:3.0:1746065142.314113:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800983bb480 x1830881263292800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065142.314118:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00002000:00100000:3.0:1746065142.314124:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bb480 with x1830881263292800 ext(0->1048575) 00002000:00010000:3.0:1746065142.314126:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bb480 00010000:00010000:2.0:1746065142.314128:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065142.314137:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293952 00010000:00010000:2.0:1746065142.314137:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065142.314139:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293952 00010000:00010000:2.0:1746065142.314142:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.314146:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00002000:00100000:3.0:1746065142.314152:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800954bd500 x1830881263293952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.314156:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bd500 with x1830881263293952 ext(1048576->2097151) 00002000:00010000:3.0:1746065142.314158:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954bd500 00000100:00100000:3.0:1746065142.314166:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3455 00000100:00100000:3.0:1746065142.314170:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+51:2006:x1830881263293952:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:2.0:1746065142.314200:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.314208:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.314214:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 23 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.314219:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.314241:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 23 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.314250:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 23 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.314258:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263248000:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065142.314310:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.314316:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 41 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.314324:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263248128:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065142.314340:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.320122:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.320149:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.320170:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294208 00000100:00100000:2.0:1746065142.320177:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294208 00010000:00010000:2.0:1746065142.320210:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 42 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.320234:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294080 00000100:00100000:2.0:1746065142.320236:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294080 00010000:00010000:2.0:1746065142.320246:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 24 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.320260:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5612 00000100:00100000:2.0:1746065142.320268:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263294208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.320279:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.320285:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 42 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.320296:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 42 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.320318:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.320322:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.320330:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.320334:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.320338:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.320375:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263294208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.320382:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5612 00000100:00100000:2.0:1746065142.320396:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5613 00000100:00100000:2.0:1746065142.320401:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263294080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.320407:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.320410:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 24 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.320419:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 24 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.320429:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.320431:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.320438:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 16 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.320444:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 16 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.320459:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.320474:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263294080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.320480:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5613 00000100:00100000:2.0:1746065142.320521:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.320547:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294464 00000100:00100000:0.0:1746065142.320551:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294464 00002000:00100000:0.0:1746065142.320575:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3620864->3624959) req@ffff880099bd7480 x1830881263294464/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.320583:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7480 with x1830881263294464 ext(3620864->3624959) 00002000:00010000:0.0:1746065142.320587:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7480 00000100:00100000:0.0:1746065142.320598:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3456 00000100:00100000:0.0:1746065142.320602:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263294464:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.320689:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263294464:12345-192.168.202.27@tcp:3:cat.0 Request processed in 86us (167us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065142.320694:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3456 00002000:00100000:0.0:1746065142.320699:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3620864->3624959) req@ffff880099bd7480 x1830881263294464/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.320706:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7480 with x1830881263294464 ext(3620864->3624959) 00002000:00010000:0.0:1746065142.320708:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7480 00010000:00010000:3.0:1746065142.322969:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc146de9c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932934 expref: 23 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.323018:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263248000:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.323032:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4600/0xad6b7ddc146de80 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932926 expref: 41 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.323041:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263248128:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.323059:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323065:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323070:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065142.323111:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065142.323115:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065142.323129:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323140:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323149:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323153:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323158:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323163:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323167:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065142.323170:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323174:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323185:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065142.323187:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065142.323190:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323194:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146dfad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323203:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323207:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323211:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323214:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dda00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065142.323216:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323220:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323225:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097e34300) 00010000:00010000:3.0:1746065142.323227:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065142.323229:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323233:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146dfb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.323260:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146dfa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.323270:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.323275:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065142.323276:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065142.323279:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dcc00, rc 0) 00000100:00100000:3.0:1746065142.323325:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:31955:x1830881263293696:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9283us (9430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.323332:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13519 00000100:00100000:0.0:1746065142.325279:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.325339:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294592 00000100:00100000:2.0:1746065142.325345:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294592 00000100:00100000:2.0:1746065142.325388:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12626 00000100:00100000:2.0:1746065142.325394:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+53:31946:x1830881263294592:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065142.325407:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.325419:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a3e expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.325440:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.325447:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 54 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.325452:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.325453:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.325456:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->2244607] (req 2097152->2244607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 54 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.325477:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 54 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.325486:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 54 pid: 10219 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746065142.325494:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263248256:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065142.325558:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.325566:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 27 pid: 3068 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.325574:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263248384:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065142.325590:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.326166:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.326212:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294720 00000100:00100000:1.0:1746065142.326215:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294720 00000100:00100000:1.0:1746065142.326241:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12627 00000100:00100000:1.0:1746065142.326246:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+28:31954:x1830881263294720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.326253:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.326259:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a45 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.326272:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 54 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.326276:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065142.326278:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065142.326280:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.326293:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 54 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.326299:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 54 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.326305:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263248512:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.326339:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.327402:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2006:x1830881263293952:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13227us (13458us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065142.327410:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3455 00002000:00100000:3.0:1746065142.327417:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800954bd500 x1830881263293952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.327425:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800954bd500 with x1830881263293952 ext(1048576->2097151) 00002000:00010000:3.0:1746065142.327428:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800954bd500 00000100:00100000:2.0:1746065142.336514:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263248256:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.336985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.337163:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263248512:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065142.337188:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.337203:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166000, rc 0) 00000100:00100000:0.0:1746065142.337240:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+29:31954:x1830881263294720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10993us (11074us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.337247:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12627 00000100:00100000:2.0:1746065142.337556:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263248384:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065142.337574:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->2244607] (req 2097152->2244607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 52 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.337583:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee600, rc 0) 00000100:00100000:2.0:1746065142.337601:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+52:31946:x1830881263294592:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12207us (12327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.337606:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12626 00000100:00100000:3.0:1746065142.337694:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294976 00000100:00100000:3.0:1746065142.337700:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294976 00000100:00100000:3.0:1746065142.337730:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4849 00000100:00100000:3.0:1746065142.339071:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+23:31951:x1830881263294976:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065142.339244:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+24:31951:x1830881263294976:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1508us (2260us total) trans 8589935824 rc 0/0 00000100:00100000:3.0:1746065142.339250:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4849 00000100:00100000:1.0:1746065142.340396:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.340795:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295104 00000100:00100000:3.0:1746065142.340801:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295104 00002000:00100000:3.0:1746065142.340828:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1888256->2068479) req@ffff8800907bf800 x1830881263295104/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.340836:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bf800 with x1830881263295104 ext(1888256->2068479) 00010000:00010000:3.0:1746065142.340843:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.340854:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065142.340860:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bf800 00000100:00100000:3.0:1746065142.340880:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1224 00000100:00100000:3.0:1746065142.340886:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881263295104:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065142.345079:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.345111:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.345137:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.345165:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.345185:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295488 00000100:00100000:0.0:1746065142.345192:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295488 00000100:00100000:0.0:1746065142.345223:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295616 00000100:00100000:0.0:1746065142.345225:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295616 00000100:00100000:0.0:1746065142.345238:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12628 00000100:00100000:0.0:1746065142.345244:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263295488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065142.345259:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.345273:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a4c expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.345295:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.345297:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.345305:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.345317:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.345326:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda800, rc 0) 00000100:00100000:0.0:1746065142.345359:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263295488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 115us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.345365:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12628 00000100:00100000:0.0:1746065142.345377:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12629 00000100:00100000:0.0:1746065142.345382:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263295616:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065142.345388:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.345395:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146dfd7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a53 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.345427:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263248640:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065142.345480:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.345521:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.345556:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.345589:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.345601:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295744 00000100:00100000:0.0:1746065142.345603:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295744 00000100:00100000:0.0:1746065142.345617:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295872 00000100:00100000:0.0:1746065142.345618:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295872 00000100:00100000:0.0:1746065142.345626:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296000 00000100:00100000:0.0:1746065142.345627:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296000 00000100:00100000:0.0:1746065142.345636:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12630 00000100:00100000:0.0:1746065142.345639:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263295744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065142.345645:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.345651:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a5a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.345659:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.345660:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.345663:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.345671:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.345676:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:0.0:1746065142.345691:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263295744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.345696:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12630 00000100:00100000:0.0:1746065142.345704:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12631 00000100:00100000:0.0:1746065142.345708:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263295872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065142.345712:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.345716:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a61 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.345728:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.345729:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.345732:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.345738:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.345743:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61e00, rc 0) 00000100:00100000:0.0:1746065142.345752:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263295872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 44us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.345756:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12631 00000100:00100000:0.0:1746065142.345763:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12632 00000100:00100000:0.0:1746065142.345767:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263296000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065142.345771:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.345804:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc146dfec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a68 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.345823:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263248768:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065142.345854:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.345877:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.345887:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296128 00000100:00100000:0.0:1746065142.345889:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296128 00000100:00100000:0.0:1746065142.345903:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12633 00000100:00100000:0.0:1746065142.345907:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263296128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065142.345915:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.345921:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc146dff3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a6f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.345931:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.345938:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc146dff3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a6f expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.345945:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc146dff3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a6f expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.345955:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60e00, rc 0) 00000100:00100000:0.0:1746065142.345969:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263296128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 61us (91us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065142.345973:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12633 00000100:00100000:0.0:1746065142.346032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.346049:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296384 00000100:00100000:0.0:1746065142.346052:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296384 00002000:00100000:0.0:1746065142.346072:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2691071) req@ffff880097e55180 x1830881263296384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.346080:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e55180 with x1830881263296384 ext(2097152->2691071) 00002000:00010000:0.0:1746065142.346083:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e55180 00000100:00100000:0.0:1746065142.346095:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3457 00000100:00100000:0.0:1746065142.346100:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263296384:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.346237:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295232 00000100:00100000:2.0:1746065142.346241:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295232 00010000:00010000:2.0:1746065142.346255:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 54 pid: 10219 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746065142.346281:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295360 00000100:00100000:2.0:1746065142.346284:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295360 00010000:00010000:2.0:1746065142.346292:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 29 pid: 3068 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.346304:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5614 00000100:00100000:2.0:1746065142.346308:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881263295232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.346316:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.346331:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 54 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.346339:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 54 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.346350:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc146df28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329b9 expref: 54 pid: 10219 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.346361:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.346377:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881263295232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.346382:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5614 00000100:00100000:2.0:1746065142.346392:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5615 00000100:00100000:2.0:1746065142.346397:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+29:2005:x1830881263295360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.346403:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.346409:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 29 pid: 3068 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.346416:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 29 pid: 3068 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.346425:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc146df13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329a4 expref: 29 pid: 3068 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.346432:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.346433:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.346437:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 52 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.346444:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 52 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.346460:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 52 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.346467:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263248896:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065142.346484:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.351710:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263248640:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065142.351740:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146dfd7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a53 expref: 16 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.351753:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146dfd7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a53 expref: 16 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.352931:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:0.0:1746065142.354036:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263295616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8648us (8864us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065142.354045:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12629 00000100:00100000:2.0:1746065142.355045:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881263295104:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 14156us (14648us total) trans 17179873374 rc 0/0 00000100:00100000:2.0:1746065142.355053:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1224 00002000:00100000:2.0:1746065142.355062:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1888256->2068479) req@ffff8800907bf800 x1830881263295104/t17179873374(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.355071:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bf800 with x1830881263295104 ext(1888256->2068479) 00010000:00010000:2.0:1746065142.355079:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.355091:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.355097:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bf800 00002000:00010000:2.0:1746065142.355146:0:1880:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065141 -> 1746065142 00002000:00010000:2.0:1746065142.355149:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065141 -> 1746065142 00000100:00100000:2.0:1746065142.355160:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263248768:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065142.355180:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc146dfec lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a68 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.355189:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc146dfec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a68 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.355197:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60a00, rc 0) 00000100:00100000:2.0:1746065142.355214:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263296000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9446us (9625us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065142.355220:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12632 00000100:00100000:3.0:1746065142.357082:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263248896:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065142.357097:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.357122:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263295360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10724us (12009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.357130:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5615 00000100:00100000:0.0:1746065142.367080:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.367147:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296640 00000100:00100000:2.0:1746065142.367156:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296640 00002000:00100000:2.0:1746065142.367191:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2240512->2244607) req@ffff880097e55500 x1830881263296640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.367201:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e55500 with x1830881263296640 ext(2240512->2244607) 00002000:00010000:2.0:1746065142.367206:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e55500 00000100:00100000:2.0:1746065142.367463:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3458 00000100:00100000:2.0:1746065142.367472:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881263296640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.368516:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881263296640:12345-192.168.202.27@tcp:3:cat.0 Request processed in 1043us (1440us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.368523:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3458 00002000:00100000:2.0:1746065142.368530:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2240512->2244607) req@ffff880097e55500 x1830881263296640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.368537:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e55500 with x1830881263296640 ext(2240512->2244607) 00002000:00010000:2.0:1746065142.368542:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e55500 00000100:00100000:1.0:1746065142.369974:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263296384:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23871us (23938us total) trans 0 rc 593920/593920 00000100:00100000:1.0:1746065142.369984:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3457 00002000:00100000:1.0:1746065142.369991:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2691071) req@ffff880097e55180 x1830881263296384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 593920/593920 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.369998:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e55180 with x1830881263296384 ext(2097152->2691071) 00002000:00010000:1.0:1746065142.370001:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e55180 00000100:00100000:0.0:1746065142.372601:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.374142:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.374179:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297024 00000100:00100000:0.0:1746065142.374186:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297024 00010000:00010000:0.0:1746065142.374215:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.374237:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5616 00000100:00100000:0.0:1746065142.374243:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881263297024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.374254:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.374269:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.374279:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.374302:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146df3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2068479) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9329ce expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.374323:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.374325:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.374331:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.374337:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.374364:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.374374:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263249024:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065142.374436:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.375616:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296896 00000100:00100000:3.0:1746065142.375621:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296896 00000100:00100000:3.0:1746065142.375658:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13520 00000100:00100000:3.0:1746065142.375664:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:31955:x1830881263296896:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065142.375676:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.375689:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146dffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a76 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.375766:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.375790:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.375800:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.375817:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.375826:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 14 pid: 7231 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.375833:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263249152:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065142.377252:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.377427:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.377444:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297280 00000100:00100000:3.0:1746065142.377448:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297280 00000100:00100000:3.0:1746065142.377474:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4850 00000100:00100000:3.0:1746065142.377480:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+41:31946:x1830881263297280:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065142.377616:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+42:31946:x1830881263297280:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 135us (366us total) trans 8589935825 rc 0/0 00000100:00100000:3.0:1746065142.377622:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4850 00000100:00100000:2.0:1746065142.378229:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.378343:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297536 00000100:00100000:1.0:1746065142.378348:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297536 00002000:00100000:1.0:1746065142.378371:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2244608->3145727) req@ffff880136a7b100 x1830881263297536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.378379:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b100 with x1830881263297536 ext(2244608->3145727) 00002000:00010000:1.0:1746065142.378384:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7b100 00000100:00100000:1.0:1746065142.378398:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3459 00000100:00100000:1.0:1746065142.378403:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+53:2006:x1830881263297536:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.379937:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263249024:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065142.379955:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.379995:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881263297024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5751us (5855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.380003:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5616 00000100:00100000:0.0:1746065142.386833:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.386866:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.386891:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297920 00000100:00100000:2.0:1746065142.386899:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297920 00002000:00100000:2.0:1746065142.386936:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097e55c00 x1830881263297920/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.386944:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e55c00 with x1830881263297920 ext(1048576->2097151) 00002000:00010000:2.0:1746065142.386948:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e55c00 00000100:00100000:2.0:1746065142.386963:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298048 00000100:00100000:2.0:1746065142.386965:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298048 00002000:00100000:2.0:1746065142.386976:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->3559423) req@ffff880097e56300 x1830881263298048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.386982:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56300 with x1830881263298048 ext(3145728->3559423) 00002000:00010000:2.0:1746065142.386985:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e56300 00000100:00100000:2.0:1746065142.386999:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3460 00000100:00100000:2.0:1746065142.387015:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263297920:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.387066:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+52:2006:x1830881263297536:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8661us (8837us total) trans 0 rc 901120/901120 00000100:00100000:0.0:1746065142.387072:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3459 00002000:00100000:0.0:1746065142.387077:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2244608->3145727) req@ffff880136a7b100 x1830881263297536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.387083:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b100 with x1830881263297536 ext(2244608->3145727) 00002000:00010000:0.0:1746065142.387086:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7b100 00000100:00100000:0.0:1746065142.387100:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3461 00000100:00100000:0.0:1746065142.387104:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263298048:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.387181:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263249152:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.387207:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065142.397463:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.397663:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263298048:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10556us (10794us total) trans 0 rc 413696/413696 00000100:00100000:1.0:1746065142.397673:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3461 00002000:00100000:1.0:1746065142.397682:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->3559423) req@ffff880097e56300 x1830881263298048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 413696/413696 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.397690:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56300 with x1830881263298048 ext(3145728->3559423) 00002000:00010000:1.0:1746065142.397695:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e56300 00000100:00100000:2.0:1746065142.397800:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298176 00000100:00100000:2.0:1746065142.397806:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298176 00010000:00010000:2.0:1746065142.397830:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 15 pid: 7231 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.398718:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5617 00000100:00100000:2.0:1746065142.398727:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263298176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.398738:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.398744:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 15 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.398759:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 15 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.398803:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146dfbb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a37 expref: 15 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.398829:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.398833:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.398841:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.398847:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.398864:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.398887:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263298176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 161us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.398892:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5617 00010000:00010000:3.0:1746065142.399131:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.399140:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065142.399161:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065142.399260:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146dffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a76 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.399276:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a76 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.399281:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065142.399283:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065142.399285:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:3.0:1746065142.399322:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:31955:x1830881263296896:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 23657us (26726us total) trans 8589935826 rc 0/0 00000100:00100000:3.0:1746065142.399327:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13520 00000100:00100000:0.0:1746065142.403516:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.404147:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298304 00000100:00100000:3.0:1746065142.404155:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298304 00000100:00100000:3.0:1746065142.404192:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12634 00000100:00100000:3.0:1746065142.404200:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+23:31949:x1830881263298304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.404216:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.404230:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a7d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.404255:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 24 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.404263:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.404274:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.404276:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.404279:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 5/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.404303:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.404314:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 9 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.404324:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263249280:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065142.404366:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263297920:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17359us (17537us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065142.404374:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3460 00002000:00100000:2.0:1746065142.404382:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097e55c00 x1830881263297920/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.404390:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e55c00 with x1830881263297920 ext(1048576->2097151) 00002000:00010000:2.0:1746065142.404393:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e55c00 00010000:00010000:3.0:1746065142.407594:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 24 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.407617:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 24 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.407630:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263249408:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.407730:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.409408:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.410255:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.410350:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298560 00000100:00100000:2.0:1746065142.410358:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298560 00000100:00100000:2.0:1746065142.410406:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12635 00000100:00100000:2.0:1746065142.410413:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263298560:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065142.410429:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.410443:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf000/0xad6b7ddc146e016 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a8b expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.410484:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263249536:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065142.411265:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.411469:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.412457:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.412515:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298432 00000100:00100000:3.0:1746065142.412521:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298432 00000100:00100000:3.0:1746065142.412547:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298688 00000100:00100000:3.0:1746065142.412549:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298688 00000100:00100000:3.0:1746065142.412562:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12636 00000100:00100000:3.0:1746065142.412567:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263298432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065142.412580:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.412591:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a84 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.412607:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.412609:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.412615:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.412628:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.412636:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30000, rc 0) 00000100:00100000:3.0:1746065142.412678:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263298432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 110us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.412683:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12636 00000100:00100000:3.0:1746065142.412695:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12637 00000100:00100000:3.0:1746065142.412698:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263298688:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065142.412703:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.412708:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146e024 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a92 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.412733:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263249664:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065142.412768:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.413583:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263249280:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.413597:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263249408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.413617:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.413625:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c800, rc 0) 00000100:00100000:3.0:1746065142.413659:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+24:31949:x1830881263298304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9459us (10149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.413665:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12634 00000100:00100000:1.0:1746065142.414880:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.416274:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298816 00000100:00100000:2.0:1746065142.416283:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298816 00002000:00100000:2.0:1746065142.416323:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3559424->3624959) req@ffff880097e57800 x1830881263298816/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.416332:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e57800 with x1830881263298816 ext(3559424->3624959) 00010000:00010000:2.0:1746065142.416339:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 10 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.416350:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 10 pid: 10219 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.416356:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097e57800 00000100:00100000:2.0:1746065142.416387:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298944 00000100:00100000:2.0:1746065142.416389:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298944 00002000:00100000:2.0:1746065142.416400:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2691072->3145727) req@ffff8800907bd500 x1830881263298944/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065142.416403:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1225 00002000:00100000:2.0:1746065142.416406:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd500 with x1830881263298944 ext(2691072->3145727) 00010000:00010000:2.0:1746065142.416411:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 24 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.416413:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263298816:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:2.0:1746065142.416419:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 24 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.416423:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907bd500 00000100:00100000:2.0:1746065142.416434:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1226 00000100:00100000:2.0:1746065142.416439:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881263298944:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065142.416631:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263249536:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065142.416786:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf000/0xad6b7ddc146e016 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a8b expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.416799:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf000/0xad6b7ddc146e016 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a8b expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.416811:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf000, rc 0) 00000100:00100000:3.0:1746065142.416834:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263298560:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6421us (7430us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065142.416840:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12635 00000100:00100000:0.0:1746065142.417908:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.417958:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299072 00000100:00100000:3.0:1746065142.417966:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299072 00000100:00100000:3.0:1746065142.418001:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12638 00000100:00100000:3.0:1746065142.418015:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+28:31954:x1830881263299072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.418025:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.418038:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932a99 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.418059:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.418060:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.418067:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.418079:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.418086:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4200, rc 0) 00000100:00100000:3.0:1746065142.418163:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+29:31954:x1830881263299072:12345-192.168.202.27@tcp:101:cat.0 Request processed in 147us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.418168:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12638 00002000:00010000:3.0:1746065142.421515:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065141 -> 1746065142 00002000:00010000:3.0:1746065142.421522:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065141 -> 1746065142 00000100:00100000:3.0:1746065142.421543:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263249664:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065142.421571:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146e024 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a92 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.421582:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146e024 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a92 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.421591:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:3.0:1746065142.421629:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263298688:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8928us (10159us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065142.421637:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12637 00000100:00100000:1.0:1746065142.423575:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263298816:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7160us (11115us total) trans 21474840811 rc 0/0 00000100:00100000:1.0:1746065142.423584:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1225 00002000:00100000:1.0:1746065142.423591:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3559424->3624959) req@ffff880097e57800 x1830881263298816/t21474840811(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.423599:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e57800 with x1830881263298816 ext(3559424->3624959) 00010000:00010000:1.0:1746065142.423606:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.423616:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065142.423621:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097e57800 00000100:00100000:1.0:1746065142.428203:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.428229:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299328 00000100:00100000:1.0:1746065142.428235:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299328 00000100:00100000:1.0:1746065142.428270:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13521 00000100:00100000:1.0:1746065142.428277:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:31955:x1830881263299328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065142.428298:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.428301:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065142.428324:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e001 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a76 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.428354:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065142.428358:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065142.428368:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146e032 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932aa0 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.428434:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065142.428444:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065142.428452:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065142.428461:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065142.428518:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146e032 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.428528:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.428534:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065142.428537:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065142.428539:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:1.0:1746065142.428742:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:31955:x1830881263299328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 464us (545us total) trans 8589935827 rc 0/0 00000100:00100000:1.0:1746065142.428748:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13521 00000100:00100000:2.0:1746065142.429205:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263298944:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12764us (14325us total) trans 21474840812 rc 0/0 00000100:00100000:2.0:1746065142.429213:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1226 00002000:00100000:2.0:1746065142.429221:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2691072->3145727) req@ffff8800907bd500 x1830881263298944/t21474840812(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.429230:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd500 with x1830881263298944 ext(2691072->3145727) 00010000:00010000:2.0:1746065142.429237:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 26 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.429246:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 26 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.429251:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907bd500 00000100:00100000:0.0:1746065142.432994:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.433115:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299584 00000100:00100000:2.0:1746065142.433125:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299584 00002000:00100000:2.0:1746065142.433168:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097e54a80 x1830881263299584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.433183:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e54a80 with x1830881263299584 ext(1048576->2097151) 00002000:00010000:2.0:1746065142.433188:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e54a80 00000100:00100000:2.0:1746065142.433232:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3462 00000100:00100000:2.0:1746065142.433241:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263299584:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.434216:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.434647:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.434678:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.434691:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.434711:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.434734:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299840 00000100:00100000:0.0:1746065142.434741:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299840 00000100:00100000:1.0:1746065142.434749:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.434763:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300096 00000100:00100000:1.0:1746065142.434767:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300096 00000100:00100000:1.0:1746065142.434804:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300352 00000100:00100000:1.0:1746065142.434806:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300352 00000100:00100000:0.0:1746065142.434808:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299968 00000100:00100000:0.0:1746065142.434814:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299968 00000100:00100000:1.0:1746065142.434816:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300224 00000100:00100000:1.0:1746065142.434818:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300224 00000100:00100000:1.0:1746065142.434831:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12639 00000100:00100000:1.0:1746065142.434836:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263299840:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:0.0:1746065142.434841:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12640 00000100:00100000:0.0:1746065142.434848:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2007:x1830881263300096:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065142.434864:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.434871:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.434879:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.434887:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.434888:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.434894:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.434894:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.434899:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.434901:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.434901:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.434903:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.434906:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.434907:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.434910:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.434928:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.434932:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.434938:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 11 pid: 3068 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.434942:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 17 pid: 1880 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746065142.434953:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263249792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065142.434954:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263249920:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.435024:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.435033:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 13 pid: 3067 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746065142.435041:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263250048:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.435094:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12641 00000100:00100000:3.0:1746065142.435101:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263300352:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065142.435119:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.435127:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065142.435130:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.435136:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746065142.435138:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.435158:0:12260:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.435166:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.435184:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12642 00000100:00100000:3.0:1746065142.435189:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263300224:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065142.435201:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.435209:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.435221:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.435227:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.435231:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.435232:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.435234:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.435246:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.435254:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 11 pid: 9549 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746065142.435261:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263250304:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.435812:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12643 00000100:00100000:1.0:1746065142.435818:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2007:x1830881263299968:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065142.435822:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.435832:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.435832:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 30 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.435841:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.435845:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263250432:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.435847:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.435851:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.435852:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.435854:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.435866:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.435873:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 17 pid: 9549 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.435874:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.435880:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263250560:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065142.435882:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 51 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.435889:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263250688:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.435900:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.435906:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 30 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.435907:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.435912:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263250816:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.435923:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065142.435935:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.435941:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 25 pid: 12260 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.435947:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263250944:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.435956:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746065142.436086:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.436093:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 13 pid: 1880 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746065142.436100:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263251072:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.436117:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.436123:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 25 pid: 9549 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.436128:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263251200:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.436137:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.437016:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299712 00000100:00100000:2.0:1746065142.437023:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299712 00010000:00010000:2.0:1746065142.437745:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.437795:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5618 00000100:00100000:2.0:1746065142.437802:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263299712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.437811:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.437833:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.437843:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.437859:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44a00/0xad6b7ddc146df9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3559424->18446744073709551615] (req 3559424->3624959) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a30 expref: 12 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.437883:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.438133:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263299712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 330us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.438139:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5618 00000100:00100000:1.0:1746065142.440481:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.440917:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263249792:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065142.440930:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300480 00000100:00100000:2.0:1746065142.440936:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300480 00000100:00100000:2.0:1746065142.440980:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12644 00000100:00100000:2.0:1746065142.440986:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2007:x1830881263300480:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065142.441026:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.441040:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.441046:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.441048:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.441050:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.441073:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 51 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.441082:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 51 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.441205:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263249920:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.441217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.441220:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263250048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.441237:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.441250:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.441255:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300736 00000100:00100000:0.0:1746065142.441258:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300736 00000100:00100000:1.0:1746065142.441263:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300608 00000100:00100000:1.0:1746065142.441267:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300608 00010000:00010000:0.0:1746065142.441274:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 19 pid: 1880 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.441281:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 26 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.441291:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300864 00000100:00100000:0.0:1746065142.441293:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300864 00000100:00100000:1.0:1746065142.441298:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5619 00010000:00010000:0.0:1746065142.441302:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 14 pid: 3067 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746065142.441303:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2006:x1830881263300736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.441310:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065142.441315:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5620 00000100:00100000:0.0:1746065142.441320:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263300608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.441324:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 19 pid: 1880 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.441327:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.441332:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 19 pid: 1880 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.441337:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 26 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.441344:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 26 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.441345:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146dfde lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a5a expref: 19 pid: 1880 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.441355:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc146df8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3559423] (req 2691072->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a1b expref: 26 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.441357:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065142.441366:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.441367:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.441372:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.441379:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.441386:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2006:x1830881263300736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.441392:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5619 00010000:00010000:0.0:1746065142.441397:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.441405:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5621 00010000:00010000:0.0:1746065142.441405:0:8352:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 25 pid: 1880 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.441409:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263300864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065142.441414:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263251456:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065142.441416:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.441424:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 14 pid: 3067 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.441436:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 14 pid: 3067 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.441446:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc146dfd0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a4c expref: 14 pid: 3067 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746065142.441449:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065142.441454:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.441467:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263300864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.441471:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5621 00000100:00100000:0.0:1746065142.441542:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263250432:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.441544:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.441557:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300992 00000100:00100000:1.0:1746065142.441560:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300992 00000100:00100000:2.0:1746065142.441732:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263251328:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065142.441754:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.443666:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263250560:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.443807:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 11 pid: 3068 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746065142.443834:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5622 00000100:00100000:1.0:1746065142.443840:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263300992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.443850:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.443862:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 11 pid: 3068 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.443870:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 11 pid: 3068 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.443886:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046a00/0xad6b7ddc146def0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932981 expref: 11 pid: 3068 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.443895:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.443918:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263300992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.443924:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5622 00000100:00100000:0.0:1746065142.451446:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.451464:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.451520:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263251456:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065142.451522:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263250688:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065142.451535:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065142.451547:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.451570:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263300608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10249us (10331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.451579:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5620 00000100:00100000:0.0:1746065142.451602:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301376 00000100:00100000:0.0:1746065142.451607:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301376 00000100:00100000:2.0:1746065142.451626:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263299584:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18387us (18643us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1746065142.451626:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 10 pid: 9549 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746065142.451633:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3462 00000100:00100000:0.0:1746065142.451640:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301248 00002000:00100000:2.0:1746065142.451641:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097e54a80 x1830881263299584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065142.451642:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301248 00002000:00100000:2.0:1746065142.451649:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e54a80 with x1830881263299584 ext(1048576->2097151) 00010000:00010000:0.0:1746065142.451652:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 25 pid: 12260 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.451655:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 29 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.451663:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5623 00010000:00010000:2.0:1746065142.451665:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 29 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.451668:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263301376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00002000:00010000:2.0:1746065142.451670:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097e54a80 00010000:00010000:0.0:1746065142.451677:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065142.451689:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5624 00010000:00010000:0.0:1746065142.451691:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 10 pid: 9549 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746065142.451695:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263301248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.451700:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 10 pid: 9549 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.451701:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.451710:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 25 pid: 12260 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.451717:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 25 pid: 12260 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.451718:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065142.451727:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.451729:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.451733:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.451733:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263301376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.451737:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5623 00010000:00010000:2.0:1746065142.451740:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.451752:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.451764:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263301248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.451768:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5624 00000100:00100000:0.0:1746065142.451797:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.451826:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.451834:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301120 00000100:00100000:0.0:1746065142.451834:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301632 00000100:00100000:0.0:1746065142.451836:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301632 00000100:00100000:1.0:1746065142.451837:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301120 00010000:00010000:0.0:1746065142.451845:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 13 pid: 1880 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.451850:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 18 pid: 9549 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746065142.451856:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5625 00000100:00100000:0.0:1746065142.451860:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263301632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.451865:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.451870:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 13 pid: 1880 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.451877:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 13 pid: 1880 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.451885:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.451895:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263301632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 35us (68us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065142.452029:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683ac00/0xad6b7ddc146de72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93291f expref: 9 pid: 9549 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746065142.452042:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263250304:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.452052:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc146dfe5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a61 expref: 13 pid: 1880 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746065142.452060:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263251072:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.452067:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263251200:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.452081:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.452100:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263250816:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.452111:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.452161:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5626 00000100:00100000:1.0:1746065142.452167:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2004:x1830881263301120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.452174:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.452183:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 18 pid: 9549 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.452190:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 18 pid: 9549 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.452201:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146e01d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a84 expref: 18 pid: 9549 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746065142.452208:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.452221:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263301120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.452225:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5626 00010000:00010000:1.0:1746065142.452244:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3400/0xad6b7ddc146dee9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93297a expref: 24 pid: 12260 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.452251:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263250944:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.452262:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452268:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452274:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452286:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452292:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452298:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452302:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7f000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065142.452305:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452311:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452319:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452324:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e047 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.452348:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263299840:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 17512us (17702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.452354:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12639 00000100:00100000:1.0:1746065142.452381:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.452391:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301504 00000100:00100000:1.0:1746065142.452393:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301504 00010000:00010000:1.0:1746065142.452402:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.452413:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5627 00000100:00100000:1.0:1746065142.452416:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881263301504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.452421:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.452427:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452434:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452443:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146df83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a14 expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452450:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.452459:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881263301504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.452464:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5627 00000100:00100000:1.0:1746065142.452481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.452488:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301760 00000100:00100000:1.0:1746065142.452490:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301760 00010000:00010000:1.0:1746065142.452496:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 24 pid: 9549 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.452506:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5628 00000100:00100000:1.0:1746065142.452509:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263301760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.452514:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.452519:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 24 pid: 9549 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452525:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 24 pid: 9549 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452533:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc146ddc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328c4 expref: 24 pid: 9549 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452539:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.452540:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.452542:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452552:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452563:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.452574:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263301760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.452579:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5628 00000100:00100000:1.0:1746065142.452602:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.452610:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301888 00000100:00100000:1.0:1746065142.452612:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301888 00010000:00010000:1.0:1746065142.452620:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 29 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.452630:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5629 00000100:00100000:1.0:1746065142.452633:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+29:2007:x1830881263301888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.452639:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.452644:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 29 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452651:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 29 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452661:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166000/0xad6b7ddc146dfc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a45 expref: 29 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.452666:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.452668:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.452669:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452674:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.452684:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065142.452694:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2007:x1830881263301888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 60us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.452698:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5629 00010000:00010000:3.0:1746065142.453250:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453257:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453268:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453272:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453277:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453282:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065142.453284:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453289:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453296:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453301:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc146e063 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.453325:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263299968:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 17507us (18613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.453330:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12643 00010000:00010000:3.0:1746065142.453343:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453349:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453357:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453362:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453367:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453371:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065142.453373:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453377:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453384:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.453389:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc146e05c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.453409:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263300224:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 18220us (18660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.453413:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12642 00000100:00100000:3.0:1746065142.453443:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263251328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.453452:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.455662:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5625 00000100:00100000:0.0:1746065142.457244:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.457270:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.457296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.457310:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302400 00000100:00100000:0.0:1746065142.457310:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302016 00000100:00100000:1.0:1746065142.457316:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302400 00000100:00100000:0.0:1746065142.457316:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302016 00002000:00100000:0.0:1746065142.457346:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2244607) req@ffff880099cc2a00 x1830881263302016/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.457347:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097e56680 x1830881263302400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.457355:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56680 with x1830881263302400 ext(3145728->4194303) 00002000:00100000:0.0:1746065142.457355:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2a00 with x1830881263302016 ext(2097152->2244607) 00010000:00010000:1.0:1746065142.457363:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.457363:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.457374:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.457375:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 52 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065142.457380:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc2a00 00002000:00010000:1.0:1746065142.457381:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097e56680 00000100:00100000:0.0:1746065142.457391:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302528 00000100:00100000:0.0:1746065142.457393:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302528 00000100:00100000:1.0:1746065142.457399:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1227 00002000:00100000:0.0:1746065142.457402:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880135222d80 x1830881263302528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065142.457405:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881263302016:12345-192.168.202.27@tcp:4:cat.0 00002000:00100000:0.0:1746065142.457408:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222d80 with x1830881263302528 ext(3145728->4194303) 00010000:00010000:0.0:1746065142.457413:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 23 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.457419:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 23 pid: 1880 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065142.457423:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135222d80 00000100:00100000:0.0:1746065142.457432:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1228 00000100:00100000:0.0:1746065142.457436:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+52:2007:x1830881263302400:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065142.457506:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1229 00000100:00100000:1.0:1746065142.457510:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263302528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065142.472829:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.472953:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.472992:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302656 00000100:00100000:3.0:1746065142.473000:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302656 00010000:00010000:3.0:1746065142.473042:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 28 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.473076:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5630 00000100:00100000:3.0:1746065142.473083:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263302656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.473095:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.473111:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 28 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.473120:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 28 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.473139:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc146e02b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a99 expref: 28 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.473156:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.473158:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.473163:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473170:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473445:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.473482:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263302656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 400us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.473489:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5630 00000100:00100000:3.0:1746065142.473534:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302784 00000100:00100000:3.0:1746065142.473537:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302784 00000100:00100000:3.0:1746065142.473553:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12645 00000100:00100000:3.0:1746065142.473557:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+9:31954:x1830881263302784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.473570:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.473583:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932aa7 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065142.473596:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6f5, atime: 0x6812d6f5, ctime: 0x6812d6f5, blocks: 0x808 00010000:00010000:3.0:1746065142.473605:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.473606:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.473610:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473619:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473626:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9400, rc 0) 00000100:00100000:3.0:1746065142.473641:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+10:31954:x1830881263302784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 84us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.473646:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12645 00010000:00010000:3.0:1746065142.473689:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473696:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473709:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473720:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473726:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473731:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065142.473734:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473739:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473753:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.473757:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146e04e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.473799:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263300096:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 38952us (39120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.473804:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12640 00000100:00100000:0.0:1746065142.474421:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263302528:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16909us (17123us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065142.474429:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1229 00002000:00100000:0.0:1746065142.474436:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880135222d80 x1830881263302528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.474444:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222d80 with x1830881263302528 ext(3145728->4194303) 00010000:00010000:0.0:1746065142.474451:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 23 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.474460:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 23 pid: 1880 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746065142.474465:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135222d80 00000100:00100000:2.0:1746065142.477737:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881263302016:12345-192.168.202.27@tcp:4:cat.0 Request processed in 20324us (20488us total) trans 17179873375 rc 0/0 00000100:00100000:2.0:1746065142.477747:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1227 00002000:00100000:2.0:1746065142.477757:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2244607) req@ffff880099cc2a00 x1830881263302016/t17179873375(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.477765:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2a00 with x1830881263302016 ext(2097152->2244607) 00010000:00010000:2.0:1746065142.477794:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 55 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.477805:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 55 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.477810:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc2a00 00000100:00100000:2.0:1746065142.481873:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881263302400:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24428us (24593us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065142.481882:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1228 00002000:00100000:2.0:1746065142.481891:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097e56680 x1830881263302400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.481902:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56680 with x1830881263302400 ext(3145728->4194303) 00010000:00010000:2.0:1746065142.481910:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.481922:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.481929:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097e56680 00000100:00100000:1.0:1746065142.491563:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.491635:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303168 00000100:00100000:2.0:1746065142.491643:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303168 00002000:00100000:2.0:1746065142.491677:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097fa3800 x1830881263303168/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.491686:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3800 with x1830881263303168 ext(1048576->2097151) 00002000:00010000:2.0:1746065142.491691:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3800 00000100:00100000:2.0:1746065142.491715:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3463 00000100:00100000:2.0:1746065142.491721:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263303168:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.495909:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.495948:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.495980:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.496023:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.496056:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303552 00000100:00100000:0.0:1746065142.496063:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303552 00010000:00010000:0.0:1746065142.496092:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 23 pid: 1880 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.496113:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303680 00000100:00100000:0.0:1746065142.496115:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303680 00010000:00010000:0.0:1746065142.496126:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.496139:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5631 00000100:00100000:0.0:1746065142.496145:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263303552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.496155:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.496171:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 23 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.496181:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 23 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.496200:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146e00f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a7d expref: 23 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.496214:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.496216:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.496220:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496226:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496246:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.496274:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263303552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 129us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.496280:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5631 00000100:00100000:0.0:1746065142.496294:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5632 00000100:00100000:0.0:1746065142.496298:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881263303680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.496306:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.496316:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.496325:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.496336:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146dfc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932a3e expref: 53 pid: 9548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.496345:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.496346:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.496348:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496353:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496364:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.496384:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881263303680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.496388:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5632 00010000:00010000:0.0:1746065142.496404:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496410:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496422:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496432:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496436:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496441:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065142.496444:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496450:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496458:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496462:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc146e055 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.496490:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263300352:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 61390us (61798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.496497:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12641 00000100:00100000:0.0:1746065142.496508:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303424 00000100:00100000:0.0:1746065142.496510:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303424 00000100:00100000:0.0:1746065142.496523:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12646 00000100:00100000:0.0:1746065142.496527:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+52:31949:x1830881263303424:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.496538:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.496546:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ab5 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496558:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496563:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065142.496564:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065142.496567:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 53 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496576:0:12260:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496585:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 53 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496592:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5e00, rc 0) 00000100:00100000:0.0:1746065142.496605:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+53:31949:x1830881263303424:12345-192.168.202.27@tcp:101:cat.0 Request processed in 77us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.496609:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12646 00010000:00010000:0.0:1746065142.496698:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496706:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496720:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496726:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496732:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496737:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065142.496739:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496744:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496752:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.496753:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.496757:0:9548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 52 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496763:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 52 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.496807:0:9548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 52 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.496821:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263251584:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065142.496876:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.497180:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303296 00000100:00100000:2.0:1746065142.497184:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303296 00000100:00100000:2.0:1746065142.497209:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13522 00000100:00100000:2.0:1746065142.497214:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800954be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+24:31959:x1830881263303296:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065142.497225:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.497234:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146e07f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932aae expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.497303:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065142.497315:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.497320:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065142.497334:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.497344:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 14 pid: 7231 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.497351:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263251712:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065142.497376:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.504803:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263303168:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13074us (13240us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065142.504814:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3463 00002000:00100000:2.0:1746065142.504824:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097fa3800 x1830881263303168/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.504833:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3800 with x1830881263303168 ext(1048576->2097151) 00002000:00010000:2.0:1746065142.504839:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3800 00000100:00100000:2.0:1746065142.505977:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263251584:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065142.505998:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.506016:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc146e06a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.506065:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263300480:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 65079us (65588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.506072:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12644 00000100:00100000:3.0:1746065142.506282:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263251712:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.506297:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065142.506963:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.508702:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303808 00000100:00100000:2.0:1746065142.508712:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303808 00010000:00010000:2.0:1746065142.508746:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 15 pid: 7231 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.512100:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.512172:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304064 00000100:00100000:0.0:1746065142.512179:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304064 00002000:00100000:0.0:1746065142.512214:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097242a00 x1830881263304064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.512223:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097242a00 with x1830881263304064 ext(3145728->4194303) 00002000:00010000:0.0:1746065142.512227:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097242a00 00000100:00100000:0.0:1746065142.512244:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3464 00000100:00100000:0.0:1746065142.512252:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881263304064:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.516213:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5633 00000100:00100000:2.0:1746065142.516228:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263303808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.516246:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.516256:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 15 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.516268:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 15 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.516288:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146e039 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa0 expref: 15 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.516299:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.516303:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065142.516312:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065142.516317:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065142.516338:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.516383:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263303808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 160us (9422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.516389:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5633 00010000:00010000:2.0:1746065142.516467:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065142.516474:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065142.516491:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065142.516599:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146e07f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.516612:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.516617:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.516619:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065142.516622:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:2.0:1746065142.516646:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800954be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+26:31959:x1830881263303296:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 19431us (20745us total) trans 8589935828 rc 0/0 00000100:00100000:2.0:1746065142.516652:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13522 00000100:00100000:0.0:1746065142.517436:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.518870:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.518886:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.518898:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.518956:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304320 00000100:00100000:2.0:1746065142.518962:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304320 00000100:00100000:0.0:1746065142.521030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.521153:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304448 00000100:00100000:1.0:1746065142.521159:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304448 00000100:00100000:1.0:1746065142.521190:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304704 00000100:00100000:1.0:1746065142.521192:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304704 00000100:00100000:1.0:1746065142.521202:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304960 00000100:00100000:1.0:1746065142.521204:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304960 00000100:00100000:1.0:1746065142.521213:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304576 00000100:00100000:1.0:1746065142.521214:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304576 00000100:00100000:1.0:1746065142.521226:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12647 00000100:00100000:1.0:1746065142.521232:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263304448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.521246:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.521260:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932abc expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065142.521278:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6f5, atime: 0x6812d6f4, ctime: 0x6812d6f5, blocks: 0x7f8 00010000:00010000:1.0:1746065142.521294:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521295:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521302:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521314:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521322:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad600, rc 0) 00000100:00100000:1.0:1746065142.521353:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263304448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 122us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.521359:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12647 00000100:00100000:1.0:1746065142.521371:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12648 00000100:00100000:1.0:1746065142.521376:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+29:2005:x1830881263304704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.521382:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.521390:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932aca expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065142.521400:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6f6, atime: 0x6812d6f6, ctime: 0x6812d6f6, blocks: 0x800 00010000:00010000:1.0:1746065142.521407:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521408:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521411:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521419:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521424:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac400, rc 0) 00000100:00100000:1.0:1746065142.521436:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881263304704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 60us (2549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.521440:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12648 00000100:00100000:1.0:1746065142.521448:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12649 00000100:00100000:1.0:1746065142.521452:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+29:2005:x1830881263304960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.521457:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.521462:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ad8 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.521473:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521474:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521478:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521484:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521490:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ada00, rc 0) 00000100:00100000:1.0:1746065142.521500:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881263304960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 47us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.521504:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12649 00000100:00100000:1.0:1746065142.521511:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12650 00000100:00100000:1.0:1746065142.521514:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+29:2005:x1830881263304576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.521517:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.521522:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ac3 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065142.521529:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6f6, atime: 0x6812d6f6, ctime: 0x6812d6f6, blocks: 0x808 00010000:00010000:1.0:1746065142.521535:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521536:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521539:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521546:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521556:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7acc00, rc 0) 00000100:00100000:1.0:1746065142.521568:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881263304576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.521572:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12650 00000100:00100000:1.0:1746065142.521602:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.521613:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304832 00000100:00100000:1.0:1746065142.521616:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304832 00000100:00100000:1.0:1746065142.521629:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12651 00000100:00100000:1.0:1746065142.521633:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263304832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.521646:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.521653:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ad1 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065142.521662:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d6f6, atime: 0x6812d6f6, ctime: 0x6812d6f6, blocks: 0x1650 00010000:00010000:1.0:1746065142.521671:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521672:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.521676:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521683:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.521690:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:1.0:1746065142.521703:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263304832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 70us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.521711:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12651 00000100:00100000:0.0:1746065142.522129:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.522208:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881263304064:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9957us (10116us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065142.522214:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3464 00002000:00100000:1.0:1746065142.522221:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097242a00 x1830881263304064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.522228:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097242a00 with x1830881263304064 ext(3145728->4194303) 00002000:00010000:1.0:1746065142.522232:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097242a00 00000100:00100000:2.0:1746065142.522487:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305216 00000100:00100000:2.0:1746065142.522491:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305216 00000100:00100000:2.0:1746065142.522517:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13523 00000100:00100000:2.0:1746065142.522522:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:31955:x1830881263304320:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065142.522554:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746065142.522571:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ddf4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328d2 expref: 14 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.522585:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc146ddd1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9328cb expref: 13 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.522592:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.522595:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.522617:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:31955:x1830881263304320:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 96us (5184us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746065142.522622:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13523 00000100:00100000:2.0:1746065142.522633:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13524 00000100:00100000:2.0:1746065142.522637:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+42:31961:x1830881263305216:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065142.522645:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.522652:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc146e0b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932adf expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.522708:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065142.522716:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065142.522723:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065142.522731:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065142.522810:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc146e0b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 45 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.522820:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 44 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.522825:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.522827:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065142.522829:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf400, rc 0) 00000100:00100000:2.0:1746065142.522845:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+44:31961:x1830881263305216:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 208us (717us total) trans 8589935829 rc 0/0 00000100:00100000:2.0:1746065142.522850:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13524 00000100:00100000:0.0:1746065142.525266:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.525382:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.525525:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305600 00000100:00100000:2.0:1746065142.525531:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305600 00000100:00100000:2.0:1746065142.525561:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12652 00000100:00100000:2.0:1746065142.525567:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+12:31959:x1830881263305600:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065142.525577:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.525589:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ae6 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.525610:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 13 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.525617:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.525619:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.525621:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2674688->2744319] (req 2674688->2744319) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.525643:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 13 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.525653:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 13 pid: 3068 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746065142.525664:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263251840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065142.525732:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.525965:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305472 00000100:00100000:3.0:1746065142.525971:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305472 00000100:00100000:3.0:1746065142.526011:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4851 00000100:00100000:3.0:1746065142.526017:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:31955:x1830881263305472:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065142.526139:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40de850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:31955:x1830881263305472:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 121us (877us total) trans 8589935830 rc 0/0 00000100:00100000:3.0:1746065142.526145:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4851 00000100:00100000:0.0:1746065142.527989:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.528030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.528078:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.528101:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.528125:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305728 00000100:00100000:0.0:1746065142.528132:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305728 00000100:00100000:0.0:1746065142.528163:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305984 00000100:00100000:0.0:1746065142.528166:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305984 00000100:00100000:0.0:1746065142.528181:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306240 00000100:00100000:0.0:1746065142.528185:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306240 00000100:00100000:0.0:1746065142.528199:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305856 00000100:00100000:0.0:1746065142.528202:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305856 00000100:00100000:0.0:1746065142.528220:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12653 00000100:00100000:0.0:1746065142.528228:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263305728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.528242:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.528257:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932aed expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.528277:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528280:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528289:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528300:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528309:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856400, rc 0) 00000100:00100000:0.0:1746065142.528344:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881263305728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 115us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.528350:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12653 00000100:00100000:0.0:1746065142.528366:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12654 00000100:00100000:0.0:1746065142.528373:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+54:2006:x1830881263305984:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.528385:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.528395:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932afb expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.528407:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528408:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528413:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 55 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528423:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 55 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528430:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857400, rc 0) 00000100:00100000:0.0:1746065142.528452:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+55:2006:x1830881263305984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 79us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.528457:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12654 00000100:00100000:0.0:1746065142.528470:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12655 00000100:00100000:0.0:1746065142.528476:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263306240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.528484:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.528491:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e0e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b09 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.528503:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528511:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e0e1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b09 expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528520:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e0e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b09 expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528533:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857a00, rc 0) 00000100:00100000:0.0:1746065142.528555:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263306240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 78us (478us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065142.528560:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12655 00000100:00100000:0.0:1746065142.528573:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12656 00000100:00100000:0.0:1746065142.528579:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+54:2006:x1830881263305856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.528586:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.528594:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932af4 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.528606:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528607:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528611:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 55 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528620:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 55 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528628:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857c00, rc 0) 00000100:00100000:0.0:1746065142.528648:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+55:2006:x1830881263305856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.528652:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12656 00000100:00100000:0.0:1746065142.528692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.528712:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306112 00000100:00100000:0.0:1746065142.528717:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306112 00000100:00100000:0.0:1746065142.528740:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12657 00000100:00100000:0.0:1746065142.528746:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263306112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.528754:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.528762:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b02 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.528809:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528812:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.528818:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528828:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.528835:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856200, rc 0) 00000100:00100000:0.0:1746065142.528858:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881263306112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 111us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.528863:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12657 00000100:00100000:0.0:1746065142.528966:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.528989:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306496 00000100:00100000:0.0:1746065142.528993:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306496 00000100:00100000:0.0:1746065142.529031:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4852 00000100:00100000:0.0:1746065142.529038:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:31955:x1830881263306496:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065142.529177:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:31955:x1830881263306496:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 138us (210us total) trans 8589935831 rc 0/0 00000100:00100000:0.0:1746065142.529183:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4852 00000100:00100000:0.0:1746065142.529347:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263251840:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065142.529370:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2674688->2744319] (req 2674688->2744319) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.529380:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be000, rc 0) 00000100:00100000:0.0:1746065142.529409:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+13:31959:x1830881263305600:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3841us (4026us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.529415:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12652 00000100:00100000:0.0:1746065142.530928:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.531758:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306624 00000100:00100000:2.0:1746065142.531764:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306624 00000100:00100000:0.0:1746065142.531770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.531822:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306752 00000100:00100000:1.0:1746065142.531826:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306752 00000100:00100000:1.0:1746065142.531855:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12658 00000100:00100000:1.0:1746065142.531861:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+14:31954:x1830881263306752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.531875:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.531886:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b10 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.531903:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.531907:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2674688->2744319] (req 2674688->2744319) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 15 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.531912:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065142.531914:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.531938:0:3067:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2674688->2744319] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 15 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.531951:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.531957:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad800, rc 0) 00000100:00100000:1.0:1746065142.531987:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+15:31954:x1830881263306752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 126us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.531991:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12658 00010000:00010000:2.0:1746065142.532169:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 14 pid: 3068 timeout: 838 lvb_type: 1 00000100:00100000:2.0:1746065142.532486:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5634 00000100:00100000:2.0:1746065142.532491:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263306624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.532500:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.532513:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 14 pid: 3068 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.532522:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 14 pid: 3068 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.532535:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e0b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad1 expref: 14 pid: 3068 timeout: 838 lvb_type: 1 00010000:00010000:2.0:1746065142.532548:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.532550:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.532554:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.532562:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.532581:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.532589:0:8352:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.532600:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263252096:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065142.532647:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.533907:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.534069:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306880 00000100:00100000:2.0:1746065142.534074:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306880 00000100:00100000:2.0:1746065142.534100:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12659 00000100:00100000:2.0:1746065142.534105:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+24:31949:x1830881263306880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065142.534116:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.534127:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b17 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.534143:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.534145:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065142.534148:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->5021695] (req 4194304->5021695) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.534156:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->5021695] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.534168:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46800, rc 0) 00000100:00100000:2.0:1746065142.534206:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+25:31949:x1830881263306880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.534211:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12659 00000100:00100000:2.0:1746065142.534554:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263252096:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065142.534570:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.534982:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263306624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2489us (4054us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.534990:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5634 00000100:00100000:0.0:1746065142.535861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.535964:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307136 00000100:00100000:1.0:1746065142.535970:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307136 00002000:00100000:1.0:1746065142.536013:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (2674688->2678783) req@ffff880092744e00 x1830881263307136/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.536022:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744e00 with x1830881263307136 ext(2674688->2678783) 00010000:00010000:1.0:1746065142.536028:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.536040:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065142.536046:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092744e00 00000100:00100000:1.0:1746065142.536375:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1230 00000100:00100000:1.0:1746065142.536382:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263307136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065142.536473:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263307136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 91us (613us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.536481:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1230 00002000:00100000:1.0:1746065142.536486:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (2674688->2678783) req@ffff880092744e00 x1830881263307136/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.536492:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744e00 with x1830881263307136 ext(2674688->2678783) 00010000:00010000:1.0:1746065142.536496:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.536504:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065142.536510:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092744e00 00000100:00100000:0.0:1746065142.540325:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.540768:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307392 00000100:00100000:1.0:1746065142.540802:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307392 00002000:00100000:1.0:1746065142.540839:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (2740224->2744319) req@ffff880092745180 x1830881263307392/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.540847:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745180 with x1830881263307392 ext(2740224->2744319) 00010000:00010000:1.0:1746065142.540854:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.540866:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065142.540872:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092745180 00000100:00100000:1.0:1746065142.540891:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1231 00000100:00100000:1.0:1746065142.540897:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263307392:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065142.541034:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263307392:12345-192.168.202.27@tcp:3:cat.0 Request processed in 136us (716us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065142.541039:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1231 00002000:00100000:1.0:1746065142.541044:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (2740224->2744319) req@ffff880092745180 x1830881263307392/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.541051:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745180 with x1830881263307392 ext(2740224->2744319) 00010000:00010000:1.0:1746065142.541055:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.541063:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065142.541068:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092745180 00000100:00100000:0.0:1746065142.543527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.543603:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307648 00000100:00100000:2.0:1746065142.543609:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307648 00002000:00100000:2.0:1746065142.543641:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2674688->2744319) req@ffff880092746a00 x1830881263307648/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.543649:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746a00 with x1830881263307648 ext(2674688->2744319) 00010000:00010000:2.0:1746065142.543656:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.543667:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 13 pid: 1880 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.543673:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092746a00 00000100:00100000:2.0:1746065142.543700:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1232 00000100:00100000:2.0:1746065142.543706:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263307648:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065142.549014:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263307648:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5289us (5473us total) trans 21474840813 rc 0/0 00000100:00100000:2.0:1746065142.549026:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1232 00002000:00100000:2.0:1746065142.549035:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2674688->2744319) req@ffff880092746a00 x1830881263307648/t21474840813(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.549044:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746a00 with x1830881263307648 ext(2674688->2744319) 00010000:00010000:2.0:1746065142.549053:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 15 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.549067:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 15 pid: 1880 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.549073:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092746a00 00000100:00100000:0.0:1746065142.552237:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.552427:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307776 00000100:00100000:2.0:1746065142.552435:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307776 00010000:00010000:2.0:1746065142.552466:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 15 pid: 1880 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.552506:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5635 00000100:00100000:2.0:1746065142.552512:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263307776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.552525:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.552541:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 15 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.552552:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 15 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.552576:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146e0cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2674688->2744319) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ae6 expref: 15 pid: 1880 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.552600:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.552602:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.552612:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.552620:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.552627:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.552628:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.552631:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.552637:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.552664:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.552674:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263252224:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065142.552754:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.552766:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263252352:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065142.553049:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.556632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.556729:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263252224:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065142.556739:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263252352:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065142.556755:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.556813:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263307776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4300us (4582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.556823:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5635 00000100:00100000:3.0:1746065142.556896:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308032 00000100:00100000:3.0:1746065142.556902:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308032 00002000:00100000:3.0:1746065142.556935:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092747480 x1830881263308032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.556944:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747480 with x1830881263308032 ext(4194304->5021695) 00002000:00010000:3.0:1746065142.556949:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747480 00000100:00100000:3.0:1746065142.557492:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3465 00000100:00100000:3.0:1746065142.557500:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263308032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.566548:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263308032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9040us (9914us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065142.566558:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3465 00002000:00100000:3.0:1746065142.566568:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092747480 x1830881263308032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.566576:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747480 with x1830881263308032 ext(4194304->5021695) 00002000:00010000:3.0:1746065142.566581:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747480 00000100:00100000:0.0:1746065142.587937:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.587983:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.591797:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308544 00000100:00100000:1.0:1746065142.591808:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308544 00002000:00100000:1.0:1746065142.591848:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880092744000 x1830881263308544/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.591856:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744000 with x1830881263308544 ext(2097152->4194303) 00002000:00010000:1.0:1746065142.591861:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092744000 00000100:00100000:1.0:1746065142.591885:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308288 00000100:00100000:1.0:1746065142.591887:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308288 00002000:00100000:1.0:1746065142.591898:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880092747100 x1830881263308288/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.591903:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747100 with x1830881263308288 ext(2097152->4194303) 00002000:00010000:1.0:1746065142.591906:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747100 00000100:00100000:1.0:1746065142.591932:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3466 00000100:00100000:1.0:1746065142.591938:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+30:2004:x1830881263308544:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.594256:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3467 00000100:00100000:0.0:1746065142.594267:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263308288:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065142.616060:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+30:2004:x1830881263308544:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24112us (28121us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065142.616071:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3466 00002000:00100000:1.0:1746065142.616080:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880092744000 x1830881263308544/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.616089:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744000 with x1830881263308544 ext(2097152->4194303) 00002000:00010000:1.0:1746065142.616094:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092744000 00000100:00100000:2.0:1746065142.625919:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263308288:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31645us (37926us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065142.625931:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3467 00002000:00100000:2.0:1746065142.625941:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880092747100 x1830881263308288/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.625950:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747100 with x1830881263308288 ext(2097152->4194303) 00002000:00010000:2.0:1746065142.625966:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747100 00000100:00100000:0.0:1746065142.639954:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.640062:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308800 00000100:00100000:2.0:1746065142.640071:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308800 00002000:00100000:2.0:1746065142.640113:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092747b80 x1830881263308800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.640121:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747b80 with x1830881263308800 ext(4194304->5021695) 00002000:00010000:2.0:1746065142.640126:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747b80 00000100:00100000:2.0:1746065142.640160:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3468 00000100:00100000:2.0:1746065142.640166:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263308800:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.652968:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263252480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065142.653041:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065142.654457:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252480 00000100:00100000:1.0:1746065142.654465:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252480 00000100:00100000:1.0:1746065142.654512:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1746065142.654520:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263252480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746065142.654539:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1143990592 pending 10649600 free 3910807552 avail 3679285248 00000100:00100000:1.0:1746065142.654575:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263252480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.654580:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00080000:3.0:1746065142.657224:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065142.657896:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263308800:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17724us (17943us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065142.657906:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3468 00002000:00100000:2.0:1746065142.657915:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092747b80 x1830881263308800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.657923:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747b80 with x1830881263308800 ext(4194304->5021695) 00002000:00010000:2.0:1746065142.657928:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747b80 00000100:00100000:0.0:1746065142.658139:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263252480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065142.666024:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.666425:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308928 00000100:00100000:1.0:1746065142.666433:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308928 00000100:00100000:1.0:1746065142.666487:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12660 00000100:00100000:1.0:1746065142.666495:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:31961:x1830881263308928:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065142.666512:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.666528:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b1e expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.666558:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.666565:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.666571:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.666573:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.666576:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.666601:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.666611:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 26 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.666622:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263252608:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.666712:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.666720:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 13 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.666727:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263252736:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.666749:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.671545:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.671587:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.671601:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309056 00000100:00100000:2.0:1746065142.671608:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309056 00010000:00010000:2.0:1746065142.671640:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 27 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.671666:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5636 00000100:00100000:2.0:1746065142.671673:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263309056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.671683:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.671707:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 27 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.671717:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 27 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.671738:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.671790:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263309056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.671797:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5636 00010000:00010000:1.0:1746065142.671863:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46800/0xad6b7ddc146e0fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b17 expref: 26 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.671878:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263252608:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.671887:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263252736:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.671908:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.671917:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00c00, rc 0) 00000100:00100000:1.0:1746065142.671937:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:31961:x1830881263308928:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5443us (5936us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.671943:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12660 00000100:00100000:3.0:1746065142.671947:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309184 00000100:00100000:3.0:1746065142.671951:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309184 00000100:00100000:3.0:1746065142.671975:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12661 00000100:00100000:3.0:1746065142.671980:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+14:31954:x1830881263309184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.671990:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.671999:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b25 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.672022:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.672023:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.672029:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.672039:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.672050:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d03c400, rc 0) 00000100:00100000:3.0:1746065142.672078:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+15:31954:x1830881263309184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 98us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.672083:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12661 00000100:00100000:0.0:1746065142.679444:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.680029:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.680112:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309440 00000100:00100000:1.0:1746065142.680121:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309440 00010000:00010000:1.0:1746065142.680150:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 15 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.680188:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5637 00000100:00100000:1.0:1746065142.680195:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263309440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065142.680208:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065142.680223:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 15 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.680233:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 15 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.680251:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e0f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b10 expref: 15 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.680276:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.680278:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.680284:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.680290:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.680315:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.680324:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263252864:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065142.680383:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.681050:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309312 00000100:00100000:3.0:1746065142.681176:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309312 00000100:00100000:3.0:1746065142.681553:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12662 00000100:00100000:3.0:1746065142.681716:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263309312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.681729:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.681741:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146e112 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b2c expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.681762:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146e112 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b2c expref: 16 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.681796:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146e112 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b2c expref: 16 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.681812:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:3.0:1746065142.682195:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263309312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 480us (2756us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065142.682201:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12662 00000100:00100000:0.0:1746065142.683743:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.683810:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309696 00000100:00100000:2.0:1746065142.683818:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309696 00002000:00100000:2.0:1746065142.683851:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880090ddb800 x1830881263309696/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.683859:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb800 with x1830881263309696 ext(5017600->5021695) 00002000:00010000:2.0:1746065142.683864:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddb800 00000100:00100000:2.0:1746065142.683892:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3469 00000100:00100000:2.0:1746065142.683898:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263309696:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.684018:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263309696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 119us (277us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.684023:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3469 00002000:00100000:2.0:1746065142.684028:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880090ddb800 x1830881263309696/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.684034:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb800 with x1830881263309696 ext(5017600->5021695) 00002000:00010000:2.0:1746065142.684037:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddb800 00000100:00100000:1.0:1746065142.689404:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.689466:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309952 00000100:00100000:3.0:1746065142.689472:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309952 00000100:00100000:2.0:1746065142.689485:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263252864:192.168.202.27@tcp:105: 00002000:00100000:3.0:1746065142.689505:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3911680->3915775) req@ffff880097fa1500 x1830881263309952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746065142.689505:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065142.689515:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1500 with x1830881263309952 ext(3911680->3915775) 00002000:00010000:3.0:1746065142.689519:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa1500 00000100:00100000:3.0:1746065142.689544:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3470 00000100:00100000:3.0:1746065142.689550:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263309952:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065142.689555:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263309440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9359us (9524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.689563:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5637 00000100:00100000:3.0:1746065142.689647:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263309952:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 96us (249us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.689652:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3470 00002000:00100000:3.0:1746065142.689656:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3911680->3915775) req@ffff880097fa1500 x1830881263309952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.689663:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1500 with x1830881263309952 ext(3911680->3915775) 00002000:00010000:3.0:1746065142.689666:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa1500 00000001:00080000:3.0:1746065142.689692:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873375 is committed 00000001:00080000:3.0:1746065142.689712:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873373 is committed 00000001:00080000:3.0:1746065142.689743:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873363 is committed 00000001:00080000:3.0:1746065142.689762:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873347 is committed 00000100:00100000:0.0:1746065142.695876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.695951:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310080 00000100:00100000:3.0:1746065142.695958:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310080 00000100:00100000:3.0:1746065142.696010:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12663 00000100:00100000:3.0:1746065142.696017:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+27:31961:x1830881263310080:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065142.696033:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.696046:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b33 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.696072:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.696081:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.696086:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.696088:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.696090:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.696112:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.696122:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 7 pid: 12258 timeout: 838 lvb_type: 1 00000100:00100000:3.0:1746065142.696131:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263252992:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.696194:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.696201:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 28 pid: 12260 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.696209:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263253120:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.696226:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065142.701606:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263252992:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.701614:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263253120:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.701636:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.701648:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fa00, rc 0) 00000100:00100000:3.0:1746065142.701755:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+28:31961:x1830881263310080:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5737us (5883us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.701763:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12663 00000100:00100000:0.0:1746065142.705397:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.705634:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310208 00000100:00100000:2.0:1746065142.705642:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310208 00010000:00010000:2.0:1746065142.705672:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 28 pid: 12260 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.705703:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5638 00000100:00100000:2.0:1746065142.705711:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263310208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.705723:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.705739:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 28 pid: 12260 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.705749:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 28 pid: 12260 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.705767:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146e078 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ab5 expref: 28 pid: 12260 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.705806:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.705918:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263310208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 206us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.705924:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5638 00000100:00100000:2.0:1746065142.709960:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.710088:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310336 00000100:00100000:0.0:1746065142.710095:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310336 00010000:00010000:0.0:1746065142.710207:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 8 pid: 12258 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746065142.710243:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5639 00000100:00100000:0.0:1746065142.710251:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263310336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.710263:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.710528:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 8 pid: 12258 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.710888:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 8 pid: 12258 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.710912:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146e0a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ad8 expref: 8 pid: 12258 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746065142.710934:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.710935:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.710942:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.710949:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.710980:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.710991:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263253248:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065142.711083:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.726102:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263253248:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065142.726121:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.726211:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263310336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15960us (16256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.726220:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5639 00000100:00100000:0.0:1746065142.734229:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.735831:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310592 00000100:00100000:1.0:1746065142.735843:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310592 00002000:00100000:1.0:1746065142.735883:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3694592->3698687) req@ffff88009aecb480 x1830881263310592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.735893:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb480 with x1830881263310592 ext(3694592->3698687) 00002000:00010000:1.0:1746065142.735898:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecb480 00000100:00100000:0.0:1746065142.736321:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3471 00000100:00100000:0.0:1746065142.736331:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263310592:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065142.736448:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263310592:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 119us (2227us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065142.736454:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3471 00002000:00100000:0.0:1746065142.736459:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (3694592->3698687) req@ffff88009aecb480 x1830881263310592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.736465:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb480 with x1830881263310592 ext(3694592->3698687) 00002000:00010000:0.0:1746065142.736467:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecb480 00000100:00100000:1.0:1746065142.797183:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065142.797202:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263253376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746065142.797281:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065142.797500:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263253376 00000100:00100000:2.0:1746065142.797509:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263253376 00000100:00100000:2.0:1746065142.798081:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1746065142.798090:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263253376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746065142.798111:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1205671360 pending 1036288 free 3903262720 avail 3662434304 00000100:00100000:2.0:1746065142.798153:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263253376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.798159:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00080000:3.0:1746065142.798214:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065142.798479:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263253376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746065142.799019:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.799064:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310720 00000100:00100000:3.0:1746065142.799068:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310720 00000100:00100000:3.0:1746065142.799104:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12664 00000100:00100000:3.0:1746065142.799110:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263310720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.799121:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.799136:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc146e120 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b3a expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.799165:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc146e120 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b3a expref: 26 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.799174:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc146e120 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b3a expref: 26 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.799197:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61800, rc 0) 00000100:00100000:3.0:1746065142.799234:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263310720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 123us (230us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065142.799239:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12664 00000100:00100000:0.0:1746065142.821280:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.821311:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.821334:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.821366:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.821398:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310976 00000100:00100000:0.0:1746065142.821405:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310976 00002000:00100000:0.0:1746065142.821439:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009aecbb80 x1830881263310976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.821449:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecbb80 with x1830881263310976 ext(0->1048575) 00002000:00010000:0.0:1746065142.821455:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aecbb80 00000100:00100000:0.0:1746065142.821466:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311232 00000100:00100000:0.0:1746065142.821467:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311232 00002000:00100000:0.0:1746065142.821476:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009aecb800 x1830881263311232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.821482:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb800 with x1830881263311232 ext(1048576->2097151) 00002000:00010000:0.0:1746065142.821485:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecb800 00000100:00100000:0.0:1746065142.821491:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311488 00000100:00100000:0.0:1746065142.821492:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311488 00002000:00100000:0.0:1746065142.821498:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009aec8a80 x1830881263311488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.821505:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881263311488 ext(1048576->2097151) 00002000:00010000:0.0:1746065142.821507:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8a80 00000100:00100000:0.0:1746065142.821512:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311744 00000100:00100000:0.0:1746065142.821513:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311744 00002000:00100000:0.0:1746065142.821520:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009aec9180 x1830881263311744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.821525:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881263311744 ext(1048576->2097151) 00002000:00010000:0.0:1746065142.821527:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9180 00000100:00100000:0.0:1746065142.821540:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3472 00000100:00100000:0.0:1746065142.821546:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263310976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.822988:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3473 00000100:00100000:0.0:1746065142.822999:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263311232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.823559:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3474 00000100:00100000:0.0:1746065142.823565:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263311488:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.824124:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3475 00000100:00100000:0.0:1746065142.824131:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263311744:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.838204:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.838267:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.838350:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312000 00000100:00100000:3.0:1746065142.838358:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312000 00000100:00100000:3.0:1746065142.838395:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311872 00000100:00100000:3.0:1746065142.838397:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311872 00000100:00100000:3.0:1746065142.838412:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12665 00000100:00100000:3.0:1746065142.838419:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+15:31969:x1830881263312000:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065142.838436:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.838451:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b4f expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.838477:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.838484:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.838485:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.838488:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3371008->3960831] (req 3371008->3960831) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.838512:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.838523:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 28 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.838523:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12666 00000100:00100000:0.0:1746065142.838530:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263311872:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065142.838532:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263253504:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065142.838536:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.838541:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc146e12e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b41 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.838555:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc146e12e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b41 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.838561:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc146e12e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b41 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065142.838573:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abadc00, rc 0) 00000100:00100000:3.0:1746065142.838592:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065142.838592:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263311872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 63us (325us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065142.838597:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12666 00000100:00100000:0.0:1746065142.843683:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.844861:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312128 00000100:00100000:1.0:1746065142.844871:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312128 00000100:00100000:1.0:1746065142.844929:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12667 00000100:00100000:1.0:1746065142.844937:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263312128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.844954:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.844969:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e135 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b48 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065142.845030:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263253632:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065142.851645:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.852322:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263310976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30772us (31046us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065142.852330:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3472 00002000:00100000:2.0:1746065142.852339:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009aecbb80 x1830881263310976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.852348:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecbb80 with x1830881263310976 ext(0->1048575) 00002000:00010000:2.0:1746065142.852352:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aecbb80 00000100:00100000:3.0:1746065142.852677:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263253504:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065142.852701:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3371008->3960831] (req 3371008->3960831) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.852716:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e26200, rc 0) 00000100:00100000:3.0:1746065142.852738:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+15:31969:x1830881263312000:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 14319us (14545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.852744:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12665 00000100:00100000:3.0:1746065142.859236:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.859271:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.859454:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263311232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36457us (38141us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065142.859463:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3473 00002000:00100000:1.0:1746065142.859472:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009aecb800 x1830881263311232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.859481:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb800 with x1830881263311232 ext(1048576->2097151) 00002000:00010000:1.0:1746065142.859486:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecb800 00000100:00100000:1.0:1746065142.859506:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312256 00000100:00100000:1.0:1746065142.859511:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312256 00002000:00100000:1.0:1746065142.859536:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3911680->4194303) req@ffff88012f09ca80 x1830881263312256/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.859543:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ca80 with x1830881263312256 ext(3911680->4194303) 00010000:00010000:1.0:1746065142.859550:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 27 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.859566:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 27 pid: 3067 timeout: 838 lvb_type: 0 00002000:00010000:1.0:1746065142.859571:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09ca80 00000100:00100000:1.0:1746065142.859586:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1233 00000100:00100000:1.0:1746065142.859592:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263312256:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065142.859963:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312384 00000100:00100000:0.0:1746065142.859968:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312384 00000100:00100000:0.0:1746065142.860176:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13525 00000100:00100000:0.0:1746065142.860182:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:31976:x1830881263312384:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065142.860197:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.860210:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146e13c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b56 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.860251:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.860261:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.860270:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.860280:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.860285:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.860290:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.860347:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.860357:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.860364:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.860369:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.860395:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.860403:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 43 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.860412:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263253760:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065142.864336:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.864352:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 25 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746065142.864364:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263253888:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065142.864422:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.872839:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263311488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 49264us (51494us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065142.872848:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3474 00002000:00100000:1.0:1746065142.872858:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009aec8a80 x1830881263311488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.872866:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881263311488 ext(1048576->2097151) 00002000:00010000:1.0:1746065142.872871:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8a80 00002000:00010000:1.0:1746065142.874443:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065142 -> 1746065143 00000100:00100000:1.0:1746065142.874458:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263253632:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065142.874488:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e135 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b48 expref: 8 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.874500:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e135 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b48 expref: 8 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.874524:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a800, rc 0) 00000100:00100000:1.0:1746065142.874560:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263312128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 29624us (30883us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065142.874567:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12667 00000100:00100000:2.0:1746065142.877518:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263312256:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17917us (18281us total) trans 21474840814 rc 0/0 00000100:00100000:2.0:1746065142.877528:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1233 00002000:00100000:2.0:1746065142.877538:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3911680->4194303) req@ffff88012f09ca80 x1830881263312256/t21474840814(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.877547:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ca80 with x1830881263312256 ext(3911680->4194303) 00010000:00010000:2.0:1746065142.877554:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 29 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.877569:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 29 pid: 3067 timeout: 838 lvb_type: 0 00002000:00010000:2.0:1746065142.877574:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09ca80 00000100:00100000:1.0:1746065142.879487:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.879555:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263253760:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.879640:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312640 00000100:00100000:3.0:1746065142.879647:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312640 00000100:00100000:1.0:1746065142.879755:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.879885:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263311744:12345-192.168.202.27@tcp:3:cat.0 Request processed in 55753us (58516us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065142.879893:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3475 00002000:00100000:0.0:1746065142.879900:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009aec9180 x1830881263311744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.879908:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881263311744 ext(1048576->2097151) 00002000:00010000:0.0:1746065142.879913:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9180 00000100:00100000:0.0:1746065142.879938:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312768 00000100:00100000:0.0:1746065142.879940:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312768 00010000:00010000:0.0:1746065142.879955:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 26 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.879970:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5640 00000100:00100000:0.0:1746065142.879975:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881263312768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.879985:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.879990:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 26 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.880013:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 26 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.880033:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065142.880037:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.880044:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.880049:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.880053:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065142.880066:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881263312768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.880071:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5640 00000100:00100000:3.0:1746065142.880186:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4853 00000100:00100000:3.0:1746065142.880192:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+44:30398:x1830881263312640:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065142.880314:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+45:30398:x1830881263312640:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 122us (832us total) trans 8589935832 rc 0/0 00000100:00100000:3.0:1746065142.880319:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4853 00010000:00010000:2.0:1746065142.880474:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146e086 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aae expref: 25 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.880495:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263253888:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065142.880513:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065142.888052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.888134:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.888381:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.889158:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313024 00000100:00100000:2.0:1746065142.889168:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313024 00002000:00100000:2.0:1746065142.889207:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009c5f1f80 x1830881263313024/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.889216:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1f80 with x1830881263313024 ext(0->1048575) 00002000:00010000:2.0:1746065142.889221:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f1f80 00000100:00100000:2.0:1746065142.889243:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313280 00000100:00100000:2.0:1746065142.889246:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313280 00002000:00100000:2.0:1746065142.889257:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009c5f1880 x1830881263313280/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.889264:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1880 with x1830881263313280 ext(1048576->2097151) 00002000:00010000:2.0:1746065142.889267:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f1880 00000100:00100000:2.0:1746065142.889275:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313536 00000100:00100000:2.0:1746065142.889278:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313536 00002000:00100000:2.0:1746065142.889288:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880098ddad80 x1830881263313536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.889293:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddad80 with x1830881263313536 ext(1048576->2097151) 00002000:00010000:2.0:1746065142.889296:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098ddad80 00000100:00100000:2.0:1746065142.889307:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3476 00000100:00100000:2.0:1746065142.889313:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263313024:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.889917:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3477 00000100:00100000:2.0:1746065142.889923:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263313280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.890430:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3478 00000100:00100000:2.0:1746065142.890436:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263313536:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065142.891622:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.893737:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313792 00000100:00100000:1.0:1746065142.893747:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313792 00000100:00100000:1.0:1746065142.893810:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13526 00000100:00100000:1.0:1746065142.893817:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+45:31978:x1830881263313792:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065142.893835:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.893852:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc146e158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b5d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.893936:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065142.893947:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065142.893952:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065142.893967:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065142.893975:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.895681:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065142.904449:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.904483:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.904634:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313920 00000100:00100000:2.0:1746065142.904641:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313920 00010000:00010000:2.0:1746065142.904670:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 27 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.904698:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5641 00000100:00100000:2.0:1746065142.904704:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263313920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.904716:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.904732:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 27 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.904741:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 27 pid: 3067 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.904763:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc146e104 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b1e expref: 27 pid: 3067 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.907266:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.907284:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314176 00000100:00100000:3.0:1746065142.907290:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314176 00010000:00010000:3.0:1746065142.907315:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 47 pid: 9571 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.907345:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5642 00000100:00100000:3.0:1746065142.907352:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881263314176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065142.907367:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065142.907371:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 47 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.907385:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 47 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.907402:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146e0be lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932adf expref: 47 pid: 9571 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.907417:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065142.907421:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907430:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907436:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907442:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.907448:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.907468:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065142.907503:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881263314176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 151us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.907509:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5642 00010000:00010000:3.0:1746065142.907580:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907587:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065142.907632:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065142.907636:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065142.907651:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907658:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907667:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907672:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907677:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907683:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907687:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065142.907690:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907696:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907703:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065142.907706:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065142.907708:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907713:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146e143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907723:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907728:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907732:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907736:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abac000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065142.907738:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907742:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907747:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098c65e00) 00010000:00010000:3.0:1746065142.907749:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065142.907751:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907755:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc146e14a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.907797:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146e13c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b56 expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.907811:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b56 expref: 15 pid: 7203 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.907818:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b56 expref: 15 pid: 7203 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.907828:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abade00, rc 0) 00000100:00100000:3.0:1746065142.907850:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:31976:x1830881263312384:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 47668us (48578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.907856:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13525 00010000:00010000:2.0:1746065142.908934:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.908938:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065142.908946:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.908955:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.908985:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065142.908997:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263254016:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065142.909087:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.909295:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314048 00000100:00100000:1.0:1746065142.909301:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314048 00000100:00100000:1.0:1746065142.909329:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12668 00000100:00100000:1.0:1746065142.909335:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+27:31972:x1830881263314048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065142.909347:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.909357:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b64 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.909370:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.909371:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.909375:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.909384:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.909392:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46c00, rc 0) 00000100:00100000:1.0:1746065142.909428:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:31972:x1830881263314048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 92us (4943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.909433:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12668 00000100:00100000:2.0:1746065142.912714:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263313024:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23390us (24659us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065142.912725:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3476 00002000:00100000:2.0:1746065142.912734:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009c5f1f80 x1830881263313024/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.912743:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1f80 with x1830881263313024 ext(0->1048575) 00002000:00010000:2.0:1746065142.912748:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f1f80 00000100:00100000:2.0:1746065142.913902:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263254016:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065142.913919:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.914033:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263313920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9327us (9589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.914040:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5641 00000100:00100000:0.0:1746065142.916273:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.916562:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314432 00000100:00100000:2.0:1746065142.916570:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314432 00002000:00100000:2.0:1746065142.916605:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3371008->3375103) req@ffff880098dda680 x1830881263314432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.916614:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dda680 with x1830881263314432 ext(3371008->3375103) 00002000:00010000:2.0:1746065142.916618:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dda680 00000100:00100000:2.0:1746065142.916637:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3479 00000100:00100000:2.0:1746065142.916644:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263314432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.917978:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263314432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 1331us (1708us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065142.917987:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3479 00002000:00100000:2.0:1746065142.917993:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3371008->3375103) req@ffff880098dda680 x1830881263314432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.918009:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dda680 with x1830881263314432 ext(3371008->3375103) 00002000:00010000:2.0:1746065142.918012:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dda680 00000100:00100000:3.0:1746065142.918615:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263313280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28690us (30479us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065142.918622:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3477 00002000:00100000:3.0:1746065142.918627:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009c5f1880 x1830881263313280/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.918633:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1880 with x1830881263313280 ext(1048576->2097151) 00002000:00010000:3.0:1746065142.918637:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f1880 00000100:00100000:2.0:1746065142.924990:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.925051:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.925093:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314688 00000100:00100000:0.0:1746065142.925101:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314688 00000100:00100000:3.0:1746065142.925113:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314944 00000100:00100000:3.0:1746065142.925116:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314944 00002000:00100000:3.0:1746065142.925136:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88012f1a5c00 x1830881263314944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065142.925136:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880136a7aa00 x1830881263314688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.925146:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5c00 with x1830881263314944 ext(2097152->3145727) 00002000:00010000:3.0:1746065142.925151:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5c00 00002000:00100000:0.0:1746065142.925151:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7aa00 with x1830881263314688 ext(2097152->3145727) 00002000:00010000:0.0:1746065142.925153:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a7aa00 00000100:00100000:0.0:1746065142.925180:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3480 00000100:00100000:0.0:1746065142.925188:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263314688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.925194:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3481 00000100:00100000:3.0:1746065142.925198:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263314944:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.930497:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263313536:12345-192.168.202.27@tcp:3:cat.0 Request processed in 40052us (42107us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065142.930509:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3478 00002000:00100000:3.0:1746065142.930518:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880098ddad80 x1830881263313536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.930527:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddad80 with x1830881263313536 ext(1048576->2097151) 00002000:00010000:3.0:1746065142.930532:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098ddad80 00000100:00100000:0.0:1746065142.938285:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.938357:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.938670:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.938718:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315072 00000100:00100000:3.0:1746065142.938726:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315072 00000100:00100000:3.0:1746065142.938765:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13527 00000100:00100000:3.0:1746065142.938796:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:31976:x1830881263315072:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065142.938814:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.938831:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146e16d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b6b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.938885:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.938897:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.938903:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.938916:0:7203:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065142.938925:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065142.939120:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315200 00000100:00100000:2.0:1746065142.939125:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315200 00010000:00010000:2.0:1746065142.939142:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b56 expref: 17 pid: 7203 timeout: 838 lvb_type: 0 00000100:00100000:2.0:1746065142.939163:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5643 00000100:00100000:2.0:1746065142.939168:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2007:x1830881263315200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.939177:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.939180:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b56 expref: 17 pid: 7203 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.939191:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b56 expref: 17 pid: 7203 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.939204:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146e151 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b56 expref: 17 pid: 7203 timeout: 838 lvb_type: 0 00010000:00010000:2.0:1746065142.939219:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.939222:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.939229:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.939233:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065142.939239:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065142.939243:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065142.939248:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065142.939264:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.939299:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263315200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 130us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.939305:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5643 00000100:00100000:3.0:1746065142.939462:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315456 00000100:00100000:3.0:1746065142.939466:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315456 00002000:00100000:3.0:1746065142.939487:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3956736->3960831) req@ffff880129f41180 x1830881263315456/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.939501:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41180 with x1830881263315456 ext(3956736->3960831) 00002000:00010000:3.0:1746065142.939505:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f41180 00000100:00100000:3.0:1746065142.939519:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3482 00000100:00100000:3.0:1746065142.939524:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263315456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065142.939615:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263315456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 90us (945us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065142.939620:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3482 00002000:00100000:3.0:1746065142.939625:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3956736->3960831) req@ffff880129f41180 x1830881263315456/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.939631:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41180 with x1830881263315456 ext(3956736->3960831) 00002000:00010000:3.0:1746065142.939634:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f41180 00010000:00010000:1.0:1746065142.939716:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065142.939725:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065142.939740:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065142.939847:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc146e158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b5d expref: 47 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.939864:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b5d expref: 46 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.939870:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b5d expref: 46 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746065142.939874:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46e00, rc 0) 00000100:00100000:1.0:1746065142.939892:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+46:31978:x1830881263313792:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 46076us (48272us total) trans 8589935833 rc 0/0 00000100:00100000:1.0:1746065142.939897:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13526 00000100:00100000:3.0:1746065142.940117:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263314944:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14917us (15065us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065142.940123:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3481 00002000:00100000:3.0:1746065142.940128:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88012f1a5c00 x1830881263314944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.940135:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5c00 with x1830881263314944 ext(2097152->3145727) 00002000:00010000:3.0:1746065142.940138:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5c00 00000100:00100000:1.0:1746065142.943957:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263314688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18585us (18790us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065142.943967:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3480 00002000:00100000:1.0:1746065142.943977:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880136a7aa00 x1830881263314688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065142.943985:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7aa00 with x1830881263314688 ext(2097152->3145727) 00002000:00010000:1.0:1746065142.943990:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a7aa00 00000100:00100000:0.0:1746065142.949065:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.949184:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315712 00000100:00100000:2.0:1746065142.949193:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315712 00000100:00100000:2.0:1746065142.949244:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4854 00000100:00100000:2.0:1746065142.949251:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+25:31969:x1830881263315712:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065142.949599:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+26:31969:x1830881263315712:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 347us (540us total) trans 8589935834 rc 0/0 00000100:00100000:2.0:1746065142.949605:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4854 00000100:00100000:2.0:1746065142.952694:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.953128:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315840 00000100:00100000:0.0:1746065142.953137:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315840 00010000:00010000:0.0:1746065142.953168:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b5d expref: 46 pid: 7231 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746065142.953207:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5644 00000100:00100000:0.0:1746065142.953215:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881263315840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.953228:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065142.953232:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b5d expref: 46 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.953243:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b5d expref: 46 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.953262:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e15f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b5d expref: 46 pid: 7231 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746065142.953289:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065142.953294:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.953303:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.953310:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065142.953327:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065142.953595:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.953602:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065142.953645:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065142.953649:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065142.953665:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.953675:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065142.953696:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146e16d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.953711:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 15 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.953716:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065142.953719:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065142.953721:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46800, rc 0) 00000100:00100000:3.0:1746065142.953759:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:31976:x1830881263315072:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 14987us (15482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.953766:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13527 00000100:00100000:3.0:1746065142.954995:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263315840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1775us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.955013:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5644 00000100:00100000:0.0:1746065142.961517:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.961559:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.961585:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.961661:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065142.961685:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315968 00000100:00100000:0.0:1746065142.961693:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315968 00000100:00100000:0.0:1746065142.961725:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316096 00000100:00100000:0.0:1746065142.961727:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316096 00000100:00100000:0.0:1746065142.961742:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316352 00000100:00100000:0.0:1746065142.961744:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316352 00000100:00100000:0.0:1746065142.961754:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316608 00000100:00100000:0.0:1746065142.961755:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316608 00000100:00100000:0.0:1746065142.961766:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12669 00000100:00100000:0.0:1746065142.961794:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+15:31975:x1830881263315968:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065142.961808:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.961822:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b72 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.961843:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.961844:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.961851:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.961867:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.961875:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046e00, rc 0) 00000100:00100000:1.0:1746065142.961960:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12670 00000100:00100000:1.0:1746065142.961969:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263316096:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065142.961977:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065142.961984:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b79 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065142.961995:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.961996:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065142.962012:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.962020:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065142.962026:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46600, rc 0) 00000100:00100000:3.0:1746065142.962086:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12671 00000100:00100000:3.0:1746065142.962092:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2007:x1830881263316352:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065142.962100:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.962107:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b87 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.962117:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.962118:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.962122:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.962129:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.962135:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:2.0:1746065142.962192:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12672 00000100:00100000:2.0:1746065142.962198:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263316608:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065142.962204:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.962209:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc146e197 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b95 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.962223:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc146e197 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b95 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.962230:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc146e197 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b95 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065142.962244:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5ce600, rc 0) 00000100:00100000:0.0:1746065142.962304:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:31975:x1830881263315968:12345-192.168.202.27@tcp:101:cat.0 Request processed in 531us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065142.962310:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12669 00000100:00100000:1.0:1746065142.962353:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263316096:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 386us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065142.962357:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12670 00000100:00100000:3.0:1746065142.962412:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263316352:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 320us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.962417:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12671 00000100:00100000:3.0:1746065142.962450:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.962460:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316224 00000100:00100000:3.0:1746065142.962463:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316224 00000100:00100000:3.0:1746065142.962485:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12673 00000100:00100000:3.0:1746065142.962488:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263316224:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065142.962494:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.962499:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b80 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.962507:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.962508:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.962512:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.962519:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.962525:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47200, rc 0) 00000100:00100000:3.0:1746065142.962536:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263316224:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.962540:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12673 00000100:00100000:3.0:1746065142.962582:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.962592:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316480 00000100:00100000:3.0:1746065142.962595:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316480 00000100:00100000:3.0:1746065142.962615:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12674 00000100:00100000:3.0:1746065142.962620:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263316480:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065142.962625:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.962632:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b8e expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.962641:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.962642:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065142.962645:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.962653:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.962659:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46e00, rc 0) 00000100:00100000:3.0:1746065142.962673:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263316480:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 53us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.962677:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12674 00000100:00100000:3.0:1746065142.962718:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.962729:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316736 00000100:00100000:3.0:1746065142.962732:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316736 00000100:00100000:3.0:1746065142.962745:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12675 00000100:00100000:3.0:1746065142.962750:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263316736:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065142.962755:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.962761:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146e1ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932b9c expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065142.962810:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263254144:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065142.962857:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.963151:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263316608:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 951us (1488us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065142.963157:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12672 00000100:00100000:3.0:1746065142.966826:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263254144:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065142.966852:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146e1ac lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b9c expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.966863:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146e1ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b9c expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065142.966875:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46000, rc 0) 00000100:00100000:3.0:1746065142.966909:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263316736:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4158us (4190us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065142.966915:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12675 00000100:00100000:0.0:1746065142.967761:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.967885:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316864 00000100:00100000:3.0:1746065142.967891:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316864 00000100:00100000:3.0:1746065142.968804:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12676 00000100:00100000:3.0:1746065142.968813:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+27:31972:x1830881263316864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.968829:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.968841:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ba3 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.968865:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.968871:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.968873:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.968875:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.968897:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.968908:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 15 pid: 10219 timeout: 838 lvb_type: 0 00000100:00100000:3.0:1746065142.968918:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263254272:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065142.970351:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065142.972182:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.972216:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.972232:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.972251:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.972268:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316992 00000100:00100000:2.0:1746065142.972274:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316992 00000100:00100000:2.0:1746065142.972307:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 184 00000100:00100000:2.0:1746065142.972314:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2006:x1830881263316992:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1746065142.972363:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2006:x1830881263316992:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.972369:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 184 00000100:00100000:2.0:1746065142.972406:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.972426:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317248 00000100:00100000:2.0:1746065142.972429:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317248 00000100:00100000:2.0:1746065142.972450:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 619 00000100:00100000:2.0:1746065142.972454:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263317248:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1746065142.972479:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263317248:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 24us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.972484:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 619 00000100:00100000:2.0:1746065142.972529:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.972539:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317504 00000100:00100000:2.0:1746065142.972541:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317504 00000100:00100000:2.0:1746065142.972554:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 620 00000100:00100000:2.0:1746065142.972557:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263317504:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1746065142.972575:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263317504:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 17us (47us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.972582:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 620 00000100:00100000:2.0:1746065142.972607:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.972619:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317888 00000100:00100000:2.0:1746065142.972621:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317888 00002000:00100000:2.0:1746065142.972642:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800983b8380 x1830881263317888/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065142.972651:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8380 with x1830881263317888 ext(2097152->3145727) 00002000:00010000:2.0:1746065142.972656:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b8380 00000100:00100000:2.0:1746065142.972667:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3483 00000100:00100000:2.0:1746065142.972672:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263317888:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065142.973346:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263254272:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065142.973368:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.973382:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:2.0:1746065142.973399:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+28:31972:x1830881263316864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4588us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.973405:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12676 00000100:00100000:3.0:1746065142.974218:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317120 00000100:00100000:3.0:1746065142.974223:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317120 00000100:00100000:3.0:1746065142.974257:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317376 00000100:00100000:3.0:1746065142.974259:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317376 00000100:00100000:3.0:1746065142.974272:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317632 00000100:00100000:3.0:1746065142.974274:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317632 00000100:00100000:3.0:1746065142.974285:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 995 00000100:00100000:3.0:1746065142.974290:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2006:x1830881263317120:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065142.974324:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2006:x1830881263317120:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 33us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.974329:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 995 00000100:00100000:3.0:1746065142.974339:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 996 00000100:00100000:3.0:1746065142.974343:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+5:2006:x1830881263317376:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065142.974361:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+5:2006:x1830881263317376:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 18us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.974366:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 996 00000100:00100000:3.0:1746065142.974374:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 997 00000100:00100000:3.0:1746065142.974378:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2006:x1830881263317632:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065142.974396:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2006:x1830881263317632:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 17us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065142.974400:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 997 00000100:00100000:3.0:1746065142.975437:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.975465:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.975482:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318016 00000100:00100000:3.0:1746065142.975486:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318016 00002000:00100000:3.0:1746065142.975510:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3371008->3960831) req@ffff88012f09dc00 x1830881263318016/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/0 e 0 to 0 dl 1746065153 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.975520:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09dc00 with x1830881263318016 ext(3371008->3960831) 00010000:00010000:3.0:1746065142.975528:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 18 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.975539:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 18 pid: 10219 timeout: 838 lvb_type: 0 00002000:00010000:3.0:1746065142.975546:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09dc00 00000100:00100000:3.0:1746065142.975562:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1234 00000100:00100000:3.0:1746065142.975568:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263318016:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065142.975850:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318272 00000100:00100000:0.0:1746065142.975854:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318272 00000100:00100000:0.0:1746065142.975876:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13528 00000100:00100000:0.0:1746065142.975881:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:31976:x1830881263318272:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065142.975890:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065142.975904:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146e1ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932baa expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.975963:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.975975:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.975985:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.975995:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976013:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976018:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976096:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146e1cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976104:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146e1cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976110:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146e1cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065142.976118:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065142.976181:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976187:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976193:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976197:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976201:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065142.976205:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976210:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976222:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065142.976224:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065142.976228:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976232:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e1c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976246:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976250:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976254:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976258:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065142.976260:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976265:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976271:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880095561d00) 00010000:00010000:0.0:1746065142.976273:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065142.976275:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976278:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146e1c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065142.976309:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146e1ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932baa expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.976320:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146e1cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932baa expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.976326:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065142.976328:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065142.976330:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046c00, rc 0) 00000100:00100000:0.0:1746065142.976357:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:31976:x1830881263318272:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 474us (922us total) trans 8589935835 rc 0/0 00000100:00100000:0.0:1746065142.976362:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13528 00000100:00080000:2.0:1746065142.976891:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746065142.992416:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263317888:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19734us (19799us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065142.992426:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3483 00002000:00100000:3.0:1746065142.992436:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800983b8380 x1830881263317888/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/440 e 0 to 0 dl 1746065153 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.992444:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8380 with x1830881263317888 ext(2097152->3145727) 00002000:00010000:3.0:1746065142.992449:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b8380 00000100:00100000:0.0:1746065142.993993:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065142.994072:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.994172:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318400 00000100:00100000:2.0:1746065142.994205:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318400 00000100:00100000:2.0:1746065142.994249:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 711 00000100:00100000:2.0:1746065142.994255:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263318400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065142.994267:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065142.994292:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146e1cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932baa expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.994310:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.994314:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065142.994345:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263318400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065142.994351:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 711 00000100:00100000:2.0:1746065142.994387:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318656 00000100:00100000:2.0:1746065142.994390:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318656 00000100:00100000:2.0:1746065142.994408:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13529 00000100:00100000:2.0:1746065142.994412:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:31976:x1830881263318656:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065142.994429:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065142.994439:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31200/0xad6b7ddc146e1dd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bb1 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.994528:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065142.994874:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263318016:12345-192.168.202.27@tcp:4:cat.0 Request processed in 19306us (19407us total) trans 21474840815 rc 0/0 00000100:00100000:3.0:1746065142.994882:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1234 00002000:00100000:3.0:1746065142.994889:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3371008->3960831) req@ffff88012f09dc00 x1830881263318016/t21474840815(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:58/0 lens 488/448 e 0 to 0 dl 1746065153 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065142.994896:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09dc00 with x1830881263318016 ext(3371008->3960831) 00010000:00010000:3.0:1746065142.994903:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 18 pid: 10219 timeout: 838 lvb_type: 0 00010000:00010000:3.0:1746065142.994915:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 18 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065142.994921:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09dc00 00010000:00010000:2.0:1746065142.995289:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995298:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995309:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995315:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995320:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995326:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065142.995329:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995335:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995342:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065142.995345:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065142.995348:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995352:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146e1e4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065142.995376:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31200/0xad6b7ddc146e1dd lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb1 expref: 17 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.995383:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31200/0xad6b7ddc146e1dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb1 expref: 17 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065142.995390:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31200, rc 0) 00000100:00100000:2.0:1746065142.995426:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:31976:x1830881263318656:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1012us (1353us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065142.995431:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13529 00000100:00100000:1.0:1746065142.997572:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.998204:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318784 00000100:00100000:1.0:1746065142.998211:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065142.998212:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318784 00000100:00100000:3.0:1746065142.998299:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12677 00000100:00100000:3.0:1746065142.998307:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+7:31975:x1830881263318784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065142.998319:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065142.998333:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bb8 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.998356:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.998362:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.998364:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065142.998366:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 8 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.998392:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065142.998402:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 26 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065142.998409:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318912 00000100:00100000:3.0:1746065142.998412:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263254400:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065142.998412:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318912 00010000:00010000:0.0:1746065142.998427:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 18 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065142.998443:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5645 00000100:00100000:0.0:1746065142.998447:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263318912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065142.998455:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065142.998468:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065142 -> 1746065143 00000100:00100000:3.0:1746065142.998473:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065142.998474:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 18 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065142.998482:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 18 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065142.998499:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146e127 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3371008->4194303] (req 3371008->3960831) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b4f expref: 18 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065142.998515:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.998516:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065142.998522:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.998529:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065142.998547:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065142.998554:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263254528:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065142.998575:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065142.998633:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065142.998693:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319168 00000100:00100000:2.0:1746065142.998697:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319168 00000100:00100000:2.0:1746065142.998721:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4855 00000100:00100000:2.0:1746065142.998726:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:31976:x1830881263319168:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065142.998878:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:31976:x1830881263319168:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 151us (245us total) trans 8589935836 rc 0/0 00000100:00100000:2.0:1746065142.998883:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4855 00000100:00100000:1.0:1746065143.004144:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.004210:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263254400:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065143.004210:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263254528:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065143.004226:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065143.004234:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 8 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.004251:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46400, rc 0) 00000100:00100000:0.0:1746065143.004261:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263318912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5812us (6048us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.004266:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+8:31975:x1830881263318784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5961us (6700us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.004270:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5645 00000100:00100000:3.0:1746065143.004271:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12677 00000100:00100000:2.0:1746065143.004337:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319296 00000100:00100000:2.0:1746065143.004343:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319296 00002000:00100000:2.0:1746065143.004381:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3698687) req@ffff880097fa0e00 x1830881263319296/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.004389:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0e00 with x1830881263319296 ext(3145728->3698687) 00010000:00010000:2.0:1746065143.004395:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 27 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.004405:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 27 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065143.004411:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa0e00 00000100:00100000:2.0:1746065143.004425:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1235 00000100:00100000:2.0:1746065143.004431:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263319296:12345-192.168.202.27@tcp:4:cat.0 00000100:00080000:3.0:1746065143.004628:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065143.004866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.004903:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319552 00000100:00100000:3.0:1746065143.004907:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319552 00002000:00100000:3.0:1746065143.004936:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa3480 x1830881263319552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.004943:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3480 with x1830881263319552 ext(3145728->4194303) 00000100:00080000:2.0:1746065143.004945:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1746065143.004946:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3480 00000100:00100000:3.0:1746065143.004959:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3484 00000100:00100000:3.0:1746065143.004964:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263319552:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065143.017150:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263319296:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12711us (13006us total) trans 17179873376 rc 0/0 00000100:00100000:2.0:1746065143.017161:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1235 00002000:00100000:2.0:1746065143.017171:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3698687) req@ffff880097fa0e00 x1830881263319296/t17179873376(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.017179:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0e00 with x1830881263319296 ext(3145728->3698687) 00010000:00010000:2.0:1746065143.017189:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.017202:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065143.017209:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa0e00 00000100:00100000:3.0:1746065143.017507:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263319552:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12540us (12666us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.017514:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3484 00002000:00100000:3.0:1746065143.017519:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa3480 x1830881263319552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.017526:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3480 with x1830881263319552 ext(3145728->4194303) 00002000:00010000:3.0:1746065143.017529:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3480 00000100:00100000:0.0:1746065143.019302:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.019386:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319680 00000100:00100000:2.0:1746065143.019392:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319680 00010000:00010000:2.0:1746065143.019418:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.019440:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5646 00000100:00100000:2.0:1746065143.019446:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263319680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.019458:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.019474:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.019485:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.019505:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993fa00/0xad6b7ddc146e119 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b33 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.019708:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.019710:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.019717:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 7 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.019728:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 7 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.019758:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 7 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.019769:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263254656:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065143.021387:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.021962:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.022180:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319808 00000100:00100000:3.0:1746065143.022187:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319808 00000100:00100000:3.0:1746065143.022225:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12678 00000100:00100000:3.0:1746065143.022231:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:31972:x1830881263319808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.022244:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.022257:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bbf expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.022274:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.022275:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.022280:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.022291:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.022298:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46600, rc 0) 00000100:00100000:3.0:1746065143.022334:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:31972:x1830881263319808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 103us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.022339:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12678 00000100:00100000:0.0:1746065143.026845:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.026983:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263254656:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065143.027013:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.027054:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263319680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7607us (7756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.027063:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5646 00000100:00100000:3.0:1746065143.028884:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263320064 00000100:00100000:3.0:1746065143.028894:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263320064 00002000:00100000:3.0:1746065143.028939:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880099ec5500 x1830881263320064/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.028948:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5500 with x1830881263320064 ext(2097152->3145727) 00002000:00010000:3.0:1746065143.028952:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec5500 00000100:00100000:3.0:1746065143.028968:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3485 00000100:00100000:3.0:1746065143.028974:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263320064:12345-192.168.202.27@tcp:3:cat.0 00000100:00080000:2.0:1746065143.030305:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065143.037732:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.037794:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263320320 00000100:00100000:3.0:1746065143.037802:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263320320 00002000:00100000:3.0:1746065143.037836:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097fa0380 x1830881263320320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.037845:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0380 with x1830881263320320 ext(3145728->4194303) 00002000:00010000:3.0:1746065143.037850:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0380 00000100:00100000:3.0:1746065143.037869:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3486 00000100:00100000:3.0:1746065143.037874:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263320320:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065143.048225:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263320064:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19242us (21379us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.048234:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3485 00002000:00100000:3.0:1746065143.048243:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880099ec5500 x1830881263320064/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.048252:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5500 with x1830881263320064 ext(2097152->3145727) 00002000:00010000:3.0:1746065143.048257:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec5500 00000100:00100000:3.0:1746065143.061086:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263320320:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23202us (23351us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.061098:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3486 00002000:00100000:3.0:1746065143.061108:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097fa0380 x1830881263320320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.061116:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0380 with x1830881263320320 ext(3145728->4194303) 00002000:00010000:3.0:1746065143.061121:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0380 00000100:00100000:1.0:1746065143.063078:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.064665:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263320448 00000100:00100000:2.0:1746065143.064675:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263320448 00000100:00100000:2.0:1746065143.064739:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12679 00000100:00100000:2.0:1746065143.064747:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+17:31975:x1830881263320448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.064765:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.064792:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bc6 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.064816:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.064817:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.064823:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 18 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.064836:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 18 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.064845:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31000, rc 0) 00000100:00100000:2.0:1746065143.064885:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+18:31975:x1830881263320448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 139us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.064891:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12679 00000100:00080000:0.0:1746065143.064973:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065143.079157:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.081817:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.081864:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.081908:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263320960 00000100:00100000:0.0:1746065143.081917:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263320960 00002000:00100000:0.0:1746065143.081955:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa2300 x1830881263320960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065143.081966:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321216 00002000:00100000:0.0:1746065143.081970:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2300 with x1830881263320960 ext(3145728->4194303) 00000100:00100000:3.0:1746065143.081971:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321216 00002000:00010000:0.0:1746065143.081975:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2300 00002000:00100000:3.0:1746065143.081990:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097fa3b80 x1830881263321216/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065143.081994:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321088 00000100:00100000:0.0:1746065143.081997:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321088 00002000:00100000:0.0:1746065143.082018:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097fa1f80 x1830881263321088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.082021:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3b80 with x1830881263321216 ext(3145728->4194303) 00002000:00010000:3.0:1746065143.082024:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa3b80 00002000:00100000:0.0:1746065143.082025:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1f80 with x1830881263321088 ext(4194304->5021695) 00002000:00010000:0.0:1746065143.082027:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa1f80 00000100:00100000:0.0:1746065143.082048:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3487 00000100:00100000:3.0:1746065143.082053:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3488 00000100:00100000:0.0:1746065143.082054:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263320960:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065143.082059:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263321216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065143.082093:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3489 00000100:00100000:2.0:1746065143.082099:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263321088:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065143.088617:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.090188:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321472 00000100:00100000:2.0:1746065143.090201:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321472 00000100:00100000:2.0:1746065143.090271:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13530 00000100:00100000:2.0:1746065143.090283:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+26:31982:x1830881263321472:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065143.090306:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.090324:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146e200 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bcd expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.090632:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263321088:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8529us (8763us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065143.090641:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3489 00002000:00100000:3.0:1746065143.090651:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097fa1f80 x1830881263321088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.090659:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1f80 with x1830881263321088 ext(4194304->5021695) 00002000:00010000:3.0:1746065143.090664:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa1f80 00000100:00080000:0.0:1746065143.090926:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065143.091087:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.091100:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.091107:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.091133:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.091143:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 16 pid: 7203 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.091152:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263254784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.091211:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.100262:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263320960:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18198us (21289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065143.100272:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3487 00002000:00100000:2.0:1746065143.100283:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa2300 x1830881263320960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.100292:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2300 with x1830881263320960 ext(3145728->4194303) 00002000:00010000:2.0:1746065143.100298:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2300 00000100:00100000:3.0:1746065143.101159:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263254784:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.101179:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065143.101863:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.102022:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321600 00000100:00100000:3.0:1746065143.102028:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321600 00010000:00010000:3.0:1746065143.102062:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 17 pid: 7203 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.102105:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5647 00000100:00100000:3.0:1746065143.102112:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263321600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1746065143.102148:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746065143.102227:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.102234:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 17 pid: 7203 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.102245:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 17 pid: 7203 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.102263:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e174 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b6b expref: 17 pid: 7203 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.102288:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.102292:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.102301:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.102307:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.102322:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.102349:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263321600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 238us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.102355:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5647 00010000:00010000:2.0:1746065143.102464:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.102472:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065143.102488:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065143.102581:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146e200 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.102608:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.102618:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065143.102620:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065143.102623:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2600, rc 0) 00000100:00100000:2.0:1746065143.102643:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+28:31982:x1830881263321472:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12365us (14036us total) trans 8589935837 rc 0/0 00000100:00100000:2.0:1746065143.102650:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13530 00000100:00100000:3.0:1746065143.105994:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263321216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23927us (24174us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.106013:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3488 00002000:00100000:3.0:1746065143.106022:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097fa3b80 x1830881263321216/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.106030:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3b80 with x1830881263321216 ext(3145728->4194303) 00002000:00010000:3.0:1746065143.106035:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa3b80 00000100:00100000:0.0:1746065143.107416:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.107503:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321728 00000100:00100000:3.0:1746065143.107510:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321728 00000100:00100000:3.0:1746065143.107555:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12680 00000100:00100000:3.0:1746065143.107562:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+8:31982:x1830881263321728:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065143.107574:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.107587:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bd4 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.107610:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.107617:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.107623:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 28 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.107629:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.107630:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.107633:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1581056->1662975] (req 1581056->1662975) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.107656:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 28 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.107666:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 28 pid: 12260 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.107681:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263254912:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.107793:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.107802:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 7 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.107808:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263255040:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.107841:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.107847:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.107852:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263255168:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.107865:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.111017:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.111174:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263254912:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.111184:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263255040:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.111191:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263255168:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.111216:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1581056->1662975] (req 1581056->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.111237:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47800, rc 0) 00000100:00100000:3.0:1746065143.111277:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+9:31982:x1830881263321728:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3714us (3863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.111284:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12680 00000100:00100000:1.0:1746065143.111424:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.111427:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321984 00000100:00100000:3.0:1746065143.111432:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321984 00000100:00100000:1.0:1746065143.111458:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065143.111487:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 29 pid: 12260 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746065143.111497:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321856 00000100:00100000:0.0:1746065143.111499:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321856 00010000:00010000:0.0:1746065143.111517:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 8 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746065143.111533:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322112 00000100:00100000:0.0:1746065143.111535:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322112 00010000:00010000:0.0:1746065143.111541:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746065143.111559:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5648 00000100:00100000:0.0:1746065143.111568:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263321856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.111578:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.111594:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 8 pid: 10219 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746065143.111602:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 8 pid: 10219 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746065143.111617:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc146e19e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b80 expref: 8 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.111874:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5649 00000100:00100000:3.0:1746065143.111879:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263322112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.111885:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.111891:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746065143.111898:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746065143.111908:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc146e0a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ac3 expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:3.0:1746065143.111918:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.111936:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263322112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.111940:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5650 00000100:00100000:3.0:1746065143.111945:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5649 00000100:00100000:1.0:1746065143.111949:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263321984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.111956:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.111965:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 29 pid: 12260 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.111974:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 29 pid: 12260 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.111986:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146e0e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932af4 expref: 29 pid: 12260 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.111988:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.112012:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322240 00010000:00010000:1.0:1746065143.112012:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.112014:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065143.112015:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322240 00010000:00010000:1.0:1746065143.112021:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 8 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.112028:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 8 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.112052:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 8 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.112055:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.112062:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263255296:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065143.112071:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263321856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 505us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.112075:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5648 00000100:00080000:0.0:1746065143.112089:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065143.112107:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.112164:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12681 00000100:00100000:3.0:1746065143.112170:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263322240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.112179:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.112187:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146e21c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bdb expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.112209:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263255424:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065143.112226:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.118745:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.118751:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263255296:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065143.118766:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.118827:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263321984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6879us (7815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.118836:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5650 00000100:00100000:2.0:1746065143.118885:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322496 00000100:00100000:2.0:1746065143.118890:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322496 00002000:00100000:2.0:1746065143.118927:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1581056->1585151) req@ffff880099ec7b80 x1830881263322496/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.118934:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7b80 with x1830881263322496 ext(1581056->1585151) 00002000:00010000:2.0:1746065143.118938:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec7b80 00000100:00100000:2.0:1746065143.118953:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3490 00000100:00100000:2.0:1746065143.118959:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263322496:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.119065:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263322496:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 105us (325us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.119069:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3490 00002000:00100000:2.0:1746065143.119074:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1581056->1585151) req@ffff880099ec7b80 x1830881263322496/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.119080:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7b80 with x1830881263322496 ext(1581056->1585151) 00002000:00010000:2.0:1746065143.119083:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec7b80 00002000:00010000:3.0:1746065143.119323:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065142 -> 1746065143 00002000:00010000:3.0:1746065143.119327:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065142 -> 1746065143 00002000:00010000:3.0:1746065143.119329:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065142 -> 1746065143 00000100:00100000:3.0:1746065143.119337:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263255424:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065143.119358:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146e21c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bdb expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.119368:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abac000/0xad6b7ddc146e21c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bdb expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.119389:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:3.0:1746065143.119411:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263322240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7240us (7422us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065143.119416:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12681 00000100:00100000:0.0:1746065143.127120:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.127151:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322752 00000100:00100000:0.0:1746065143.127158:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322752 00002000:00100000:0.0:1746065143.127191:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1658880->1662975) req@ffff880099ec4000 x1830881263322752/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.127200:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4000 with x1830881263322752 ext(1658880->1662975) 00002000:00010000:0.0:1746065143.127205:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec4000 00000100:00100000:0.0:1746065143.127219:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3491 00000100:00100000:0.0:1746065143.127225:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263322752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065143.127350:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263322752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 123us (235us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065143.127356:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3491 00002000:00100000:0.0:1746065143.127362:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1658880->1662975) req@ffff880099ec4000 x1830881263322752/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.127368:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4000 with x1830881263322752 ext(1658880->1662975) 00002000:00010000:0.0:1746065143.127371:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec4000 00000100:00100000:0.0:1746065143.129811:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.130119:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323008 00000100:00100000:2.0:1746065143.130126:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323008 00002000:00100000:2.0:1746065143.130158:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5017599) req@ffff880099ec7480 x1830881263323008/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.130166:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7480 with x1830881263323008 ext(4194304->5017599) 00002000:00010000:2.0:1746065143.130170:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec7480 00000100:00100000:2.0:1746065143.130197:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3492 00000100:00100000:2.0:1746065143.130203:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263323008:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065143.137035:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263323008:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6822us (7220us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746065143.137045:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3492 00002000:00100000:2.0:1746065143.137054:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5017599) req@ffff880099ec7480 x1830881263323008/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.137062:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7480 with x1830881263323008 ext(4194304->5017599) 00002000:00010000:2.0:1746065143.137068:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec7480 00000100:00100000:0.0:1746065143.154851:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.154986:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323136 00000100:00100000:3.0:1746065143.154995:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323136 00000100:00100000:3.0:1746065143.155085:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12682 00000100:00100000:3.0:1746065143.155091:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:31978:x1830881263323136:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065143.155106:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.155215:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932be2 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.155243:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 29 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.155251:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 17 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.155257:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.155258:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.155261:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.155283:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 17 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.155293:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 17 pid: 12258 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.155303:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263255552:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.155698:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 29 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.155711:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.155718:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263255680:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.155738:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.160241:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.160282:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.160600:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263255552:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.160613:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263255680:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065143.160630:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323264 00000100:00100000:1.0:1746065143.160636:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323264 00010000:00010000:3.0:1746065143.160637:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.160650:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00010000:00010000:1.0:1746065143.160659:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 18 pid: 12258 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.160689:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323392 00000100:00100000:1.0:1746065143.160692:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323392 00010000:00010000:1.0:1746065143.160700:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 30 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.160723:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:31978:x1830881263323136:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5632us (5880us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.160730:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12682 00000100:00100000:3.0:1746065143.160764:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5651 00000100:00100000:3.0:1746065143.160770:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263323264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.160807:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.160823:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 18 pid: 12258 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.160832:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 18 pid: 12258 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.160852:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc146e1f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bc6 expref: 18 pid: 12258 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.160865:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.160880:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263323264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 111us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.160885:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5651 00000100:00100000:1.0:1746065143.161527:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5652 00000100:00100000:1.0:1746065143.161534:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263323392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.161542:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.161551:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.161560:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.161572:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc146e1b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ba3 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.161597:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.161599:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.161604:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.161612:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.161638:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065143.161648:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263255808:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065143.161712:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.163615:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263255808:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065143.163630:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.163672:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263323392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2137us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.163680:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5652 00000100:00100000:0.0:1746065143.164694:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.165066:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323648 00000100:00100000:3.0:1746065143.165074:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323648 00002000:00100000:3.0:1746065143.165106:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3883008->3887103) req@ffff880097f52a00 x1830881263323648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.165115:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52a00 with x1830881263323648 ext(3883008->3887103) 00002000:00010000:3.0:1746065143.165119:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f52a00 00000100:00100000:3.0:1746065143.165134:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3493 00000100:00100000:3.0:1746065143.165140:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263323648:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065143.165249:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263323648:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 107us (557us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.165255:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3493 00002000:00100000:3.0:1746065143.165260:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3883008->3887103) req@ffff880097f52a00 x1830881263323648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.165267:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52a00 with x1830881263323648 ext(3883008->3887103) 00002000:00010000:3.0:1746065143.165270:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f52a00 00000100:00100000:0.0:1746065143.171169:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.171277:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323776 00000100:00100000:3.0:1746065143.171286:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323776 00000100:00100000:3.0:1746065143.171340:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12683 00000100:00100000:3.0:1746065143.171348:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:31978:x1830881263323776:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065143.171364:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.171377:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932be9 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.171403:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 7 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.171410:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.171416:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.171418:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.171421:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3764223] (req 3145728->3764223) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.171447:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.171456:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.171467:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263255936:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.171553:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 7 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.171564:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 7 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.171572:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263256064:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.171589:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.178451:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263255936:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.178465:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263256064:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.178489:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3764223] (req 3145728->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.178505:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abace00, rc 0) 00000100:00100000:3.0:1746065143.178558:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:31978:x1830881263323776:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7209us (7394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.178565:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12683 00000100:00100000:0.0:1746065143.178939:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.178978:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.178995:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323904 00000100:00100000:0.0:1746065143.179008:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323904 00010000:00010000:0.0:1746065143.179030:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.179060:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324032 00000100:00100000:0.0:1746065143.179063:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324032 00010000:00010000:0.0:1746065143.179072:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 8 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.179090:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5653 00000100:00100000:0.0:1746065143.179095:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263323904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.179105:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065143.179109:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5654 00000100:00100000:2.0:1746065143.179117:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263324032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.179120:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.179124:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.179128:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.179515:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 8 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.179526:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 8 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.179543:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc146e1eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bb8 expref: 8 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.179573:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.179602:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263324032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 487us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.179608:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5654 00010000:00010000:0.0:1746065143.179827:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc146e1f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bbf expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.179848:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.179850:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.179856:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.179863:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.179890:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.179901:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f53800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263256192:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065143.179946:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.182388:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f53800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263256192:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065143.182405:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.182581:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263323904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3483us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.182590:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5653 00000100:00100000:0.0:1746065143.188571:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.188649:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324288 00000100:00100000:2.0:1746065143.188657:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324288 00002000:00100000:2.0:1746065143.188694:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3760128->3764223) req@ffff880097f50e00 x1830881263324288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.188702:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50e00 with x1830881263324288 ext(3760128->3764223) 00002000:00010000:2.0:1746065143.188707:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f50e00 00000100:00100000:3.0:1746065143.189109:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3494 00000100:00100000:3.0:1746065143.189117:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263324288:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065143.189246:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263324288:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 128us (680us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.189251:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3494 00002000:00100000:3.0:1746065143.189256:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3760128->3764223) req@ffff880097f50e00 x1830881263324288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.189262:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50e00 with x1830881263324288 ext(3760128->3764223) 00002000:00010000:3.0:1746065143.189266:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f50e00 00000100:00100000:0.0:1746065143.193385:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.193691:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324544 00000100:00100000:2.0:1746065143.193699:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324544 00000100:00100000:2.0:1746065143.193761:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4856 00000100:00100000:2.0:1746065143.193768:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+45:31978:x1830881263324544:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065143.193954:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+46:31978:x1830881263324544:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 185us (575us total) trans 8589935838 rc 0/0 00000100:00100000:2.0:1746065143.193960:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4856 00000100:00080000:0.0:1746065143.194158:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065143.215422:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.215874:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.216047:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324672 00000100:00100000:1.0:1746065143.216047:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324800 00000100:00100000:3.0:1746065143.216055:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324672 00000100:00100000:1.0:1746065143.216055:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324800 00000100:00100000:3.0:1746065143.216358:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12684 00000100:00100000:3.0:1746065143.216366:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263324672:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065143.216450:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12685 00000100:00100000:1.0:1746065143.216457:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263324800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065143.216473:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.216487:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc146e231 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bf7 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.216518:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc146e231 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bf7 expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.216523:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.216526:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc146e231 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bf7 expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.216531:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc146e238 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bf0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.216539:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd600, rc 0) 00000100:00100000:3.0:1746065143.216563:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263256320:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065143.216586:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263324800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 130us (713us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065143.216591:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12685 00000100:00100000:3.0:1746065143.216608:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.218373:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263256320:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065143.218399:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc146e238 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bf0 expref: 29 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.218574:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc146e238 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bf0 expref: 29 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.218596:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00000100:00100000:3.0:1746065143.218635:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263324672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2270us (3219us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065143.218641:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12684 00000100:00100000:0.0:1746065143.223062:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.223163:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324928 00000100:00100000:3.0:1746065143.223171:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324928 00000100:00100000:3.0:1746065143.223219:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12686 00000100:00100000:3.0:1746065143.223225:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:31990:x1830881263324928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.223244:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.223258:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932bfe expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.223282:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 6 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.223287:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.223289:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.223292:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.223315:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 6 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.223325:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 6 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.223335:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263256448:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.223413:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.226926:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.227170:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325056 00000100:00100000:2.0:1746065143.227178:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325056 00002000:00100000:2.0:1746065143.227214:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1581056->1662975) req@ffff880097a6f480 x1830881263325056/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.227223:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f480 with x1830881263325056 ext(1581056->1662975) 00010000:00010000:2.0:1746065143.227231:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 7 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.227242:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 7 pid: 3067 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065143.227248:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6f480 00000100:00100000:2.0:1746065143.227265:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1236 00000100:00100000:2.0:1746065143.227270:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263325056:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065143.227456:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263256448:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.227475:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.227487:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abadc00, rc 0) 00000100:00100000:3.0:1746065143.227510:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:31990:x1830881263324928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4284us (4455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.227517:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12686 00000100:00100000:2.0:1746065143.232156:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263325056:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4877us (5229us total) trans 17179873377 rc 0/0 00000100:00100000:2.0:1746065143.232167:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1236 00002000:00100000:2.0:1746065143.232177:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1581056->1662975) req@ffff880097a6f480 x1830881263325056/t17179873377(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.232186:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f480 with x1830881263325056 ext(1581056->1662975) 00010000:00010000:2.0:1746065143.232196:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 9 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.232209:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 9 pid: 3067 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065143.232216:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6f480 00000100:00100000:0.0:1746065143.234721:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.234835:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325184 00000100:00100000:2.0:1746065143.234843:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325184 00010000:00010000:2.0:1746065143.234872:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 9 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.234901:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5655 00000100:00100000:2.0:1746065143.234909:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263325184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.234921:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.234938:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 9 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.234948:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 9 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.234967:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc146e215 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->1662975) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bd4 expref: 9 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.234990:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.234992:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.235009:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.235017:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.235048:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.235063:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263256576:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065143.235127:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.237015:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263256576:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065143.237034:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.237066:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263325184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2157us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.237075:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5655 00000100:00100000:0.0:1746065143.240660:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.240711:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325440 00000100:00100000:2.0:1746065143.240719:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325440 00002000:00100000:2.0:1746065143.240755:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097a6c380 x1830881263325440/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.240764:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c380 with x1830881263325440 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.240769:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6c380 00000100:00100000:2.0:1746065143.240811:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3495 00000100:00100000:2.0:1746065143.240817:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263325440:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065143.249974:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263325440:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9147us (9312us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065143.249985:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3495 00002000:00100000:2.0:1746065143.249995:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097a6c380 x1830881263325440/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.250016:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c380 with x1830881263325440 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.250021:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6c380 00000100:00100000:0.0:1746065143.263834:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.263905:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325696 00000100:00100000:2.0:1746065143.263913:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325696 00002000:00100000:2.0:1746065143.263946:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880097a6ea00 x1830881263325696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.263955:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ea00 with x1830881263325696 ext(2097152->3145727) 00002000:00010000:2.0:1746065143.263959:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6ea00 00000100:00100000:2.0:1746065143.264214:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3496 00000100:00100000:2.0:1746065143.264221:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263325696:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065143.271293:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263325696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7063us (7456us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065143.271377:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3496 00002000:00100000:2.0:1746065143.271388:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880097a6ea00 x1830881263325696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.271398:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ea00 with x1830881263325696 ext(2097152->3145727) 00002000:00010000:2.0:1746065143.271403:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6ea00 00000100:00100000:0.0:1746065143.282105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.282198:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325824 00000100:00100000:3.0:1746065143.282207:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325824 00000100:00100000:3.0:1746065143.282243:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12687 00000100:00100000:3.0:1746065143.282249:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:31990:x1830881263325824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.282265:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.282279:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c05 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.283394:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.283404:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.283406:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.283409:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.283436:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.283446:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.283455:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263256704:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.284207:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.288445:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263256704:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.288473:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.288487:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:3.0:1746065143.289669:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:31990:x1830881263325824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7416us (7568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.289678:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12687 00000100:00100000:0.0:1746065143.289845:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.290132:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325952 00000100:00100000:2.0:1746065143.290138:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325952 00002000:00100000:2.0:1746065143.290169:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3883008->4194303) req@ffff880097a6c700 x1830881263325952/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.290178:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c700 with x1830881263325952 ext(3883008->4194303) 00010000:00010000:2.0:1746065143.290185:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.290195:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065143.290204:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6c700 00000100:00100000:2.0:1746065143.290226:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1237 00000100:00100000:2.0:1746065143.290232:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263325952:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065143.305551:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263325952:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15311us (15699us total) trans 21474840816 rc 0/0 00000100:00100000:2.0:1746065143.305560:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1237 00002000:00100000:2.0:1746065143.305569:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3883008->4194303) req@ffff880097a6c700 x1830881263325952/t21474840816(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.305576:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c700 with x1830881263325952 ext(3883008->4194303) 00010000:00010000:2.0:1746065143.305585:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.305598:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065143.305604:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6c700 00000100:00100000:0.0:1746065143.307120:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.307149:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.307178:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.307201:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326080 00000100:00100000:0.0:1746065143.307207:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326080 00000100:00100000:0.0:1746065143.307242:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326336 00000100:00100000:0.0:1746065143.307243:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326336 00000100:00100000:0.0:1746065143.307251:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326208 00000100:00100000:0.0:1746065143.307252:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326208 00000100:00100000:0.0:1746065143.307263:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12688 00000100:00100000:0.0:1746065143.307269:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263326080:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065143.307274:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12689 00010000:00010000:0.0:1746065143.307282:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065143.307283:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263326336:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.307290:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065143.307295:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c0c expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.307310:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3400/0xad6b7ddc146e254 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c1a expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.307313:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.307315:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.307322:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.307334:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.307341:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131beec00, rc 0) 00000100:00100000:2.0:1746065143.307343:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263256832:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065143.307363:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263326080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.307368:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12688 00000100:00100000:0.0:1746065143.307378:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12690 00000100:00100000:0.0:1746065143.307382:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263326208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065143.307387:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065143.307394:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131bef400/0xad6b7ddc146e25b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c13 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.307396:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00010000:00010000:0.0:1746065143.307406:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131bef400/0xad6b7ddc146e25b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c13 expref: 18 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.307412:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131bef400/0xad6b7ddc146e25b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c13 expref: 18 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.307422:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bef400, rc 0) 00000100:00100000:0.0:1746065143.307433:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263326208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (255us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065143.307437:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12690 00002000:00010000:2.0:1746065143.312015:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065142 -> 1746065143 00002000:00010000:2.0:1746065143.312022:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065142 -> 1746065143 00000100:00100000:2.0:1746065143.312039:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263256832:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065143.312068:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3400/0xad6b7ddc146e254 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c1a expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.312079:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3400/0xad6b7ddc146e254 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c1a expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.312104:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3400, rc 0) 00000100:00100000:3.0:1746065143.312200:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.313064:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263326336:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5780us (5911us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065143.313073:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12689 00000100:00100000:2.0:1746065143.313107:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326464 00000100:00100000:2.0:1746065143.313112:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326464 00010000:00010000:2.0:1746065143.313134:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.313153:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5656 00000100:00100000:2.0:1746065143.313159:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263326464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.313169:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.313180:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.313189:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.313204:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146e223 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be2 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.313216:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.313218:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.313223:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.313230:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.313254:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 30 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.313263:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263256960:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065143.314844:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.319891:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263256960:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065143.319911:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.319963:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263326464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6803us (7763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.319973:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5656 00000100:00100000:0.0:1746065143.321542:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.321589:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.321790:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326848 00000100:00100000:2.0:1746065143.321798:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326848 00002000:00100000:2.0:1746065143.321829:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3764224->4194303) req@ffff88008c458a80 x1830881263326848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.321843:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458a80 with x1830881263326848 ext(3764224->4194303) 00002000:00010000:2.0:1746065143.321847:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458a80 00000100:00100000:2.0:1746065143.322113:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326976 00000100:00100000:2.0:1746065143.322116:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326976 00002000:00100000:2.0:1746065143.322130:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88008c45bb80 x1830881263326976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.322136:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45bb80 with x1830881263326976 ext(3145728->4194303) 00002000:00010000:2.0:1746065143.322139:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c45bb80 00000100:00100000:2.0:1746065143.322166:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3497 00000100:00100000:2.0:1746065143.322172:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263326848:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065143.322888:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3498 00000100:00100000:1.0:1746065143.322898:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263326976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065143.331083:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263326848:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8900us (9535us total) trans 0 rc 430080/430080 00000100:00100000:3.0:1746065143.331094:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3497 00002000:00100000:3.0:1746065143.331105:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3764224->4194303) req@ffff88008c458a80 x1830881263326848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 430080/430080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.331114:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458a80 with x1830881263326848 ext(3764224->4194303) 00002000:00010000:3.0:1746065143.331119:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458a80 00000100:00100000:0.0:1746065143.338256:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.338423:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327232 00000100:00100000:3.0:1746065143.338430:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327232 00002000:00100000:3.0:1746065143.338466:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88008c458700 x1830881263327232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.338475:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458700 with x1830881263327232 ext(1048576->2097151) 00002000:00010000:3.0:1746065143.338479:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458700 00000100:00100000:1.0:1746065143.338852:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263326976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15956us (17261us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065143.338861:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3498 00002000:00100000:1.0:1746065143.338866:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88008c45bb80 x1830881263326976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.338873:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45bb80 with x1830881263326976 ext(3145728->4194303) 00002000:00010000:1.0:1746065143.338876:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c45bb80 00000100:00100000:1.0:1746065143.338892:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3499 00000100:00100000:1.0:1746065143.338898:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263327232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065143.351486:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263327232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12579us (13227us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065143.351500:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3499 00002000:00100000:1.0:1746065143.351511:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88008c458700 x1830881263327232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.351520:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458700 with x1830881263327232 ext(1048576->2097151) 00002000:00010000:1.0:1746065143.351525:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458700 00000100:00100000:0.0:1746065143.355727:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.357704:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327488 00000100:00100000:1.0:1746065143.357715:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327488 00002000:00100000:1.0:1746065143.357758:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008c45b480 x1830881263327488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.357768:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45b480 with x1830881263327488 ext(4194304->5021695) 00002000:00010000:1.0:1746065143.357787:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c45b480 00000100:00100000:1.0:1746065143.357821:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3500 00000100:00100000:1.0:1746065143.357829:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263327488:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065143.372129:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.372192:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327616 00000100:00100000:2.0:1746065143.372199:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327616 00000100:00100000:2.0:1746065143.373691:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12691 00000100:00100000:2.0:1746065143.373701:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+9:31993:x1830881263327616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.373719:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.373735:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c21 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.373759:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.373766:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.373767:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.373770:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.373814:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.373825:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 28 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.373836:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263257088:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.373910:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.374916:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263327488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17084us (19193us total) trans 0 rc 827392/827392 00000100:00100000:0.0:1746065143.374924:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3500 00002000:00100000:0.0:1746065143.374932:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008c45b480 x1830881263327488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.374940:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45b480 with x1830881263327488 ext(4194304->5021695) 00002000:00010000:0.0:1746065143.374944:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c45b480 00000100:00100000:0.0:1746065143.379711:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.379826:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263257088:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.379853:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.379868:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835da00, rc 0) 00000100:00100000:2.0:1746065143.379909:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+10:31993:x1830881263327616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6208us (7787us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.379917:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12691 00000100:00100000:1.0:1746065143.380290:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327744 00000100:00100000:1.0:1746065143.380297:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327744 00002000:00100000:1.0:1746065143.380328:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3764223) req@ffff88008c459c00 x1830881263327744/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.380337:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881263327744 ext(3145728->3764223) 00010000:00010000:1.0:1746065143.380343:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.380354:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065143.380363:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c459c00 00000100:00100000:1.0:1746065143.380388:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1238 00000100:00100000:1.0:1746065143.380394:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263327744:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065143.381180:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.381392:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327872 00000100:00100000:2.0:1746065143.381396:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327872 00000100:00100000:2.0:1746065143.381423:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12692 00000100:00100000:2.0:1746065143.381427:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263327872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.381437:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.381447:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e269 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c28 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.381486:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263257216:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065143.381541:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.394060:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263257216:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065143.394095:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e269 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c28 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.394110:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e269 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c28 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.394125:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:2.0:1746065143.394194:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263327872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12762us (13012us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065143.394202:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12692 00000100:00100000:0.0:1746065143.402197:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.403099:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328000 00000100:00100000:2.0:1746065143.403108:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328000 00000100:00100000:2.0:1746065143.403146:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12693 00000100:00100000:2.0:1746065143.403153:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263328000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.403169:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.403183:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d400/0xad6b7ddc146e270 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c2f expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.403227:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263257344:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065143.403303:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.406179:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263327744:12345-192.168.202.27@tcp:4:cat.0 Request processed in 25777us (26467us total) trans 17179873378 rc 0/0 00000100:00100000:1.0:1746065143.406191:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1238 00002000:00100000:1.0:1746065143.406200:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3764223) req@ffff88008c459c00 x1830881263327744/t17179873378(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.406209:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881263327744 ext(3145728->3764223) 00010000:00010000:1.0:1746065143.406217:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 33 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.406231:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 33 pid: 3067 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065143.406237:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c459c00 00000100:00100000:2.0:1746065143.410949:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263257344:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065143.410979:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d400/0xad6b7ddc146e270 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c2f expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.410993:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d400/0xad6b7ddc146e270 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c2f expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.411046:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:2.0:1746065143.411091:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263328000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7937us (8901us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065143.411098:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12693 00000100:00100000:0.0:1746065143.413961:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.414268:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328128 00000100:00100000:2.0:1746065143.414275:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328128 00010000:00010000:2.0:1746065143.414303:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.414335:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5657 00000100:00100000:2.0:1746065143.414342:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263328128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.414354:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.414368:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.414379:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.414397:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc146e22a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932be9 expref: 31 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.414412:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.414414:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.414419:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.414426:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.414452:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.414462:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263257472:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065143.414534:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.424590:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.425725:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328256 00000100:00100000:2.0:1746065143.425734:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328256 00000100:00100000:2.0:1746065143.429074:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12694 00000100:00100000:2.0:1746065143.429089:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+10:31995:x1830881263328256:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065143.429106:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.429124:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c36 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.429150:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.429157:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.429159:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.429161:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.429186:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.429197:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.429207:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263257600:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065143.429788:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.430117:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263257472:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065143.430131:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.430154:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263328128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15812us (16200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.430162:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5657 00000100:00100000:0.0:1746065143.430584:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.430640:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328512 00000100:00100000:1.0:1746065143.430646:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328512 00002000:00100000:1.0:1746065143.430674:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88008c458e00 x1830881263328512/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.430682:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458e00 with x1830881263328512 ext(2097152->3145727) 00010000:00010000:1.0:1746065143.430688:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 12 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.430701:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 12 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065143.430706:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c458e00 00000100:00100000:1.0:1746065143.430718:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1239 00000100:00100000:1.0:1746065143.430723:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263328512:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.431464:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328768 00000100:00100000:2.0:1746065143.431467:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328768 00000100:00100000:2.0:1746065143.431491:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13531 00000100:00100000:2.0:1746065143.431496:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+46:31997:x1830881263328768:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065143.431509:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.431520:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146e27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c3d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.431596:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.431609:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.431617:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065143.431625:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065143.431705:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc146e27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 49 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.431724:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 48 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.431730:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065143.431732:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065143.431734:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ba00, rc 0) 00000100:00100000:2.0:1746065143.431753:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+48:31997:x1830881263328768:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 256us (1169us total) trans 8589935839 rc 0/0 00000100:00100000:2.0:1746065143.431758:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13531 00000100:00100000:2.0:1746065143.436231:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.443148:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263257600:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065143.443176:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 13 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.443193:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6c00, rc 0) 00000100:00100000:0.0:1746065143.443486:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+13:31995:x1830881263328256:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 14401us (18902us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.443494:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12694 00000100:00100000:1.0:1746065143.445715:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263328512:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 14985us (15922us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065143.445723:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1239 00002000:00100000:1.0:1746065143.445731:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88008c458e00 x1830881263328512/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.445739:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458e00 with x1830881263328512 ext(2097152->3145727) 00010000:00010000:1.0:1746065143.445748:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.445760:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065143.445765:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c458e00 00000100:00100000:0.0:1746065143.447766:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.447826:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328896 00000100:00100000:2.0:1746065143.447832:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328896 00000100:00100000:2.0:1746065143.447874:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12695 00000100:00100000:2.0:1746065143.447880:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+30:31997:x1830881263328896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065143.447895:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.447908:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c44 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.447930:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.447941:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.447947:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.447952:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.447954:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.447956:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [450560->552959] (req 450560->552959) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 31 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.447978:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.447986:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 31 pid: 12260 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.448006:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263257728:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.448095:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.448102:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 10 pid: 3067 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.448109:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263257856:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.448134:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.448141:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 16 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.448148:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263257984:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.448258:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.452314:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263257728:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.452326:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263257856:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065143.455199:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.455234:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.455263:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329152 00000100:00100000:2.0:1746065143.455270:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329152 00000100:00100000:0.0:1746065143.455288:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065143.455320:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 11 pid: 3067 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746065143.455332:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263257984:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.455340:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329024 00000100:00100000:2.0:1746065143.455342:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329024 00010000:00010000:2.0:1746065143.455350:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 32 pid: 12260 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746065143.455358:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [450560->552959] (req 450560->552959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 32 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.455364:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329280 00000100:00100000:2.0:1746065143.455366:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329280 00010000:00010000:0.0:1746065143.455370:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a800, rc 0) 00010000:00010000:2.0:1746065143.455373:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 17 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.455385:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5658 00000100:00100000:2.0:1746065143.455391:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263329152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.455401:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065143.455403:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:31997:x1830881263328896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7524us (7642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.455409:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12695 00010000:00010000:2.0:1746065143.455416:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 11 pid: 3067 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746065143.455424:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 11 pid: 3067 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746065143.455441:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc146e189 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b79 expref: 11 pid: 3067 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746065143.455454:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.455470:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5659 00000100:00100000:2.0:1746065143.455471:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263329152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.455476:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5658 00000100:00100000:0.0:1746065143.455476:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263329024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.455482:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065143.455484:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5660 00000100:00100000:2.0:1746065143.455488:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263329280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.455490:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 31 pid: 12260 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746065143.455493:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.455498:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 17 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746065143.455499:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 31 pid: 12260 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746065143.455505:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 17 pid: 12258 timeout: 839 lvb_type: 1 00000100:00080000:1.0:1746065143.455699:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746065143.457342:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146e0d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aed expref: 31 pid: 12260 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.457429:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.457449:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329408 00000100:00100000:1.0:1746065143.457454:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329408 00000100:00100000:1.0:1746065143.457482:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12696 00000100:00100000:1.0:1746065143.457488:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+18:31993:x1830881263329408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065143.457499:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.457509:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c4b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.457522:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.457523:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.457529:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.457538:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.457544:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdac00, rc 0) 00000100:00100000:1.0:1746065143.457568:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:31993:x1830881263329408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.457572:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12696 00010000:00010000:0.0:1746065143.457626:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.457642:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263329024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2166us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.457648:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5659 00010000:00010000:2.0:1746065143.458029:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146e094 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932abc expref: 18 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:2.0:1746065143.458043:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.458045:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.458049:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.458055:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.458081:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.458091:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263258112:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065143.458189:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.461398:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.461660:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263258112:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065143.461677:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.461711:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263329280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6221us (6421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.461720:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5660 00000100:00100000:2.0:1746065143.461743:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329536 00000100:00100000:2.0:1746065143.461747:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329536 00010000:00010000:2.0:1746065143.461765:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.462075:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5661 00000100:00100000:2.0:1746065143.462082:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263329536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.462096:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.462111:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.462122:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.462140:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146e262 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c21 expref: 11 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.462150:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.462152:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.462157:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.462164:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.462188:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.462198:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263258240:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065143.462246:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.464566:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.464969:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329792 00000100:00100000:1.0:1746065143.464976:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329792 00002000:00100000:1.0:1746065143.465016:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (450560->454655) req@ffff880097d04380 x1830881263329792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.465025:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04380 with x1830881263329792 ext(450560->454655) 00002000:00010000:1.0:1746065143.465029:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04380 00000100:00100000:1.0:1746065143.465051:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3501 00000100:00100000:1.0:1746065143.465057:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263329792:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065143.465166:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263329792:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 108us (604us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065143.465172:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3501 00002000:00100000:1.0:1746065143.465177:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (450560->454655) req@ffff880097d04380 x1830881263329792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.465183:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04380 with x1830881263329792 ext(450560->454655) 00002000:00010000:1.0:1746065143.465185:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04380 00000100:00100000:2.0:1746065143.468634:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263258240:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065143.468655:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.468702:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263329536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6619us (7309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.468713:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5661 00000100:00100000:1.0:1746065143.471664:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.472043:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.472073:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.472327:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330048 00000100:00100000:0.0:1746065143.472335:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330048 00002000:00100000:0.0:1746065143.472373:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa2680 x1830881263330048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.472382:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2680 with x1830881263330048 ext(3145728->4194303) 00002000:00010000:0.0:1746065143.472387:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2680 00000100:00100000:0.0:1746065143.472402:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330304 00000100:00100000:0.0:1746065143.472404:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330304 00002000:00100000:0.0:1746065143.472415:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (4120576->4124671) req@ffff880097fa1180 x1830881263330304/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.472422:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881263330304 ext(4120576->4124671) 00002000:00010000:0.0:1746065143.472425:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1180 00000100:00100000:0.0:1746065143.472433:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330560 00000100:00100000:0.0:1746065143.472435:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330560 00002000:00100000:0.0:1746065143.472443:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (548864->552959) req@ffff880099cf1c00 x1830881263330560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.472448:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1c00 with x1830881263330560 ext(548864->552959) 00002000:00010000:0.0:1746065143.472451:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf1c00 00000100:00100000:0.0:1746065143.472464:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3502 00000100:00100000:0.0:1746065143.472470:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263330048:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065143.473167:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3503 00000100:00100000:3.0:1746065143.473175:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263330304:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065143.473262:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263330304:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 87us (1219us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.473268:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3503 00002000:00100000:3.0:1746065143.473274:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (4120576->4124671) req@ffff880097fa1180 x1830881263330304/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.473281:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881263330304 ext(4120576->4124671) 00002000:00010000:3.0:1746065143.473284:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1180 00000100:00100000:3.0:1746065143.473298:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3504 00000100:00100000:3.0:1746065143.473302:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263330560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065143.473360:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263330560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 57us (1285us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.473369:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3504 00002000:00100000:3.0:1746065143.473374:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (548864->552959) req@ffff880099cf1c00 x1830881263330560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.473379:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1c00 with x1830881263330560 ext(548864->552959) 00002000:00010000:3.0:1746065143.473382:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf1c00 00000100:00100000:2.0:1746065143.482883:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263330048:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10404us (11216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065143.482894:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3502 00002000:00100000:2.0:1746065143.482904:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa2680 x1830881263330048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.482915:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2680 with x1830881263330048 ext(3145728->4194303) 00002000:00010000:2.0:1746065143.482920:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2680 00000100:00100000:0.0:1746065143.491571:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.491632:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330816 00000100:00100000:2.0:1746065143.491641:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330816 00002000:00100000:2.0:1746065143.491683:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4120575) req@ffff88009aceed80 x1830881263330816/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.491697:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceed80 with x1830881263330816 ext(3145728->4120575) 00002000:00010000:2.0:1746065143.491702:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aceed80 00000100:00100000:2.0:1746065143.491730:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3505 00000100:00100000:2.0:1746065143.491737:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263330816:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065143.500986:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.501519:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330944 00000100:00100000:1.0:1746065143.501528:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330944 00000100:00100000:1.0:1746065143.501579:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12697 00000100:00100000:1.0:1746065143.501586:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+17:31995:x1830881263330944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065143.501602:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.501617:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c52 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.501641:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.501649:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.501655:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.501662:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.501664:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.501667:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->4599807] (req 4194304->4599807) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.501688:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.501697:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 18 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.501708:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263258368:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.501804:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.501811:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 18 pid: 9549 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.501819:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263258496:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.501848:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.501855:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.501867:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263258624:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065143.501878:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.508517:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263258368:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.510421:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263330816:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 18678us (18852us total) trans 0 rc 974848/974848 00000100:00100000:2.0:1746065143.510430:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3505 00002000:00100000:2.0:1746065143.510439:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4120575) req@ffff88009aceed80 x1830881263330816/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 974848/974848 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.510448:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceed80 with x1830881263330816 ext(3145728->4120575) 00002000:00010000:2.0:1746065143.510453:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aceed80 00000100:00100000:0.0:1746065143.510749:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.510819:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.510840:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331072 00000100:00100000:0.0:1746065143.510845:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331072 00010000:00010000:0.0:1746065143.510876:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 19 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.510901:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331328 00000100:00100000:0.0:1746065143.510904:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331328 00010000:00010000:0.0:1746065143.510917:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 30 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.510936:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5662 00000100:00100000:0.0:1746065143.510945:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263331072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.510957:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.510977:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 19 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.510987:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 19 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.511035:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e10b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b25 expref: 19 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.511051:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.511069:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263331072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 126us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.511074:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5662 00000100:00100000:0.0:1746065143.511085:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5663 00000100:00100000:0.0:1746065143.511089:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263331328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.511096:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.511102:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 30 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.511108:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 30 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.511118:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.511131:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263331328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.511135:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5663 00000100:00100000:1.0:1746065143.511268:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263258496:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.511278:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e246 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c05 expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.511290:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263258624:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.511312:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4599807] (req 4194304->4599807) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.511320:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009019ec00, rc 0) 00000100:00100000:1.0:1746065143.511340:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+17:31995:x1830881263330944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9755us (10360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.511346:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12697 00000100:00100000:0.0:1746065143.516808:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.516879:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331200 00000100:00100000:3.0:1746065143.516886:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331200 00010000:00010000:3.0:1746065143.516915:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 17 pid: 9549 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.516940:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5664 00000100:00100000:3.0:1746065143.516947:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263331200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.516957:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.516973:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 17 pid: 9549 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.516983:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 17 pid: 9549 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.517012:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e29a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c4b expref: 17 pid: 9549 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.517950:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.517953:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.517961:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.517970:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.518010:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.518021:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263258752:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065143.519515:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.523684:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.523723:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.523762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.523831:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331712 00000100:00100000:2.0:1746065143.523838:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331712 00000100:00100000:2.0:1746065143.523887:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12698 00000100:00100000:2.0:1746065143.523896:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263331712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.523914:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.523929:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc146e2a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c67 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.523970:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263258880:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065143.524045:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.524063:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331584 00000100:00100000:2.0:1746065143.524066:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331584 00000100:00100000:2.0:1746065143.524082:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12699 00000100:00100000:2.0:1746065143.524087:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263331584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.524092:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.524099:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5c00/0xad6b7ddc146e2af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c60 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.524121:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263259008:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065143.524139:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.524331:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331456 00000100:00100000:1.0:1746065143.524335:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331456 00000100:00100000:1.0:1746065143.524448:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13532 00000100:00100000:1.0:1746065143.524453:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32000:x1830881263331456:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065143.524464:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.524473:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e2b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c59 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.524518:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.524529:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.524537:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.524547:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.524552:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.524557:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.524604:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.524612:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 27 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.524619:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 47 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.524624:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.524640:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 47 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.524655:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 47 pid: 7205 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.524662:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263259136:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.524700:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 27 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.524707:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 27 pid: 7205 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.524714:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263259264:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065143.524726:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.530403:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:0.0:1746065143.530498:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065142 -> 1746065143 00002000:00010000:0.0:1746065143.530502:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065142 -> 1746065143 00000100:00100000:0.0:1746065143.530523:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263258880:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065143.530552:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc146e2a8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c67 expref: 20 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.530564:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc146e2a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c67 expref: 20 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.530577:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852a200, rc 0) 00000100:00100000:0.0:1746065143.530614:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263331712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6720us (6890us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065143.530624:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12698 00000100:00100000:0.0:1746065143.530727:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331968 00000100:00100000:0.0:1746065143.530733:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331968 00000100:00100000:0.0:1746065143.530763:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4857 00000100:00100000:0.0:1746065143.530769:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40de450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+48:30398:x1830881263331968:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065143.530932:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40de450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+49:30398:x1830881263331968:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 162us (536us total) trans 8589935840 rc 0/0 00000100:00100000:0.0:1746065143.530938:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4857 00002000:00010000:2.0:1746065143.531176:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065141 -> 1746065143 00002000:00010000:2.0:1746065143.531180:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065140 -> 1746065143 00002000:00010000:2.0:1746065143.531181:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065141 -> 1746065143 00000100:00100000:2.0:1746065143.531191:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263259008:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065143.531207:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5c00/0xad6b7ddc146e2af lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c60 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.531215:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5c00/0xad6b7ddc146e2af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c60 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.531224:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:2.0:1746065143.531244:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263331584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7157us (7483us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065143.531249:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12699 00000100:00100000:3.0:1746065143.531956:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263258752:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065143.531967:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.531991:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263331200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15044us (15190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.532008:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5664 00000100:00100000:1.0:1746065143.532128:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263259136:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065143.532136:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263259264:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.532150:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065143.535686:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.537387:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.537519:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332096 00000100:00100000:3.0:1746065143.537528:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332096 00010000:00010000:3.0:1746065143.537555:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 28 pid: 7205 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.537573:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5665 00000100:00100000:3.0:1746065143.537579:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2007:x1830881263332096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.537589:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.537593:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 28 pid: 7205 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.537601:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 28 pid: 7205 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.537617:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146e207 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bcd expref: 28 pid: 7205 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.537638:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.537643:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.537649:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.537654:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.537657:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.537690:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2007:x1830881263332096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 111us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.537696:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5665 00000100:00100000:2.0:1746065143.540058:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332352 00000100:00100000:2.0:1746065143.540067:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332352 00002000:00100000:2.0:1746065143.540104:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4595712->4599807) req@ffff88008c52b100 x1830881263332352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.540113:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52b100 with x1830881263332352 ext(4595712->4599807) 00002000:00010000:2.0:1746065143.540117:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52b100 00000100:00100000:2.0:1746065143.540133:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3506 00000100:00100000:2.0:1746065143.540140:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263332352:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.540250:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263332352:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 110us (2867us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.540255:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3506 00002000:00100000:2.0:1746065143.540261:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4595712->4599807) req@ffff88008c52b100 x1830881263332352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.540267:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52b100 with x1830881263332352 ext(4595712->4599807) 00002000:00010000:2.0:1746065143.540269:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52b100 00000100:00100000:2.0:1746065143.540346:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.540931:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332480 00000100:00100000:0.0:1746065143.540936:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332480 00010000:00010000:0.0:1746065143.540955:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 49 pid: 7205 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.540985:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5666 00000100:00100000:0.0:1746065143.540990:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263332480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.541007:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.541011:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 49 pid: 7205 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.541022:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 49 pid: 7205 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.541038:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e285 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c3d expref: 49 pid: 7205 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.541055:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065143.541059:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.541068:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.541074:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.541090:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.541112:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263332480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 121us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.541118:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5666 00010000:00010000:1.0:1746065143.541169:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541175:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065143.541215:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065143.541219:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065143.541232:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541243:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541252:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541257:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541262:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541266:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541271:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065143.541274:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541279:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541286:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065143.541288:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065143.541291:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541307:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc146e2bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541319:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541324:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541328:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541331:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a9a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065143.541333:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541337:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541343:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5600) 00010000:00010000:1.0:1746065143.541345:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065143.541346:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541350:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e2c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.541378:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e2b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.541387:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.541393:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065143.541394:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065143.541396:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8400, rc 0) 00000100:00100000:1.0:1746065143.541416:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:32000:x1830881263331456:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 16963us (17741us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.541422:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13532 00000100:00100000:0.0:1746065143.544876:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.545347:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332736 00000100:00100000:2.0:1746065143.545354:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332736 00000100:00100000:2.0:1746065143.545391:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4858 00000100:00100000:2.0:1746065143.545397:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+27:31995:x1830881263332736:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065143.545622:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+28:31995:x1830881263332736:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 223us (752us total) trans 8589935841 rc 0/0 00000100:00100000:2.0:1746065143.545627:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4858 00000100:00100000:3.0:1746065143.546166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.546200:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.546645:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332864 00000100:00100000:0.0:1746065143.546649:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332864 00000100:00100000:0.0:1746065143.546680:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332992 00000100:00100000:0.0:1746065143.546682:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332992 00000100:00100000:0.0:1746065143.546700:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12700 00000100:00100000:0.0:1746065143.546705:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263332864:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065143.546714:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065143.546727:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc146e2d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c6e expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.546765:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263259392:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065143.546842:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.546926:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12701 00000100:00100000:2.0:1746065143.546932:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263332992:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065143.546939:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.546946:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c75 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.546957:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.546959:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.546965:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.546976:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.546984:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c400, rc 0) 00000100:00100000:2.0:1746065143.547020:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263332992:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 88us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.547025:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12701 00000100:00100000:0.0:1746065143.547761:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.549108:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.549136:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.549206:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263259392:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065143.549228:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc146e2d2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c6e expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.549238:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc146e2d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c6e expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.549246:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8c00, rc 0) 00000100:00100000:0.0:1746065143.549274:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263332864:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 2568us (3108us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065143.549280:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12700 00000100:00100000:0.0:1746065143.549297:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333120 00000100:00100000:0.0:1746065143.549300:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333120 00000100:00100000:0.0:1746065143.549317:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333248 00000100:00100000:0.0:1746065143.549319:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333248 00000100:00100000:0.0:1746065143.549331:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12702 00000100:00100000:0.0:1746065143.549336:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263333120:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065143.549344:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065143.549354:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc146e2e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c7c expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.549383:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263259520:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065143.549424:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.549562:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12703 00000100:00100000:3.0:1746065143.549569:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263333248:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065143.549576:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.549584:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc146e2e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c83 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.549607:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263259648:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065143.549631:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.549673:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333504 00000100:00100000:3.0:1746065143.549676:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333504 00002000:00100000:3.0:1746065143.549696:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4599808->5021695) req@ffff880097fa2d80 x1830881263333504/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.549704:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2d80 with x1830881263333504 ext(4599808->5021695) 00002000:00010000:3.0:1746065143.549707:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2d80 00000100:00100000:3.0:1746065143.549719:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3507 00000100:00100000:3.0:1746065143.549724:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263333504:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065143.551767:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263259520:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065143.551803:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc146e2e0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c7c expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.551813:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc146e2e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c7c expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.551821:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4200, rc 0) 00000100:00100000:0.0:1746065143.553180:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263333120:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3837us (5414us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065143.553188:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12702 00000100:00100000:3.0:1746065143.554202:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263259648:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065143.554224:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc146e2e7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c83 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.554235:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc146e2e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c83 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.554259:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00000100:00100000:3.0:1746065143.554288:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263333248:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4720us (5182us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065143.554305:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12703 00000100:00100000:2.0:1746065143.560294:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.560352:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333760 00000100:00100000:1.0:1746065143.560360:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333760 00000100:00100000:1.0:1746065143.560399:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13533 00000100:00100000:1.0:1746065143.560406:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:32000:x1830881263333760:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065143.560422:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.560439:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9600/0xad6b7ddc146e2ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c8a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.560517:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.560530:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.560536:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.560562:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.560571:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 18 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.560581:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263259776:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065143.560635:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.561056:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263333504:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11330us (11917us total) trans 0 rc 421888/421888 00000100:00100000:3.0:1746065143.561063:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3507 00002000:00100000:3.0:1746065143.561070:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4599808->5021695) req@ffff880097fa2d80 x1830881263333504/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 421888/421888 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.561078:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2d80 with x1830881263333504 ext(4599808->5021695) 00002000:00010000:3.0:1746065143.561082:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2d80 00000100:00100000:1.0:1746065143.563955:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263259776:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.563978:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065143.564307:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.564443:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333888 00000100:00100000:3.0:1746065143.564449:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333888 00010000:00010000:3.0:1746065143.564481:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 19 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.564501:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5667 00000100:00100000:3.0:1746065143.564507:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263333888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.564519:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.564523:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 19 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.564532:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 19 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.564554:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e2cb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c59 expref: 19 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.564565:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.564568:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.564575:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.564581:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.564596:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.564628:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263333888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 120us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.564635:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5667 00010000:00010000:1.0:1746065143.565329:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.565336:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065143.565353:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065143.565452:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9600/0xad6b7ddc146e2ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c8a expref: 19 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.566276:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c8a expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.566285:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065143.566287:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065143.566290:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9200, rc 0) 00000100:00100000:1.0:1746065143.566323:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32000:x1830881263333760:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5917us (6036us total) trans 8589935842 rc 0/0 00000100:00100000:1.0:1746065143.566329:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13533 00000100:00100000:0.0:1746065143.566993:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.567040:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.567628:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334016 00000100:00100000:3.0:1746065143.567636:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334016 00000100:00100000:3.0:1746065143.567678:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334144 00000100:00100000:3.0:1746065143.567680:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334144 00000100:00100000:3.0:1746065143.568084:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12704 00000100:00100000:3.0:1746065143.568092:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263334016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.568106:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.568119:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146e303 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c91 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.568162:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263259904:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065143.568224:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.568293:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12705 00000100:00100000:1.0:1746065143.568300:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263334144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065143.568306:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.568313:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc146e30a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c98 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065143.568335:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263260032:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065143.568356:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.569574:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.570263:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334400 00000100:00100000:1.0:1746065143.570269:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334400 00000100:00100000:1.0:1746065143.570486:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13534 00000100:00100000:1.0:1746065143.570495:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32000:x1830881263334400:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065143.570510:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.570512:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065143.570531:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc146e2f5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c8a expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.570544:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065143.570547:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065143.570555:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e311 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932c9f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.570636:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.570646:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.570654:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065143.570662:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065143.570734:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8400/0xad6b7ddc146e311 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.570744:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 19 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.570750:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065143.570752:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065143.570754:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9a00, rc 0) 00000100:00100000:1.0:1746065143.570811:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:32000:x1830881263334400:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 317us (1240us total) trans 8589935843 rc 0/0 00000100:00100000:1.0:1746065143.570817:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13534 00000100:00100000:1.0:1746065143.570863:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263260032:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065143.570880:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc146e30a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c98 expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.570888:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc146e30a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c98 expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.570895:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8600, rc 0) 00000100:00100000:1.0:1746065143.570914:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263334144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2616us (3873us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065143.570919:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12705 00000100:00100000:3.0:1746065143.571101:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263259904:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065143.571117:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146e303 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c91 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.571124:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abac800/0xad6b7ddc146e303 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c91 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.571134:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac800, rc 0) 00000100:00100000:3.0:1746065143.571152:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263334016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3061us (4160us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065143.571157:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12704 00000100:00100000:0.0:1746065143.574218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.574536:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334528 00000100:00100000:2.0:1746065143.574544:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334528 00000100:00100000:2.0:1746065143.574588:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13535 00000100:00100000:2.0:1746065143.574594:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:32000:x1830881263334528:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065143.574612:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.574627:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146e326 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ca6 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.574667:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146e326 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ca6 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.574678:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146e326 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ca6 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.574691:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065143.574693:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065143.574695:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d000, rc 0) 00000100:00100000:2.0:1746065143.574726:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:32000:x1830881263334528:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 132us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.574731:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13535 00000100:00100000:0.0:1746065143.575056:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.575158:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.575932:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334656 00000100:00100000:3.0:1746065143.575937:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334656 00000100:00100000:3.0:1746065143.575968:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334784 00000100:00100000:3.0:1746065143.575970:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334784 00000100:00100000:3.0:1746065143.575985:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12706 00000100:00100000:3.0:1746065143.575990:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263334656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.576009:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.576019:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e32d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cad expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.576056:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263260160:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065143.576109:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.576162:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12707 00000100:00100000:0.0:1746065143.576167:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263334784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065143.576173:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065143.576179:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146e334 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cb4 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.576198:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263260288:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065143.576216:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.577794:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263260288:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065143.577820:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146e334 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cb4 expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.577830:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146e334 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cb4 expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.577839:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a175000, rc 0) 00000100:00100000:1.0:1746065143.577868:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263334784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1700us (2709us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065143.577875:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12707 00000100:00100000:3.0:1746065143.578242:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263260160:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065143.578258:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e32d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cad expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.578266:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146e32d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cad expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065143.578595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.578611:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.578624:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334912 00000100:00100000:1.0:1746065143.578628:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334912 00010000:00010000:3.0:1746065143.578793:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:3.0:1746065143.578824:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263334656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2834us (3768us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065143.578830:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12706 00000100:00100000:3.0:1746065143.578843:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335040 00000100:00100000:3.0:1746065143.578846:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335040 00000100:00100000:1.0:1746065143.579153:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12708 00000100:00100000:1.0:1746065143.579161:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263334912:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065143.579191:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.579204:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.579210:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.579211:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.579214:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.579237:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.579247:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 28 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.579257:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263260416:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065143.579301:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa102780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.579325:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.580385:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.580486:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335168 00000100:00100000:3.0:1746065143.580491:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335168 00000100:00100000:3.0:1746065143.580523:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12709 00000100:00100000:3.0:1746065143.580530:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263335040:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065143.580553:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.580564:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.580570:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580576:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580580:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.580582:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.580584:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.580600:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580609:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.580617:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263260544:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.580651:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580658:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.580665:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263260672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.580688:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.580694:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.580701:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263260800:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.580713:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.580728:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12710 00000100:00100000:3.0:1746065143.580733:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263335168:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065143.580747:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.580756:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580762:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580768:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580788:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.580790:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.580792:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.580804:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580812:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 29 pid: 12260 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.580819:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263260928:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.580846:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580853:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 9 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.580858:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263261056:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.580876:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.580883:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.580890:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263261184:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.580900:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065143.581293:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.581311:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.581401:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335296 00000100:00100000:0.0:1746065143.581405:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335296 00000100:00100000:0.0:1746065143.581428:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335424 00000100:00100000:0.0:1746065143.581430:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335424 00000100:00100000:0.0:1746065143.581437:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335552 00000100:00100000:0.0:1746065143.581438:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335552 00000100:00100000:0.0:1746065143.581449:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12711 00000100:00100000:0.0:1746065143.581453:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263335296:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065143.581468:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581476:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581482:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.581488:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 28 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.581492:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.581493:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.581495:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581508:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 28 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.581514:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 28 pid: 13375 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746065143.581527:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263261312:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065143.581552:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065143.581558:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 12 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746065143.581564:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263261440:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065143.581579:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581584:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 15 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.581590:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263261568:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065143.581599:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.581610:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12712 00000100:00100000:0.0:1746065143.581614:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263335424:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065143.581626:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581633:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581643:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581649:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581653:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746065143.581654:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746065143.581655:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581666:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581671:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 15 pid: 9548 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.581677:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263261696:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065143.581692:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581698:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 28 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.581703:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263261824:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065143.581720:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 15 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581726:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 15 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.581734:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263261952:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065143.581747:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.581761:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12713 00000100:00100000:0.0:1746065143.581766:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263335552:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065143.581796:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581803:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581808:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065143.581809:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065143.581811:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581823:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.581830:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 9 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.581842:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263262080:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065143.581872:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.587314:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263260544:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065143.587365:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263260416:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.587382:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065143.599205:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.599223:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.599242:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.599254:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.599269:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.599292:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335808 00000100:00100000:1.0:1746065143.599304:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335808 00010000:00010000:1.0:1746065143.599338:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 10 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.599358:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336064 00000100:00100000:1.0:1746065143.599360:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336064 00010000:00010000:1.0:1746065143.599367:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 11 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.599378:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335936 00000100:00100000:1.0:1746065143.599381:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335936 00010000:00010000:1.0:1746065143.599387:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 12 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.599394:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336320 00000100:00100000:1.0:1746065143.599395:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336320 00010000:00010000:1.0:1746065143.599401:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 30 pid: 12260 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.599413:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5668 00000100:00100000:1.0:1746065143.599420:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263335808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.599431:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.599446:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 10 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599455:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 10 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599475:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc146e24d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c0c expref: 10 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599491:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.599523:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263335808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.599529:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5668 00000100:00100000:1.0:1746065143.599543:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5669 00000100:00100000:1.0:1746065143.599548:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263336064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.599555:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.599562:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 12 pid: 10219 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599568:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 12 pid: 10219 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599581:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.599594:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263336064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.599600:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5669 00000100:00100000:1.0:1746065143.599608:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5670 00000100:00100000:1.0:1746065143.599613:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263335936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.599618:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.599624:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 11 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599631:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 11 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599639:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.599651:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263335936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.599656:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5670 00000100:00100000:1.0:1746065143.599665:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5671 00000100:00100000:1.0:1746065143.599669:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263336320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.599674:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.599680:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 30 pid: 12260 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599687:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 30 pid: 12260 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599697:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.599709:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263336320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.599714:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5671 00000100:00100000:1.0:1746065143.599762:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.599801:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336448 00000100:00100000:1.0:1746065143.599805:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336448 00010000:00010000:1.0:1746065143.599817:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 29 pid: 13375 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.599832:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5672 00000100:00100000:1.0:1746065143.599836:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263336448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.599842:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.599852:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 29 pid: 13375 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599858:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 29 pid: 13375 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.599869:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.599883:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263336448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.599888:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5672 00000100:00100000:1.0:1746065143.599936:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.599946:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336192 00000100:00100000:1.0:1746065143.599949:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336192 00010000:00010000:1.0:1746065143.599959:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 13 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.599970:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5673 00000100:00100000:1.0:1746065143.599974:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263336192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.599980:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.599986:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 13 pid: 10219 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.600002:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 13 pid: 10219 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.600013:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.600026:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263336192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.600030:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5673 00000100:00100000:1.0:1746065143.600062:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.600073:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336704 00000100:00100000:1.0:1746065143.600075:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336704 00010000:00010000:1.0:1746065143.600084:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.600095:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5674 00000100:00100000:1.0:1746065143.600099:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263336704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.600104:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.600110:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.600153:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 9 pid: 12258 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.600163:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.600164:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.600168:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.600176:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.600189:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.600202:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263336704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.600207:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5674 00010000:00010000:2.0:1746065143.600389:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146e0da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932afb expref: 29 pid: 12260 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.600402:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263260928:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.600412:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146e190 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b87 expref: 10 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.600422:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263261056:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.600430:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc146e09b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aca expref: 8 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.600436:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263261184:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.600455:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600463:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600469:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600485:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600491:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600497:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600503:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065143.600506:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600513:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600524:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.600529:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131bef400/0xad6b7ddc146e349 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.600574:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263335168:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 19839us (21247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.600582:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12710 00000100:00100000:2.0:1746065143.600679:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263261696:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.600917:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc146e2d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c75 expref: 8 pid: 12258 timeout: 839 lvb_type: 1 00000100:00100000:3.0:1746065143.600932:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263260672:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.600939:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263260800:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065143.600953:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.600972:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335680 00000100:00100000:3.0:1746065143.600976:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335680 00002000:00100000:3.0:1746065143.601012:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (450560->552959) req@ffff8800a4e50700 x1830881263335680/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.601020:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50700 with x1830881263335680 ext(450560->552959) 00010000:00010000:3.0:1746065143.601026:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.601035:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065143.601040:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e50700 00000100:00100000:3.0:1746065143.601052:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1240 00000100:00100000:3.0:1746065143.601056:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263335680:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:0.0:1746065143.601209:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc146e0ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b02 expref: 30 pid: 13375 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746065143.601230:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263261312:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065143.601239:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e1a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b8e expref: 12 pid: 10219 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746065143.601245:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263261440:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065143.601252:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263261568:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065143.601266:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.603376:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.603395:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336832 00000100:00100000:0.0:1746065143.603400:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336832 00010000:00010000:0.0:1746065143.603426:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 30 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.603463:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5675 00000100:00100000:0.0:1746065143.603471:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263336832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.603483:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.603499:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 30 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.603508:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 30 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.603527:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.603559:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263336832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.603565:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5675 00000100:00100000:0.0:1746065143.603605:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065143.603701:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146e166 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b64 expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.603713:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263261824:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.603722:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263261952:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.603741:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065143.603851:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336960 00000100:00100000:3.0:1746065143.603855:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336960 00002000:00100000:3.0:1746065143.603877:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4599807) req@ffff88009577ce00 x1830881263336960/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.603885:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ce00 with x1830881263336960 ext(4194304->4599807) 00010000:00010000:3.0:1746065143.603890:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.603897:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065143.603902:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009577ce00 00000100:00100000:3.0:1746065143.603916:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1241 00000100:00100000:3.0:1746065143.603920:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263336960:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065143.604153:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263262080:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.604164:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.606336:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.606839:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.606857:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.606877:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337216 00000100:00100000:0.0:1746065143.606883:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337216 00000100:00100000:1.0:1746065143.607152:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337088 00000100:00100000:1.0:1746065143.607155:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337088 00010000:00010000:1.0:1746065143.607177:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 18 pid: 9548 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.607208:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336576 00000100:00100000:1.0:1746065143.607210:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336576 00010000:00010000:1.0:1746065143.607217:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.607229:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5676 00000100:00100000:1.0:1746065143.607234:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263337088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.607244:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.607257:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 18 pid: 9548 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607266:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 18 pid: 9548 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607283:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146e182 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932b72 expref: 18 pid: 9548 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607294:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.607322:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263337088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.607327:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5676 00000100:00100000:1.0:1746065143.607338:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5677 00000100:00100000:1.0:1746065143.607342:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263336576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.607347:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.607356:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607362:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607376:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc146e23f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932bfe expref: 29 pid: 3067 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607385:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.607386:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.607389:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.607396:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.607411:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.607421:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263336576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 79us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.607425:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5677 00000100:00100000:1.0:1746065143.607453:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.607464:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337344 00000100:00100000:1.0:1746065143.607466:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337344 00010000:00010000:1.0:1746065143.607475:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 17 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.607486:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5678 00000100:00100000:1.0:1746065143.607489:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263337344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.607494:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.607502:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 17 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607513:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 17 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607523:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146e071 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932aa7 expref: 17 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.607531:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.607532:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.607534:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.607539:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.607552:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.607565:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263337344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.607569:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5678 00002000:00100000:0.0:1746065143.607707:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (4120576->4194303) req@ffff88009577ea00 x1830881263337216/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.607715:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ea00 with x1830881263337216 ext(4120576->4194303) 00010000:00010000:0.0:1746065143.607720:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 8 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.607727:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 8 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065143.607732:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009577ea00 00000100:00100000:0.0:1746065143.607746:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1242 00000100:00100000:0.0:1746065143.607750:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263337216:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:0.0:1746065143.607846:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.607852:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.607864:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.607870:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.607875:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.607880:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a174a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065143.607883:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.607889:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.607896:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.607901:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc146e350 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.607938:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263335296:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 26484us (27555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.607944:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12711 00010000:00010000:0.0:1746065143.608024:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.608030:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.608042:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.608047:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.608053:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.608057:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abade00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065143.608060:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.608065:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.608073:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.608079:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146e342 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.608111:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263335040:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 27582us (29499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.608116:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12709 00000100:00100000:3.0:1746065143.616436:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263335680:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 15371us (17230us total) trans 21474840817 rc 0/0 00000100:00100000:3.0:1746065143.616447:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1240 00002000:00100000:3.0:1746065143.616457:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (450560->552959) req@ffff8800a4e50700 x1830881263335680/t21474840817(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.616465:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50700 with x1830881263335680 ext(450560->552959) 00010000:00010000:3.0:1746065143.616474:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.616485:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065143.616491:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e50700 00000100:00100000:1.0:1746065143.619228:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263337216:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11469us (12361us total) trans 17179873379 rc 0/0 00000100:00100000:1.0:1746065143.619238:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1242 00002000:00100000:1.0:1746065143.619247:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (4120576->4194303) req@ffff88009577ea00 x1830881263337216/t17179873379(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.619256:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ea00 with x1830881263337216 ext(4120576->4194303) 00010000:00010000:1.0:1746065143.619264:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.619275:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746065143.619281:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009577ea00 00000100:00100000:2.0:1746065143.619887:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263336960:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15963us (16279us total) trans 21474840818 rc 0/0 00000100:00100000:2.0:1746065143.619895:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1241 00002000:00100000:2.0:1746065143.619901:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4599807) req@ffff88009577ce00 x1830881263336960/t21474840818(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.619908:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ce00 with x1830881263336960 ext(4194304->4599807) 00010000:00010000:2.0:1746065143.619914:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.619923:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065143.619929:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009577ce00 00000100:00100000:0.0:1746065143.623434:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.623954:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337472 00000100:00100000:3.0:1746065143.623962:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337472 00010000:00010000:3.0:1746065143.623991:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.624026:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5679 00000100:00100000:3.0:1746065143.624033:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263337472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.624046:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.624064:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.624073:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.624093:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009019ec00/0xad6b7ddc146e2a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4599807) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c52 expref: 16 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.624107:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.624109:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.624113:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.624121:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.624141:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.624178:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263337472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 145us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.624184:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5679 00010000:00010000:2.0:1746065143.624297:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.624306:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.624321:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.624327:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.624333:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.624338:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdac00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065143.624342:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.624349:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.624358:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.624363:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146e357 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.624419:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263335424:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 42803us (43126us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.624426:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12712 00000100:00100000:1.0:1746065143.625162:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.625269:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337600 00000100:00100000:0.0:1746065143.625274:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337600 00010000:00010000:0.0:1746065143.625290:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.625315:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5680 00000100:00100000:0.0:1746065143.625321:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263337600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.625329:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.625339:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.625348:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.625361:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e293 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 450560->552959) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c44 expref: 29 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.626526:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.626531:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.626536:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.626546:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.626581:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.626627:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263337600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1304us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.626635:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5680 00010000:00010000:2.0:1746065143.626697:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.626705:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.626723:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.626728:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.626735:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.626745:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d03c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065143.626748:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.626753:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.626763:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.626768:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d03c400/0xad6b7ddc146e33b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.626829:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263334912:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 47669us (48235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.626836:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12708 00000100:00100000:0.0:1746065143.627313:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.627575:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337728 00000100:00100000:2.0:1746065143.627580:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337728 00010000:00010000:2.0:1746065143.627601:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.627832:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5681 00000100:00100000:2.0:1746065143.627840:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263337728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.627850:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.627864:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.627874:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.627889:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146e277 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c36 expref: 10 pid: 10219 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.627898:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.627899:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.627902:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.627907:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.628305:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065143.628499:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.628506:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.628520:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.628525:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.628531:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.628536:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835c200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065143.628538:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.628544:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.628557:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.628562:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc146e35e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.628625:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263337728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 785us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.628631:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5681 00000100:00100000:1.0:1746065143.628724:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2007:x1830881263335552:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 46958us (47411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.628730:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12713 00000100:00100000:0.0:1746065143.630626:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.631493:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337984 00000100:00100000:1.0:1746065143.631502:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337984 00000100:00100000:1.0:1746065143.631548:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13536 00000100:00100000:1.0:1746065143.631555:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:32000:x1830881263337984:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:1.0:1746065143.631591:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.631611:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146e326 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ca6 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631625:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065143.631628:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065143.631646:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.631656:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146dbbd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ac expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631662:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 47 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631672:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93272e expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631677:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 47 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631683:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 27 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631688:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 47 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631693:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631698:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 10/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065143.631724:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631734:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 27 pid: 9571 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.631746:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262208:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.631853:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 47 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631865:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 47 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.631873:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262336:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.631897:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 27 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631904:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 27 pid: 7204 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.631911:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262464:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.631936:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 47 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631943:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 47 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.631950:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262592:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.631969:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93272e expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.631976:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93272e expref: 27 pid: 9571 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.631983:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262720:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.632025:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 47 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.632032:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 47 pid: 9571 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.632040:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262848:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.632064:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146dbbd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ac expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.632071:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146dbbd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ac expref: 27 pid: 9571 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.632078:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262976:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065143.632092:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.637095:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.637168:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338624 00000100:00100000:0.0:1746065143.637174:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338624 00000100:00100000:2.0:1746065143.637274:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262208:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.637283:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262336:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.637290:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262464:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.637296:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262592:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.637302:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262720:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.637309:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262848:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065143.637371:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4859 00000100:00100000:0.0:1746065143.637379:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+48:16305:x1830881263338624:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065143.638447:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+49:16305:x1830881263338624:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1065us (1356us total) trans 8589935844 rc 0/0 00000100:00100000:0.0:1746065143.638454:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4859 00000100:00100000:1.0:1746065143.638564:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.638884:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.638900:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338368 00000100:00100000:0.0:1746065143.638904:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338368 00000100:00100000:2.0:1746065143.639379:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263262976:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.639412:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065143.639496:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339392 00000100:00100000:3.0:1746065143.639501:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339392 00000100:00100000:3.0:1746065143.639537:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13537 00000100:00100000:3.0:1746065143.639543:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+49:32004:x1830881263339392:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065143.639557:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.639570:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc146e36c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cbb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.639625:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.639635:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.639644:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.639654:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.639659:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.639664:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065143.639926:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4860 00000100:00100000:0.0:1746065143.639932:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+28:31232:x1830881263338368:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065143.640050:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+29:31232:x1830881263338368:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 118us (1166us total) trans 8589935845 rc 0/0 00000100:00100000:0.0:1746065143.640056:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4860 00000100:00100000:0.0:1746065143.640104:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.640155:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.640167:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.640188:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.640210:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.640231:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338112 00000100:00100000:0.0:1746065143.640234:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338112 00010000:00010000:0.0:1746065143.640248:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 29 pid: 7204 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.640260:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338880 00000100:00100000:0.0:1746065143.640261:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338880 00010000:00010000:0.0:1746065143.640269:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93272e expref: 30 pid: 9571 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.640276:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339008 00000100:00100000:0.0:1746065143.640277:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339008 00010000:00010000:0.0:1746065143.640284:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 51 pid: 9571 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.640290:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338752 00000100:00100000:0.0:1746065143.640292:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338752 00010000:00010000:0.0:1746065143.640298:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 52 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.640305:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339136 00000100:00100000:0.0:1746065143.640306:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339136 00010000:00010000:0.0:1746065143.640313:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146dbbd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ac expref: 31 pid: 9571 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.640325:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5682 00000100:00100000:0.0:1746065143.640330:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+31:2005:x1830881263338112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.640338:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.640341:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 31 pid: 7204 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640348:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 31 pid: 7204 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640361:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146db46 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93274a expref: 31 pid: 7204 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640370:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065143.640374:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.640381:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.640401:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881263338112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.640406:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5682 00000100:00100000:0.0:1746065143.640416:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5683 00000100:00100000:0.0:1746065143.640420:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+29:2005:x1830881263338880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.640427:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.640430:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93272e expref: 29 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640441:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93272e expref: 29 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640450:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc146db2a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93272e expref: 29 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640458:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065143.640461:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.640466:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.640479:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263338880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.640484:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5683 00000100:00100000:0.0:1746065143.640493:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5684 00000100:00100000:0.0:1746065143.640498:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+52:2006:x1830881263339008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.640514:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.640518:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 52 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640525:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 52 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640534:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc146dbe0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ba expref: 52 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640541:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065143.640545:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.640549:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.640563:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+51:2006:x1830881263339008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.640568:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5684 00000100:00100000:0.0:1746065143.640577:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5685 00000100:00100000:0.0:1746065143.640582:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263338752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.640587:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.640590:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 50 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640597:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 50 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640605:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146db38 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93273c expref: 50 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640613:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065143.640615:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.640619:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.640632:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263338752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.640637:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5685 00000100:00100000:0.0:1746065143.640663:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5686 00000100:00100000:0.0:1746065143.640667:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263339136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.640672:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.640676:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146dbbd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ac expref: 27 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640682:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146dbbd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ac expref: 27 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640690:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146dbbd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9327ac expref: 27 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.640699:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065143.640702:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.640707:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.640721:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263339136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.640726:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5686 00000100:00100000:0.0:1746065143.643653:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.646629:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339520 00000100:00100000:3.0:1746065143.646639:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339520 00010000:00010000:3.0:1746065143.646670:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 26 pid: 9571 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.646703:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5687 00000100:00100000:3.0:1746065143.646708:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263339520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.646721:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.646726:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 26 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.646736:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 26 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.646754:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146de64 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932918 expref: 26 pid: 9571 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.646769:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.646789:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.646796:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065143.646848:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263339520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 138us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.646854:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5687 00000100:00100000:2.0:1746065143.646958:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.647080:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339648 00000100:00100000:0.0:1746065143.647084:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339648 00010000:00010000:0.0:1746065143.647097:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 49 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746065143.647120:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5688 00000100:00100000:0.0:1746065143.647124:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263339648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.647131:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.647134:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 49 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.647141:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 49 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.647151:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4400/0xad6b7ddc146dd68 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93288c expref: 49 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.647160:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065143.647163:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.647168:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.647173:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065143.647189:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.647207:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263339648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.647212:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5688 00010000:00010000:2.0:1746065143.647260:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065143.647266:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000040:00080000:2.0:1746065143.647511:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].495, 88 off51616 00000004:00080000:2.0:1746065143.647519:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665745036ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647543:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].444, 88 off47120 00000004:00080000:2.0:1746065143.647548:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739665774349ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.647560:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].445, 88 off47208 00000004:00080000:2.0:1746065143.647563:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739665789656ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.647571:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].496, 88 off51704 00000004:00080000:2.0:1746065143.647574:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665800681ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647581:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].497, 88 off51792 00000004:00080000:2.0:1746065143.647584:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665810146ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647591:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].446, 88 off47296 00000004:00080000:2.0:1746065143.647593:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739665819961ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.647601:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].447, 88 off47384 00000004:00080000:2.0:1746065143.647603:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739665829207ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.647609:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].448, 88 off47472 00000004:00080000:2.0:1746065143.647611:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739665837997ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.647618:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].498, 88 off51880 00000004:00080000:2.0:1746065143.647621:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665847689ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647629:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].449, 88 off47560 00000004:00080000:2.0:1746065143.647631:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739665857859ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.647639:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].499, 88 off51968 00000004:00080000:2.0:1746065143.647641:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665867946ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647648:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].450, 88 off47648 00000004:00080000:2.0:1746065143.647651:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739665877652ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.647657:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].500, 88 off52056 00000004:00080000:2.0:1746065143.647659:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665885922ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647665:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].501, 88 off52144 00000004:00080000:2.0:1746065143.647667:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665893667ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647673:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].502, 88 off52232 00000004:00080000:2.0:1746065143.647675:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665901164ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647680:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].503, 88 off52320 00000004:00080000:2.0:1746065143.647682:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739665908214ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.647687:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].451, 88 off47736 00000004:00080000:2.0:1746065143.647689:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739665915444ns, next at 615601404258ns, rc = 0 00000001:00080000:0.0:1746065143.657142:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935846 is committed 00000004:00080000:0.0:1746065143.657152:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 446 committed 00000004:00080000:0.0:1746065143.657159:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 496 committed 00000004:00080000:0.0:1746065143.657171:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 495 committed 00000004:00080000:0.0:1746065143.657173:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 494 committed 00000004:00080000:0.0:1746065143.657174:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 493 committed 00000004:00080000:0.0:1746065143.657176:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 445 committed 00000004:00080000:0.0:1746065143.657177:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 492 committed 00000004:00080000:0.0:1746065143.657179:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 444 committed 00000004:00080000:0.0:1746065143.657180:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 491 committed 00000004:00080000:0.0:1746065143.657182:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 443 committed 00000004:00080000:0.0:1746065143.657183:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 442 committed 00000004:00080000:0.0:1746065143.657185:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 441 committed 00000004:00080000:0.0:1746065143.657186:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 490 committed 00000004:00080000:0.0:1746065143.657188:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 489 committed 00000004:00080000:0.0:1746065143.657189:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 440 committed 00000004:00080000:0.0:1746065143.657191:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 439 committed 00000004:00080000:0.0:1746065143.657193:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 488 committed 00000001:00080000:0.0:1746065143.657197:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935845 is committed 00000001:00080000:0.0:1746065143.657200:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935844 is committed 00000100:00100000:2.0:1746065143.657404:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263263488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.657457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.657494:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263264000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.657510:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.657527:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065143.657532:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263263104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.657547:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.657558:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263263616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.657573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.657589:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263263232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.657604:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.657615:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263263744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.657646:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.657659:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065143.657663:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263263360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.657682:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1746065143.658160:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009577f800 reply state ffff88009df67400 transno 8589935846 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658179:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658186:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.658189:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065143.658192:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746065143.658265:0:7231:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065143.658277:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32000:x1830881263337984:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 26720us (27654us total) trans 8589935846 rc 0/0 00000100:00100000:3.0:1746065143.658284:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13536 00010000:00010000:3.0:1746065143.658309:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658315:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658321:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658326:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065143.658329:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658339:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658346:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.658348:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065143.658351:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658354:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e365 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065143.658385:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.658395:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.658402:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.658423:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.658433:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 7 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.658442:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263264128:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065143.658470:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.658874:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263263872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.658893:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065143.659049:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263488 00000100:00100000:1.0:1746065143.659055:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263488 00000100:00100000:1.0:1746065143.659087:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264000 00000100:00100000:1.0:1746065143.659090:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264000 00000100:00100000:1.0:1746065143.659099:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263104 00000100:00100000:1.0:1746065143.659101:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263104 00000100:00100000:1.0:1746065143.659107:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263616 00000100:00100000:1.0:1746065143.659109:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263616 00000100:00100000:1.0:1746065143.659114:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263232 00000100:00100000:1.0:1746065143.659115:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263232 00000100:00100000:1.0:1746065143.659119:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263744 00000100:00100000:1.0:1746065143.659121:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263744 00000100:00100000:1.0:1746065143.659125:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263360 00000100:00100000:1.0:1746065143.659126:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263360 00000100:00100000:1.0:1746065143.659130:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263872 00000100:00100000:1.0:1746065143.659131:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263872 00000100:00100000:1.0:1746065143.659137:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12714 00000100:00100000:1.0:1746065143.659143:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263263488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065143.659241:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065143.659243:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065143.659245:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065143.659247:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065143.659249:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746065143.659276:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263263488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (1819us total) trans 21474840819 rc 0/0 00000100:00100000:1.0:1746065143.659282:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12714 00000100:00100000:1.0:1746065143.659293:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12715 00000100:00100000:1.0:1746065143.659298:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263264000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065143.659338:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:1.0:1746065143.659340:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065143.659342:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065143.659343:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065143.659345:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:1.0:1746065143.659360:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263264000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (1849us total) trans 21474840820 rc 0/0 00000100:00100000:1.0:1746065143.659364:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12715 00000100:00100000:1.0:1746065143.659372:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12716 00000100:00100000:1.0:1746065143.659376:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263263104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065143.659414:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263263104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (1866us total) trans 21474840821 rc 0/0 00000100:00100000:1.0:1746065143.659421:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12716 00000100:00100000:1.0:1746065143.659429:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12717 00000100:00100000:1.0:1746065143.659433:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263263616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065143.659467:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:1.0:1746065143.659470:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065143.659471:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065143.659473:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065143.659474:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:1.0:1746065143.659491:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263263616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (1918us total) trans 21474840822 rc 0/0 00000100:00100000:1.0:1746065143.659496:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12717 00000100:00100000:1.0:1746065143.659599:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12718 00000100:00100000:1.0:1746065143.659603:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263263232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065143.659646:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263263232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (2041us total) trans 21474840823 rc 0/0 00000100:00100000:1.0:1746065143.659650:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12718 00000100:00100000:1.0:1746065143.659657:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12719 00000100:00100000:1.0:1746065143.659661:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263263744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065143.659695:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263263744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 34us (2049us total) trans 21474840824 rc 0/0 00000100:00100000:1.0:1746065143.659699:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12719 00000100:00100000:1.0:1746065143.659705:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12720 00000100:00100000:1.0:1746065143.659708:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263263360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065143.659740:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263263360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 31us (2057us total) trans 21474840825 rc 0/0 00000100:00100000:1.0:1746065143.659744:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12720 00000100:00100000:1.0:1746065143.659750:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12721 00000100:00100000:1.0:1746065143.659753:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263263872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065143.659793:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065143.659795:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065143.659797:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065143.659798:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065143.659800:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:1.0:1746065143.659814:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263263872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (921us total) trans 21474840826 rc 0/0 00000100:00100000:1.0:1746065143.659818:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12721 00000100:00080000:1.0:1746065143.659829:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065143.659900:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263264512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.659919:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065143.659932:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263265024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.659944:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065143.659954:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065143.659959:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263264384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.659971:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065143.659978:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263264896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.659990:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065143.660014:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264512 00000100:00100000:1.0:1746065143.660016:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264512 00000100:00100000:1.0:1746065143.660033:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265024 00000100:00100000:1.0:1746065143.660035:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265024 00000100:00100000:1.0:1746065143.660040:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264384 00000100:00100000:1.0:1746065143.660042:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264384 00000100:00100000:1.0:1746065143.660048:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264896 00000100:00100000:1.0:1746065143.660049:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264896 00000100:00100000:1.0:1746065143.660056:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12722 00000100:00100000:1.0:1746065143.660060:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3762:x1830881263264512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660125:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263264512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (204us total) trans 17179873380 rc 0/0 00000100:00100000:1.0:1746065143.660130:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12722 00000100:00100000:1.0:1746065143.660138:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12723 00000100:00100000:1.0:1746065143.660142:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3762:x1830881263265024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660184:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263265024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (238us total) trans 17179873381 rc 0/0 00000100:00100000:1.0:1746065143.660188:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12723 00000100:00100000:1.0:1746065143.660195:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12724 00000100:00100000:1.0:1746065143.660199:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3762:x1830881263264384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660236:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263264384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (264us total) trans 17179873382 rc 0/0 00000100:00100000:1.0:1746065143.660240:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12724 00000100:00100000:1.0:1746065143.660248:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12725 00000100:00100000:1.0:1746065143.660252:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3762:x1830881263264896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660294:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263264896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (302us total) trans 17179873383 rc 0/0 00000100:00100000:1.0:1746065143.660298:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12725 00000100:00100000:1.0:1746065143.660312:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263264256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660326:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065143.660338:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263264768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660351:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065143.660359:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065143.660363:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263264640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660373:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065143.660380:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263265152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660391:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746065143.660402:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065143.660418:0:3762:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873363 gen 2 00000004:00080000:1.0:1746065143.660422:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ce00, transno 17179873298 00000004:00080000:1.0:1746065143.660427:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d880, transno 17179873299 00000004:00080000:1.0:1746065143.660430:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d500, transno 17179873300 00000004:00080000:1.0:1746065143.660431:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3c000, transno 17179873301 00000004:00080000:1.0:1746065143.660433:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d180, transno 17179873302 00000004:00080000:1.0:1746065143.660435:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ed80, transno 17179873303 00000004:00080000:1.0:1746065143.660437:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ca80, transno 17179873304 00000004:00080000:1.0:1746065143.660439:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3fb80, transno 17179873305 00000004:00080000:1.0:1746065143.660441:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4000, transno 17179873310 00000004:00080000:1.0:1746065143.660443:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd6d80, transno 17179873311 00000004:00080000:1.0:1746065143.660445:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6680, transno 17179873312 00000004:00080000:1.0:1746065143.660447:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4000, transno 17179873313 00000004:00080000:1.0:1746065143.660449:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6a00, transno 17179873314 00000004:00080000:1.0:1746065143.660451:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4380, transno 17179873315 00000004:00080000:1.0:1746065143.660453:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6300, transno 17179873316 00000004:00080000:1.0:1746065143.660455:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5500, transno 17179873317 00000004:00080000:1.0:1746065143.660457:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f2d80, transno 17179873318 00000004:00080000:1.0:1746065143.660458:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f2a00, transno 17179873319 00000004:00080000:1.0:1746065143.660460:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3800, transno 17179873320 00000004:00080000:1.0:1746065143.660462:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1880, transno 17179873321 00000004:00080000:1.0:1746065143.660464:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e53800, transno 17179873322 00000004:00080000:1.0:1746065143.660466:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0380, transno 17179873323 00000004:00080000:1.0:1746065143.660468:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e52a00, transno 17179873324 00000004:00080000:1.0:1746065143.660469:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3100, transno 17179873325 00000004:00080000:1.0:1746065143.660471:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097241500, transno 17179873336 00000004:00080000:1.0:1746065143.660473:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097243b80, transno 17179873337 00000004:00080000:1.0:1746065143.660475:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097243100, transno 17179873338 00000004:00080000:1.0:1746065143.660476:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097241c00, transno 17179873339 00000004:00080000:1.0:1746065143.660478:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097243800, transno 17179873340 00000004:00080000:1.0:1746065143.660480:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097242300, transno 17179873341 00000004:00080000:1.0:1746065143.660481:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097242680, transno 17179873342 00000004:00080000:1.0:1746065143.660483:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097240e00, transno 17179873343 00000004:00080000:1.0:1746065143.660484:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da300, transno 17179873348 00000004:00080000:1.0:1746065143.660486:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d8700, transno 17179873349 00000004:00080000:1.0:1746065143.660488:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957db100, transno 17179873350 00000004:00080000:1.0:1746065143.660490:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c000, transno 17179873351 00000004:00080000:1.0:1746065143.660492:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9500, transno 17179873352 00000004:00080000:1.0:1746065143.660493:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9180, transno 17179873353 00000004:00080000:1.0:1746065143.660495:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957da680, transno 17179873354 00000004:00080000:1.0:1746065143.660497:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9f80, transno 17179873355 00000004:00080000:1.0:1746065143.660499:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577d180, transno 17179873356 00000004:00080000:1.0:1746065143.660501:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f100, transno 17179873357 00000004:00080000:1.0:1746065143.660503:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bf100, transno 17179873358 00000004:00080000:1.0:1746065143.660505:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577df80, transno 17179873359 00000004:00080000:1.0:1746065143.660506:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bce00, transno 17179873360 00000004:00080000:1.0:1746065143.660508:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577e300, transno 17179873361 00000004:00080000:1.0:1746065143.660510:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bed80, transno 17179873362 00000004:00080000:1.0:1746065143.660512:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bdc00, transno 17179873363 00000100:00100000:1.0:1746065143.660517:0:3762:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880097fa4e00 x1830881263264384/t17179873382(17179873382) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065159 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065143.660525:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa4e00/2, rc 0, transno 17179873382 00000100:00100000:1.0:1746065143.660529:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263264384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065143.660537:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa5c00/2, rc 0, transno 17179873383 00000100:00100000:1.0:1746065143.660539:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263264896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065143.660545:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa5180/2, rc 0, transno 17179873380 00000100:00100000:1.0:1746065143.660547:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263264512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065143.660552:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa5f80/2, rc 0, transno 17179873381 00000100:00100000:1.0:1746065143.660555:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263265024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660565:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264256 00000100:00100000:1.0:1746065143.660567:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264256 00000100:00100000:1.0:1746065143.660576:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264768 00000100:00100000:1.0:1746065143.660578:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264768 00000100:00100000:1.0:1746065143.660582:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264640 00000100:00100000:1.0:1746065143.660584:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264640 00000100:00100000:1.0:1746065143.660588:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265152 00000100:00100000:1.0:1746065143.660590:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265152 00000100:00100000:1.0:1746065143.660596:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12726 00000100:00100000:1.0:1746065143.660599:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881263264256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660652:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263264256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (325us total) trans 17179873384 rc 0/0 00000100:00100000:1.0:1746065143.660657:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12726 00000100:00100000:1.0:1746065143.660666:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12727 00000100:00100000:1.0:1746065143.660670:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881263264768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660715:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263264768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (362us total) trans 17179873385 rc 0/0 00000100:00100000:1.0:1746065143.660723:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12727 00000100:00100000:1.0:1746065143.660731:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12728 00000100:00100000:1.0:1746065143.660735:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881263264640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065143.660769:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065143.660788:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065143.660790:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065143.660791:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065143.660793:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:1.0:1746065143.660811:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263264640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (436us total) trans 17179873386 rc 0/0 00000100:00100000:1.0:1746065143.660816:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12728 00000100:00100000:1.0:1746065143.660825:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12729 00000100:00100000:1.0:1746065143.660829:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881263265152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065143.660875:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263265152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (482us total) trans 17179873387 rc 0/0 00000100:00100000:1.0:1746065143.660880:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12729 00000004:00080000:1.0:1746065143.660898:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa5500/2, rc 0, transno 17179873386 00000100:00100000:1.0:1746065143.660902:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263264640:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065143.660908:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa6300/2, rc 0, transno 17179873387 00000100:00100000:1.0:1746065143.660910:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263265152:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065143.660915:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa4a80/2, rc 0, transno 17179873384 00000100:00100000:1.0:1746065143.660918:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263264256:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065143.660923:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa5880/2, rc 0, transno 17179873385 00000100:00100000:1.0:1746065143.660926:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263264768:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065143.661118:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 48 done 00000100:00100000:3.0:1746065143.663104:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840806 gen 2 00000004:00080000:3.0:1746065143.663111:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf800, transno 21474840707 00000004:00080000:3.0:1746065143.663120:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edac380, transno 21474840708 00000004:00080000:3.0:1746065143.663122:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edac000, transno 21474840709 00000004:00080000:3.0:1746065143.663124:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edae300, transno 21474840710 00000004:00080000:3.0:1746065143.663125:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edac700, transno 21474840711 00000004:00080000:3.0:1746065143.663127:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edadc00, transno 21474840712 00000004:00080000:3.0:1746065143.663129:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaca80, transno 21474840713 00000004:00080000:3.0:1746065143.663131:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf480, transno 21474840714 00000004:00080000:3.0:1746065143.663133:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edad880, transno 21474840715 00000004:00080000:3.0:1746065143.663135:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaed80, transno 21474840716 00000004:00080000:3.0:1746065143.663137:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaea00, transno 21474840717 00000004:00080000:3.0:1746065143.663139:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad7b80, transno 21474840718 00000004:00080000:3.0:1746065143.663141:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad5f80, transno 21474840719 00000004:00080000:3.0:1746065143.663142:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad5500, transno 21474840720 00000004:00080000:3.0:1746065143.663144:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad4000, transno 21474840721 00000004:00080000:3.0:1746065143.663146:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad5c00, transno 21474840722 00000004:00080000:3.0:1746065143.663148:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edae680, transno 21474840723 00000004:00080000:3.0:1746065143.663150:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad7100, transno 21474840724 00000004:00080000:3.0:1746065143.663152:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513ad80, transno 21474840732 00000004:00080000:3.0:1746065143.663154:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513aa00, transno 21474840733 00000004:00080000:3.0:1746065143.663156:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138e00, transno 21474840734 00000004:00080000:3.0:1746065143.663157:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138380, transno 21474840735 00000004:00080000:3.0:1746065143.663160:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513a300, transno 21474840736 00000004:00080000:3.0:1746065143.663161:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139f80, transno 21474840737 00000004:00080000:3.0:1746065143.663163:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139c00, transno 21474840738 00000004:00080000:3.0:1746065143.663164:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138000, transno 21474840739 00000004:00080000:3.0:1746065143.663166:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139880, transno 21474840740 00000004:00080000:3.0:1746065143.663168:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b03800, transno 21474840745 00000004:00080000:3.0:1746065143.663170:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b03100, transno 21474840746 00000004:00080000:3.0:1746065143.663173:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b01880, transno 21474840747 00000004:00080000:3.0:1746065143.663174:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b02680, transno 21474840748 00000004:00080000:3.0:1746065143.663177:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b00000, transno 21474840749 00000004:00080000:3.0:1746065143.663179:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b01180, transno 21474840750 00000004:00080000:3.0:1746065143.663181:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b02300, transno 21474840751 00000004:00080000:3.0:1746065143.663182:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b00700, transno 21474840752 00000004:00080000:3.0:1746065143.663185:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221500, transno 21474840753 00000004:00080000:3.0:1746065143.663186:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139180, transno 21474840754 00000004:00080000:3.0:1746065143.663189:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138a80, transno 21474840755 00000004:00080000:3.0:1746065143.663191:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6df100, transno 21474840756 00000004:00080000:3.0:1746065143.663193:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6ddf80, transno 21474840757 00000004:00080000:3.0:1746065143.663195:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513a680, transno 21474840758 00000004:00080000:3.0:1746065143.663197:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dca80, transno 21474840759 00000004:00080000:3.0:1746065143.663199:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513b480, transno 21474840760 00000004:00080000:3.0:1746065143.663201:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dfb80, transno 21474840761 00000004:00080000:3.0:1746065143.663203:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dd880, transno 21474840762 00000004:00080000:3.0:1746065143.663205:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d05500, transno 21474840776 00000004:00080000:3.0:1746065143.663206:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06300, transno 21474840777 00000004:00080000:3.0:1746065143.663208:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06a00, transno 21474840778 00000004:00080000:3.0:1746065143.663210:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d04e00, transno 21474840779 00000004:00080000:3.0:1746065143.663212:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06d80, transno 21474840780 00000004:00080000:3.0:1746065143.663214:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd180, transno 21474840781 00000004:00080000:3.0:1746065143.663216:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06680, transno 21474840782 00000004:00080000:3.0:1746065143.663217:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d04000, transno 21474840783 00000004:00080000:3.0:1746065143.663219:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d07100, transno 21474840784 00000004:00080000:3.0:1746065143.663221:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b67800, transno 21474840789 00000004:00080000:3.0:1746065143.663223:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b65c00, transno 21474840790 00000004:00080000:3.0:1746065143.663225:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b65180, transno 21474840791 00000004:00080000:3.0:1746065143.663227:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b64700, transno 21474840792 00000004:00080000:3.0:1746065143.663229:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b65880, transno 21474840793 00000004:00080000:3.0:1746065143.663231:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b64380, transno 21474840794 00000004:00080000:3.0:1746065143.663233:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b64e00, transno 21474840795 00000004:00080000:3.0:1746065143.663235:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b66300, transno 21474840796 00000004:00080000:3.0:1746065143.663237:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b66680, transno 21474840797 00000004:00080000:3.0:1746065143.663239:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c30380, transno 21474840798 00000004:00080000:3.0:1746065143.663240:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097240700, transno 21474840799 00000004:00080000:3.0:1746065143.663242:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097242d80, transno 21474840800 00000004:00080000:3.0:1746065143.663244:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c31500, transno 21474840801 00000004:00080000:3.0:1746065143.663246:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d05180, transno 21474840802 00000004:00080000:3.0:1746065143.663248:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097240000, transno 21474840803 00000004:00080000:3.0:1746065143.663251:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c31c00, transno 21474840804 00000004:00080000:3.0:1746065143.663253:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b64a80, transno 21474840805 00000004:00080000:3.0:1746065143.663254:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097240380, transno 21474840806 00000100:00100000:3.0:1746065143.663261:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800983b9f80 x1830881263263104/t21474840821(21474840821) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065159 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746065143.663271:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800983b9f80/2, rc 0, transno 21474840821 00000100:00100000:3.0:1746065143.663274:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263263104:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065143.663287:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528000/2, rc 0, transno 21474840822 00000100:00100000:3.0:1746065143.663290:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263263616:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065143.663297:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e50e00/2, rc 0, transno 21474840819 00000100:00100000:3.0:1746065143.663300:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263263488:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065143.663305:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a78380/2, rc 0, transno 21474840820 00000100:00100000:3.0:1746065143.663308:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263264000:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065143.663326:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834f480/2, rc 0, transno 21474840825 00000100:00100000:3.0:1746065143.663328:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263263360:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065143.663334:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077ce00/2, rc 0, transno 21474840826 00000100:00100000:3.0:1746065143.663337:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263263872:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065143.663342:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fca80/2, rc 0, transno 21474840823 00000100:00100000:3.0:1746065143.663345:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263263232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065143.663351:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6de680/2, rc 0, transno 21474840824 00000100:00100000:3.0:1746065143.663353:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263263744:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065143.664173:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 72 done 00000100:00100000:3.0:1746065143.664246:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065143.664255:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263265280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065143.664295:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.664359:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265280 00000100:00100000:2.0:1746065143.664364:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265280 00000100:00100000:2.0:1746065143.664387:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12730 00000100:00100000:2.0:1746065143.664393:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263265280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.664499:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263265280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (203us total) trans 21474840827 rc 0/0 00000100:00100000:2.0:1746065143.664505:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12730 00000004:00080000:3.0:1746065143.664578:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e4000/2, rc 0, transno 21474840827 00000100:00100000:3.0:1746065143.664582:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263265280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065143.672873:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.673031:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263264128:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.673053:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065143.673110:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339776 00000100:00100000:3.0:1746065143.673116:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339776 00000100:00100000:3.0:1746065143.673159:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13538 00000100:00100000:3.0:1746065143.673166:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32000:x1830881263339776:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065143.673185:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.673199:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cc2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.673242:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.673253:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.673266:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.673269:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065143.673271:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5200, rc 0) 00000100:00100000:3.0:1746065143.673307:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32000:x1830881263339776:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 141us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.673316:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13538 00000100:00100000:0.0:1746065143.673858:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.674008:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339904 00000100:00100000:3.0:1746065143.674012:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339904 00010000:00010000:3.0:1746065143.674027:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 8 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.674137:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5689 00000100:00100000:3.0:1746065143.674144:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263339904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.674152:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.674157:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 8 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.674165:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 8 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.674179:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9a00/0xad6b7ddc146e318 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932c9f expref: 8 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.674188:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.674191:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.674198:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.674203:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.675006:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065143.675137:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.675145:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065143.675158:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065143.675230:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.675236:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.675241:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.675245:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065143.675248:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.675254:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.675263:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065143.675265:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065143.675268:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.675272:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc146e381 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065143.675480:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263339904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1334us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.675487:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5689 00010000:00010000:2.0:1746065143.677155:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677166:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677171:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677176:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677180:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065143.677184:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677189:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677199:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065143.677202:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065143.677205:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677209:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146e373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677219:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677223:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677227:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677231:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065143.677233:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677237:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677243:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a400) 00010000:00010000:2.0:1746065143.677244:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065143.677246:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677254:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc146e37a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065143.677297:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc146e36c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cbb expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.677303:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc146e36c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cbb expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.677310:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47000, rc 0) 00000100:00100000:2.0:1746065143.677360:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+27:32004:x1830881263339392:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 37816us (38795us total) trans 8589935847 rc 301/301 00000100:00100000:2.0:1746065143.677367:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13537 00000100:00100000:2.0:1746065143.677981:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.678055:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340160 00000100:00100000:3.0:1746065143.678061:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340160 00000100:00100000:3.0:1746065143.678097:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4861 00000100:00100000:3.0:1746065143.678102:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32000:x1830881263340160:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065143.678217:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32000:x1830881263340160:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 114us (237us total) trans 8589935848 rc 0/0 00000100:00100000:3.0:1746065143.678223:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4861 00000100:00100000:0.0:1746065143.682544:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.682579:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.682693:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340672 00000100:00100000:3.0:1746065143.682701:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340672 00000100:00100000:3.0:1746065143.682741:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13539 00000100:00100000:3.0:1746065143.682748:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+27:32007:x1830881263340672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.682769:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.682812:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e396 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cc9 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.682873:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.682884:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.682892:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.682902:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.682910:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.682914:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065143.683017:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340416 00000100:00100000:1.0:1746065143.683022:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340416 00000100:00100000:1.0:1746065143.683051:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4862 00000100:00100000:1.0:1746065143.683056:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32000:x1830881263340416:12345-192.168.202.27@tcp:35:mirror_io.0 00010000:00010000:3.0:1746065143.683251:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4800/0xad6b7ddc146e3ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.683259:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4800/0xad6b7ddc146e3ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.683266:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4800/0xad6b7ddc146e3ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065143.683274:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:1.0:1746065143.683976:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32000:x1830881263340416:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 917us (1436us total) trans 8589935850 rc 0/0 00000100:00100000:1.0:1746065143.683982:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4862 00010000:00010000:3.0:1746065143.684484:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684493:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684498:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684503:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684508:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065143.684511:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684518:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684532:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065143.684534:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065143.684538:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684542:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc146e39d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684551:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684555:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684559:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684563:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065143.684564:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684568:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684573:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a100) 00010000:00010000:3.0:1746065143.684575:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065143.684577:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684581:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e3a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.684611:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e396 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc9 expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.684621:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4800/0xad6b7ddc146e3ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc9 expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.684627:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.684628:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065143.684630:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4800, rc 0) 00000100:00100000:3.0:1746065143.684666:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+29:32007:x1830881263340672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1918us (2085us total) trans 8589935849 rc 0/0 00000100:00100000:3.0:1746065143.684672:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13539 00000100:00100000:0.0:1746065143.685343:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.685407:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340928 00000100:00100000:3.0:1746065143.685412:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340928 00000100:00100000:3.0:1746065143.685446:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13540 00000100:00100000:3.0:1746065143.685452:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c1bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+7:32009:x1830881263340928:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065143.685466:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.685474:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc146e3b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cd0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.685514:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685523:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685530:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685539:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685548:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685553:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685612:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685618:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685624:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065143.685630:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065143.685666:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685672:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685676:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685681:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685685:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065143.685688:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685693:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685703:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065143.685705:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065143.685708:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685712:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e3c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685719:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685723:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685727:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685731:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065143.685733:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685737:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685742:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2aa00) 00010000:00010000:3.0:1746065143.685744:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065143.685746:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685749:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e3c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065143.685769:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc146e3b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.685802:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.685806:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.685808:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065143.685810:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4600, rc 0) 00000100:00100000:3.0:1746065143.685833:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c1bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+9:32009:x1830881263340928:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 381us (492us total) trans 8589935851 rc 0/0 00000100:00100000:3.0:1746065143.685838:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13540 00000100:00100000:0.0:1746065143.691401:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.691421:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.691448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.691514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.691584:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341056 00000100:00100000:2.0:1746065143.691592:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341056 00000100:00100000:2.0:1746065143.691626:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341184 00000100:00100000:2.0:1746065143.691628:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341184 00000100:00100000:2.0:1746065143.691639:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341312 00000100:00100000:2.0:1746065143.691640:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341312 00000100:00100000:2.0:1746065143.691660:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341440 00000100:00100000:2.0:1746065143.691662:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341440 00000100:00100000:2.0:1746065143.691675:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12731 00000100:00100000:2.0:1746065143.691681:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263341056:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.691697:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.691712:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cd7 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065143.691735:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6f7, atime: 0x6812d6f4, ctime: 0x6812d6f7, blocks: 0x7f8 00010000:00010000:2.0:1746065143.691750:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.691752:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.691758:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.691770:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.691800:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8c00, rc 0) 00000100:00100000:2.0:1746065143.691837:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263341056:12345-192.168.202.27@tcp:101:cat.0 Request processed in 156us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.691843:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12731 00000100:00100000:2.0:1746065143.691857:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12732 00000100:00100000:2.0:1746065143.691861:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263341184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.691867:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.691876:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cde expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065143.691887:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6f7, atime: 0x6812d6f7, ctime: 0x6812d6f7, blocks: 0x808 00010000:00010000:2.0:1746065143.691893:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.691894:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.691897:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.691906:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.691912:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9a00, rc 0) 00000100:00100000:2.0:1746065143.691925:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263341184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 63us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.691929:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12732 00000100:00100000:2.0:1746065143.691937:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12733 00000100:00100000:2.0:1746065143.691941:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263341312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.691945:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.691953:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ce5 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065143.691961:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6f6, atime: 0x6812d6f6, ctime: 0x6812d6f6, blocks: 0x800 00010000:00010000:2.0:1746065143.691967:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.691968:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.691971:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.691979:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.691984:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8a00, rc 0) 00000100:00100000:2.0:1746065143.692009:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263341312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 68us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.692013:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12733 00000100:00100000:2.0:1746065143.692022:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12734 00000100:00100000:2.0:1746065143.692026:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263341440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.692032:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.692038:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cec expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065143.692046:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6f5, atime: 0x6812d6f5, ctime: 0x6812d6f5, blocks: 0x808 00010000:00010000:2.0:1746065143.692051:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.692052:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.692056:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.692063:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 30 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.692069:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8200, rc 0) 00000100:00100000:2.0:1746065143.692081:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263341440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.692085:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12734 00000100:00100000:0.0:1746065143.694123:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.694161:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.694219:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341568 00000100:00100000:1.0:1746065143.694225:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341568 00000100:00100000:1.0:1746065143.694260:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341696 00000100:00100000:1.0:1746065143.694262:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341696 00000100:00100000:1.0:1746065143.694276:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12735 00000100:00100000:1.0:1746065143.694281:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263341568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065143.694290:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.694302:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cf3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065143.694317:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d6f7, atime: 0x6812d6f7, ctime: 0x6812d6f7, blocks: 0x1650 00010000:00010000:1.0:1746065143.694328:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.694330:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.694334:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 31 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.694344:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 31 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.694356:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0a0800, rc 0) 00000100:00100000:1.0:1746065143.694381:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263341568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.694386:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12735 00000100:00100000:1.0:1746065143.694399:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12736 00000100:00100000:1.0:1746065143.694404:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263341696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065143.694410:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.694417:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932cfa expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065143.694427:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d6f7, atime: 0x6812d6f7, ctime: 0x6812d6f7, blocks: 0x1000 00010000:00010000:1.0:1746065143.694434:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.694435:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.694438:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 31 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.694446:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 31 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.694451:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3200, rc 0) 00000100:00100000:1.0:1746065143.694465:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263341696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.694470:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12736 00000100:00100000:0.0:1746065143.704845:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.705035:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341952 00000100:00100000:2.0:1746065143.705046:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341952 00000100:00100000:2.0:1746065143.705119:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13541 00000100:00100000:2.0:1746065143.705129:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+29:32004:x1830881263341952:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065143.705155:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.705159:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065143.705184:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4800/0xad6b7ddc146e3ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc9 expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.705205:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065143.705211:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065143.705222:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9c00/0xad6b7ddc146e406 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d01 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.705267:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065143.705279:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.705286:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.705292:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065143.705319:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.705330:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 8 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.705341:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263265408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.705445:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.705454:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 8 pid: 7205 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.705462:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263265536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.705492:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.707757:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.707864:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.708338:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.710484:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.710501:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342464 00000100:00100000:2.0:1746065143.710508:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342464 00002000:00100000:2.0:1746065143.710546:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012edac380 x1830881263342464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.710555:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881263342464 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.710560:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac380 00000100:00100000:2.0:1746065143.710585:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342336 00000100:00100000:2.0:1746065143.710587:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342336 00002000:00100000:2.0:1746065143.710597:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88012edac000 x1830881263342336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.710603:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac000 with x1830881263342336 ext(0->1048575) 00002000:00010000:2.0:1746065143.710605:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edac000 00000100:00100000:2.0:1746065143.710619:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342720 00000100:00100000:2.0:1746065143.710621:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342720 00002000:00100000:2.0:1746065143.710630:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88012edae300 x1830881263342720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.710635:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae300 with x1830881263342720 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.710637:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edae300 00000100:00100000:2.0:1746065143.710645:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3508 00000100:00100000:2.0:1746065143.710650:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263342464:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.711210:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3509 00000100:00100000:2.0:1746065143.711215:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263342336:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.711699:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3510 00000100:00100000:2.0:1746065143.711704:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263342720:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065143.713741:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342976 00000100:00100000:0.0:1746065143.713749:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342976 00002000:00100000:0.0:1746065143.713794:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012edac700 x1830881263342976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.713802:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac700 with x1830881263342976 ext(1048576->2097151) 00002000:00010000:0.0:1746065143.713807:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edac700 00000100:00100000:0.0:1746065143.713823:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3511 00000100:00100000:0.0:1746065143.713829:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263342976:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065143.731757:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.731813:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.736331:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343232 00000100:00100000:3.0:1746065143.736342:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343232 00010000:00010000:3.0:1746065143.736377:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 9 pid: 7205 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.736400:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343104 00000100:00100000:3.0:1746065143.736402:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343104 00010000:00010000:3.0:1746065143.736411:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 9 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.736425:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5690 00000100:00100000:3.0:1746065143.736431:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263343232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065143.736443:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065143.736447:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 9 pid: 7205 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.736455:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 9 pid: 7205 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.736476:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.736480:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.736485:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.736490:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.736515:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5691 00000100:00100000:0.0:1746065143.736522:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263343104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.736528:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.736532:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 9 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:3.0:1746065143.736533:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263343232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (4784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.736538:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5690 00010000:00010000:0.0:1746065143.736540:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 9 pid: 7231 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.736549:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065143.736552:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065143.736557:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065143.736562:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065143.736573:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065143.736587:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263343104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 67us (4775us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.736595:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5691 00010000:00010000:2.0:1746065143.736973:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146e388 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cc2 expref: 8 pid: 7231 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.737006:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263265408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.737019:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc146e3ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd0 expref: 8 pid: 7205 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.737025:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263265536:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.737041:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065143.737047:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065143.737052:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000040:00080000:2.0:1746065143.737236:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].504, 88 off52408 00000004:00080000:2.0:1746065143.737240:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755466224ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737261:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].452, 88 off47824 00000004:00080000:2.0:1746065143.737264:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739755490024ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.737272:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].453, 88 off47912 00000004:00080000:2.0:1746065143.737274:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739755500812ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.737280:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].505, 88 off52496 00000004:00080000:2.0:1746065143.737282:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755508847ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737288:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].506, 88 off52584 00000004:00080000:2.0:1746065143.737290:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755516696ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737296:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].454, 88 off48000 00000004:00080000:2.0:1746065143.737298:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739755524697ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.737304:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].455, 88 off48088 00000004:00080000:2.0:1746065143.737307:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739755533163ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.737312:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].456, 88 off48176 00000004:00080000:2.0:1746065143.737314:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739755540763ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.737320:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].507, 88 off52672 00000004:00080000:2.0:1746065143.737322:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755548162ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737327:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].457, 88 off48264 00000004:00080000:2.0:1746065143.737329:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739755555618ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.737334:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].508, 88 off52760 00000004:00080000:2.0:1746065143.737337:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755563253ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737342:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].458, 88 off48352 00000004:00080000:2.0:1746065143.737344:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739755570676ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065143.737349:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].509, 88 off52848 00000004:00080000:2.0:1746065143.737351:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755577834ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737357:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].510, 88 off52936 00000004:00080000:2.0:1746065143.737359:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755585144ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737364:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].511, 88 off53024 00000004:00080000:2.0:1746065143.737366:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755592247ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737371:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].512, 88 off53112 00000004:00080000:2.0:1746065143.737373:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739755599773ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065143.737379:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].459, 88 off48440 00000004:00080000:2.0:1746065143.737381:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739755607147ns, next at 615601404258ns, rc = 0 00000100:00100000:2.0:1746065143.747530:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263342464:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 36867us (39766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065143.747541:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3508 00002000:00100000:2.0:1746065143.747553:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012edac380 x1830881263342464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.747562:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881263342464 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.747567:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac380 00000001:00080000:2.0:1746065143.753458:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935852 is committed 00000004:00080000:2.0:1746065143.753469:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 454 committed 00000004:00080000:2.0:1746065143.753476:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 505 committed 00000004:00080000:2.0:1746065143.754657:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 504 committed 00000004:00080000:2.0:1746065143.754662:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 503 committed 00000004:00080000:2.0:1746065143.754664:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 502 committed 00000004:00080000:2.0:1746065143.754665:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 453 committed 00000004:00080000:2.0:1746065143.754667:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 501 committed 00000004:00080000:2.0:1746065143.754669:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 452 committed 00000004:00080000:2.0:1746065143.754672:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 500 committed 00000004:00080000:2.0:1746065143.754673:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 451 committed 00000004:00080000:2.0:1746065143.754674:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 450 committed 00000004:00080000:2.0:1746065143.754676:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 449 committed 00000004:00080000:2.0:1746065143.754678:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 499 committed 00000004:00080000:2.0:1746065143.754679:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 498 committed 00000004:00080000:2.0:1746065143.754681:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 448 committed 00000004:00080000:2.0:1746065143.754682:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 447 committed 00000004:00080000:2.0:1746065143.754683:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 497 committed 00000001:00080000:2.0:1746065143.754689:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935851 is committed 00000001:00080000:2.0:1746065143.754693:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935850 is committed 00000100:00100000:0.0:1746065143.757062:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263265792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065143.757115:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065143.757158:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065143.757164:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263265664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065143.757181:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065143.757902:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263342336:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 46682us (50034us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.757910:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3509 00002000:00100000:3.0:1746065143.757918:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88012edac000 x1830881263342336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.757926:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac000 with x1830881263342336 ext(0->1048575) 00002000:00010000:3.0:1746065143.757931:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edac000 00000100:00100000:3.0:1746065143.758464:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265792 00000100:00100000:3.0:1746065143.758470:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265792 00000100:00100000:3.0:1746065143.758492:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265664 00000100:00100000:3.0:1746065143.758493:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265664 00000100:00100000:3.0:1746065143.758503:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12737 00000100:00100000:3.0:1746065143.758507:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263265792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065143.758610:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065143.758613:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065143.758615:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065143.758617:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065143.758618:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746065143.758640:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3762:x1830881263265792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (1524us total) trans 21474840828 rc 0/0 00000100:00100000:3.0:1746065143.758645:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12737 00000100:00100000:3.0:1746065143.758654:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12738 00000100:00100000:3.0:1746065143.758658:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263265664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065143.758707:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065143.758709:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065143.758710:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065143.758712:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065143.758714:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065143.758733:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263265664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1550us total) trans 17179873388 rc 0/0 00000100:00100000:3.0:1746065143.758737:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12738 00000100:00100000:3.0:1746065143.758751:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263265920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065143.758770:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065143.758809:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065143.758814:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263266048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065143.758828:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065143.758845:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265920 00000100:00100000:3.0:1746065143.758848:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265920 00000100:00100000:3.0:1746065143.758861:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266048 00000100:00100000:3.0:1746065143.758862:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266048 00000100:00100000:3.0:1746065143.758879:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12739 00000100:00100000:3.0:1746065143.758884:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3759:x1830881263265920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065143.758923:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065143.758925:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065142 -> 1746065142 00002000:00010000:3.0:1746065143.758927:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065142 -> 1746065142 00002000:00010000:3.0:1746065143.758928:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065142 -> 1746065142 00002000:00010000:3.0:1746065143.758930:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065143.758951:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3759:x1830881263265920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (180us total) trans 17179873389 rc 0/0 00000100:00100000:3.0:1746065143.758956:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12739 00000100:00100000:3.0:1746065143.758965:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12740 00000100:00100000:3.0:1746065143.758969:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3759:x1830881263266048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065143.759014:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065143.759016:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065143.759018:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065143.759019:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065143.759021:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746065143.759038:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3759:x1830881263266048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (208us total) trans 17179873390 rc 0/0 00000100:00100000:3.0:1746065143.759043:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12740 00000004:00080000:3.0:1746065143.759070:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f53480/2, rc 0, transno 17179873390 00000100:00100000:3.0:1746065143.759074:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263266048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065143.759080:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f51180/2, rc 0, transno 17179873389 00000100:00100000:3.0:1746065143.759082:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263265920:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065143.759126:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.759139:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.759141:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065143.759152:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9c00/0xad6b7ddc146e406 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 28 pid: 9571 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065143.759168:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.759187:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.759189:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065143.759191:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9e00, rc 0) 00000100:00100000:3.0:1746065143.759214:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+27:32004:x1830881263341952:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 54088us (54380us total) trans 8589935852 rc 0/0 00000100:00100000:3.0:1746065143.759220:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13541 00000004:00080000:0.0:1746065143.761172:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f51880/2, rc 0, transno 17179873388 00000100:00100000:0.0:1746065143.761182:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263265664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065143.761198:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ea00/2, rc 0, transno 21474840828 00000100:00100000:0.0:1746065143.761202:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263265792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065143.761212:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065143.761220:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263266176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065143.761259:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065143.761298:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266176 00000100:00100000:0.0:1746065143.761302:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266176 00000100:00100000:0.0:1746065143.761334:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12741 00000100:00100000:0.0:1746065143.761341:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3762:x1830881263266176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065143.761433:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065143.761437:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065143.761439:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065143.761441:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065143.761442:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:0.0:1746065143.761479:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263266176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (220us total) trans 17179873391 rc 0/0 00000100:00100000:0.0:1746065143.761486:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12741 00000004:00080000:0.0:1746065143.761519:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f53800/2, rc 0, transno 17179873391 00000100:00100000:0.0:1746065143.761525:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263266176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.762309:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263266432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.762338:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.762382:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263266944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.762406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.762425:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263267456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.762450:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.762470:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746065143.762475:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263266560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.762498:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.762515:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263267072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.762537:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.762555:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263267584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.762577:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.762606:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266432 00000100:00100000:2.0:1746065143.762610:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266432 00000100:00100000:2.0:1746065143.762635:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266944 00000100:00100000:2.0:1746065143.762639:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266944 00000100:00100000:2.0:1746065143.762656:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267456 00000100:00100000:2.0:1746065143.762659:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267456 00000100:00100000:2.0:1746065143.762673:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266560 00000100:00100000:2.0:1746065143.762676:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266560 00000100:00100000:2.0:1746065143.762690:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267072 00000100:00100000:2.0:1746065143.762693:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267072 00000100:00100000:2.0:1746065143.762701:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267584 00000100:00100000:2.0:1746065143.762703:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267584 00000100:00100000:2.0:1746065143.762714:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12742 00000100:00100000:2.0:1746065143.762720:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263266432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065143.762852:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:2.0:1746065143.762856:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065143.762857:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065143.762859:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065143.762860:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:2.0:1746065143.762896:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263266432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (557us total) trans 21474840829 rc 0/0 00000100:00100000:2.0:1746065143.762902:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12742 00000100:00100000:2.0:1746065143.762920:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12743 00000100:00100000:2.0:1746065143.762925:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263266944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065143.762983:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065143.762986:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065143.762987:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065143.762989:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065143.762991:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:2.0:1746065143.763031:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263266944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (623us total) trans 21474840830 rc 0/0 00000100:00100000:2.0:1746065143.763036:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12743 00000100:00100000:2.0:1746065143.763052:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12744 00000100:00100000:2.0:1746065143.763058:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263267456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.763147:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263267456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (694us total) trans 17179873392 rc 0/0 00000100:00100000:2.0:1746065143.763153:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12744 00000100:00100000:2.0:1746065143.763166:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12745 00000100:00100000:2.0:1746065143.763173:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263266560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065143.763230:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065143.763233:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065143.763235:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065143.763236:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065143.763237:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746065143.763264:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263266560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (764us total) trans 21474840831 rc 0/0 00000100:00100000:2.0:1746065143.763271:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12745 00000100:00100000:2.0:1746065143.763285:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12746 00000100:00100000:2.0:1746065143.763290:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263267072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065143.763335:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:2.0:1746065143.763338:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065143.763340:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065143.763341:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065143.763342:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:2.0:1746065143.763370:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263267072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (831us total) trans 21474840832 rc 0/0 00000100:00100000:2.0:1746065143.763375:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12746 00000100:00100000:2.0:1746065143.763389:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12747 00000100:00100000:2.0:1746065143.763395:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263267584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.763470:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263267584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (891us total) trans 17179873393 rc 0/0 00000100:00100000:2.0:1746065143.763476:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12747 00000004:00080000:2.0:1746065143.763514:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d880/2, rc 0, transno 21474840831 00000100:00100000:2.0:1746065143.763520:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263266560:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065143.763529:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ed80/2, rc 0, transno 21474840832 00000100:00100000:2.0:1746065143.763532:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263267072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065143.763539:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6f800/2, rc 0, transno 17179873393 00000100:00100000:2.0:1746065143.763542:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263267584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065143.763549:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ce00/2, rc 0, transno 21474840829 00000100:00100000:2.0:1746065143.763552:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263266432:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065143.763559:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d180/2, rc 0, transno 21474840830 00000100:00100000:2.0:1746065143.763561:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263266944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065143.763567:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6d500/2, rc 0, transno 17179873392 00000100:00100000:2.0:1746065143.763570:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263267456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.763612:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263266688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.763639:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.763679:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263267200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.763705:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.763723:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263267712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.763744:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.763762:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1746065143.763768:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263266304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.763824:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.763859:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263266816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.763883:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.763901:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263267328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.763921:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065143.763946:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266688 00000100:00100000:2.0:1746065143.763950:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266688 00000100:00100000:2.0:1746065143.763967:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267200 00000100:00100000:2.0:1746065143.763970:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267200 00000100:00100000:2.0:1746065143.763980:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267712 00000100:00100000:2.0:1746065143.763982:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267712 00000100:00100000:2.0:1746065143.763989:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266304 00000100:00100000:2.0:1746065143.763991:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266304 00000100:00100000:2.0:1746065143.764016:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266816 00000100:00100000:2.0:1746065143.764019:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266816 00000100:00100000:2.0:1746065143.764028:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267328 00000100:00100000:2.0:1746065143.764030:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267328 00000100:00100000:2.0:1746065143.764042:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12748 00000100:00100000:2.0:1746065143.764047:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263266688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065143.764107:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:2.0:1746065143.764110:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065143.764112:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065143.764113:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065143.764115:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:2.0:1746065143.764149:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263266688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (508us total) trans 21474840833 rc 0/0 00000100:00100000:2.0:1746065143.764155:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12748 00000100:00100000:2.0:1746065143.764169:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12749 00000100:00100000:2.0:1746065143.764175:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263267200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.764251:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263267200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (544us total) trans 21474840834 rc 0/0 00000100:00100000:2.0:1746065143.764257:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12749 00000100:00100000:2.0:1746065143.764271:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12750 00000100:00100000:2.0:1746065143.764277:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881263267712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.764339:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263267712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (593us total) trans 17179873394 rc 0/0 00000100:00100000:2.0:1746065143.764345:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12750 00000100:00100000:2.0:1746065143.764359:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12751 00000100:00100000:2.0:1746065143.764365:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263266304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065143.764420:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065143.764423:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065141 -> 1746065141 00002000:00010000:2.0:1746065143.764425:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065141 -> 1746065141 00002000:00010000:2.0:1746065143.764426:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065141 -> 1746065141 00002000:00010000:2.0:1746065143.764428:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065143.764454:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263266304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (629us total) trans 21474840835 rc 0/0 00000100:00100000:2.0:1746065143.764460:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12751 00000100:00100000:2.0:1746065143.764473:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12752 00000100:00100000:2.0:1746065143.764478:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263266816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065143.764553:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263266816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (668us total) trans 21474840836 rc 0/0 00000100:00100000:2.0:1746065143.764559:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12752 00000100:00100000:2.0:1746065143.764572:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12753 00000100:00100000:2.0:1746065143.764578:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881263267328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065143.764655:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263267328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (732us total) trans 17179873395 rc 0/0 00000100:00100000:2.0:1746065143.764661:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12753 00000004:00080000:2.0:1746065143.764696:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3dc00/2, rc 0, transno 21474840835 00000100:00100000:2.0:1746065143.764701:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263266304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065143.764711:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3c000/2, rc 0, transno 21474840836 00000100:00100000:2.0:1746065143.764714:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263266816:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065143.764722:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6f100/2, rc 0, transno 17179873395 00000100:00100000:2.0:1746065143.764725:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263267328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065143.764733:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d500/2, rc 0, transno 21474840833 00000100:00100000:2.0:1746065143.764736:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263266688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065143.764744:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ca80/2, rc 0, transno 21474840834 00000100:00100000:2.0:1746065143.764746:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263267200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065143.764753:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6e300/2, rc 0, transno 17179873394 00000100:00100000:2.0:1746065143.764756:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263267712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065143.769225:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.770951:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263342720:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 59240us (62607us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065143.770961:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3510 00002000:00100000:2.0:1746065143.770972:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88012edae300 x1830881263342720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.770981:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae300 with x1830881263342720 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.770986:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edae300 00000100:00100000:3.0:1746065143.771482:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343488 00000100:00100000:3.0:1746065143.771490:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343488 00000100:00100000:3.0:1746065143.771526:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13542 00000100:00100000:3.0:1746065143.771532:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+7:32014:x1830881263343488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.771551:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.771566:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e414 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d08 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.771622:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.771633:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.771645:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.771654:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.771658:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.771663:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.771730:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.771736:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.771741:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065143.771747:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:1.0:1746065143.775856:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.776166:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263342976:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 62335us (65684us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065143.776174:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3511 00002000:00100000:0.0:1746065143.776184:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012edac700 x1830881263342976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.776192:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac700 with x1830881263342976 ext(1048576->2097151) 00002000:00010000:0.0:1746065143.776197:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edac700 00010000:00010000:3.0:1746065143.776452:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776461:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776466:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776472:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776477:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065143.776482:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776488:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776501:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065143.776504:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065143.776507:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776512:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e41b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776526:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776530:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776534:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776537:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065143.776539:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776543:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776548:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2ae00) 00010000:00010000:3.0:1746065143.776550:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065143.776552:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776559:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e422 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065143.776601:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146e414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.776678:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343616 00000100:00100000:2.0:1746065143.776684:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343616 00000100:00100000:2.0:1746065143.776720:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13543 00000100:00100000:2.0:1746065143.776726:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+27:32007:x1830881263343616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.776740:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.776751:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146e437 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d0f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.776798:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146e437 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d0f expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.776808:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146e437 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d0f expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.776823:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065143.776825:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065143.776827:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4c00, rc 0) 00000100:00100000:2.0:1746065143.776851:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+28:32007:x1830881263343616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 125us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.776855:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13543 00010000:00010000:3.0:1746065143.777095:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.777100:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065143.777102:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065143.777104:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5600, rc 0) 00000100:00100000:3.0:1746065143.777760:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+9:32014:x1830881263343488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6226us (8540us total) trans 8589935853 rc 0/0 00000100:00100000:3.0:1746065143.777766:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13542 00000100:00100000:0.0:1746065143.778518:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.779986:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343744 00000100:00100000:1.0:1746065143.780001:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343744 00000100:00100000:1.0:1746065143.780044:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 712 00000100:00100000:1.0:1746065143.780050:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263343744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.780060:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.780076:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146e437 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d0f expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.780100:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065143.780104:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.780141:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263343744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.780146:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 712 00000100:00100000:0.0:1746065143.783155:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.783878:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344000 00000100:00100000:1.0:1746065143.783887:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344000 00000100:00100000:1.0:1746065143.783940:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12754 00000100:00100000:1.0:1746065143.783947:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263344000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065143.783962:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.783976:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d1d expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.784003:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.784005:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.784013:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.784025:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065143.784035:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:1.0:1746065143.784209:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263344000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 262us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.784214:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12754 00000100:00100000:0.0:1746065143.784509:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.784525:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.785112:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.786228:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.786446:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.788101:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343872 00000100:00100000:3.0:1746065143.788110:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343872 00000100:00100000:3.0:1746065143.788146:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344256 00000100:00100000:3.0:1746065143.788148:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344256 00000100:00100000:3.0:1746065143.788156:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344512 00000100:00100000:3.0:1746065143.788157:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344512 00000100:00100000:3.0:1746065143.788166:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344128 00000100:00100000:3.0:1746065143.788168:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344128 00000100:00100000:3.0:1746065143.788180:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12755 00000100:00100000:3.0:1746065143.788186:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263343872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.788201:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.788214:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d16 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.788237:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.788239:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.788246:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.788259:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.788267:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5e00, rc 0) 00000100:00100000:3.0:1746065143.788307:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263343872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 121us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.788313:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12755 00000100:00100000:3.0:1746065143.788326:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12756 00000100:00100000:3.0:1746065143.788330:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263344256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.788336:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.788341:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d2b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.788350:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.788351:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.788354:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.788362:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.788372:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5800, rc 0) 00000100:00100000:3.0:1746065143.788384:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263344256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (3859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.788388:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12756 00000100:00100000:3.0:1746065143.788396:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12757 00000100:00100000:3.0:1746065143.788399:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263344512:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.788404:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.788411:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d39 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.788418:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.788419:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.788422:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.788429:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.788434:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4c00, rc 0) 00000100:00100000:3.0:1746065143.788443:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263344512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 44us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.788447:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12757 00000100:00100000:3.0:1746065143.788453:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12758 00000100:00100000:3.0:1746065143.788456:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263344128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.788462:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.788465:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d24 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.788472:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.788473:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.788476:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.788482:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.788487:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4a00, rc 0) 00000100:00100000:3.0:1746065143.788496:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263344128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 39us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.788499:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12758 00000100:00100000:3.0:1746065143.789353:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344384 00000100:00100000:3.0:1746065143.789358:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344384 00000100:00100000:3.0:1746065143.789376:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12759 00000100:00100000:3.0:1746065143.789380:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263344384:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065143.789387:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.789393:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d32 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.789403:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.789404:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065143.789408:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.789422:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065143.789428:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4000, rc 0) 00000100:00100000:3.0:1746065143.789450:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263344384:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.789454:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12759 00000100:00100000:0.0:1746065143.790736:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.790792:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344640 00000100:00100000:2.0:1746065143.790797:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344640 00000100:00100000:2.0:1746065143.790816:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12760 00000100:00100000:2.0:1746065143.790821:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:32004:x1830881263344640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065143.790830:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.790837:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d40 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.790852:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 32 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.790859:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.790863:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.790864:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.790866:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2801664->3117055] (req 2801664->3117055) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.790888:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.790898:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 17 pid: 13375 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.790908:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263267840:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.790982:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 32 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.790989:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 32 pid: 11461 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.791005:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263267968:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.791023:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.805405:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.805447:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.805476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.805515:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.805584:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344896 00000100:00100000:2.0:1746065143.805591:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344896 00002000:00100000:2.0:1746065143.805630:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012edaf480 x1830881263344896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.805639:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf480 with x1830881263344896 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.805644:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf480 00000100:00100000:2.0:1746065143.805661:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345152 00000100:00100000:2.0:1746065143.805663:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345152 00002000:00100000:2.0:1746065143.805673:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88011dad6d80 x1830881263345152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.805680:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6d80 with x1830881263345152 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.805683:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad6d80 00000100:00100000:2.0:1746065143.805692:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345408 00000100:00100000:2.0:1746065143.805694:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345408 00002000:00100000:2.0:1746065143.805705:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011dad7b80 x1830881263345408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.805710:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7b80 with x1830881263345408 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.805713:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad7b80 00000100:00100000:2.0:1746065143.805731:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3512 00000100:00100000:2.0:1746065143.805737:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263344896:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065143.806182:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3513 00000100:00100000:3.0:1746065143.806190:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263345152:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.806336:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263267840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.806345:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263267968:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.806368:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2801664->3117055] (req 2801664->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.806381:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4800, rc 0) 00000100:00100000:1.0:1746065143.807657:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345536 00000100:00100000:1.0:1746065143.807664:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345536 00010000:00010000:1.0:1746065143.807827:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 18 pid: 13375 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.807942:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5692 00000100:00100000:2.0:1746065143.807977:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:32004:x1830881263344640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 17152us (17242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.807984:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12760 00000100:00100000:3.0:1746065143.807990:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3514 00000100:00100000:3.0:1746065143.808006:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263345408:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065143.810206:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263345536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.810229:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.810262:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 18 pid: 13375 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.810276:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 18 pid: 13375 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.810297:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4000/0xad6b7ddc146e461 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d32 expref: 18 pid: 13375 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.810320:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.810359:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263345536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 175us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065143.810624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.810648:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345664 00000100:00100000:0.0:1746065143.810653:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345664 00010000:00010000:0.0:1746065143.810673:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 34 pid: 11461 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.811663:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5692 00000100:00100000:1.0:1746065143.811711:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.811733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.811746:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.811760:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346176 00000100:00100000:1.0:1746065143.811763:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346176 00002000:00100000:1.0:1746065143.811801:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097f50a80 x1830881263346176/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.811809:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50a80 with x1830881263346176 ext(1048576->2097151) 00002000:00010000:1.0:1746065143.811813:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f50a80 00000100:00100000:1.0:1746065143.811830:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346048 00000100:00100000:1.0:1746065143.811833:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346048 00002000:00100000:1.0:1746065143.811844:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097f53100 x1830881263346048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.811850:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53100 with x1830881263346048 ext(0->1048575) 00002000:00010000:1.0:1746065143.811853:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53100 00000100:00100000:1.0:1746065143.811860:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346688 00000100:00100000:1.0:1746065143.811862:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346688 00002000:00100000:1.0:1746065143.811870:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097a6d880 x1830881263346688/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.811875:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d880 with x1830881263346688 ext(1048576->2097151) 00002000:00010000:1.0:1746065143.811878:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6d880 00000100:00100000:1.0:1746065143.811887:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3515 00000100:00100000:1.0:1746065143.811893:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263346176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065143.812179:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3516 00000100:00100000:3.0:1746065143.812186:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263346048:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065143.812521:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3517 00000100:00100000:1.0:1746065143.812528:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263346688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065143.812824:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.812837:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346432 00000100:00100000:3.0:1746065143.812841:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346432 00002000:00100000:3.0:1746065143.812859:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880098dd8700 x1830881263346432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.812866:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8700 with x1830881263346432 ext(1048576->2097151) 00002000:00010000:3.0:1746065143.812870:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd8700 00000100:00100000:3.0:1746065143.812880:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3518 00000100:00100000:3.0:1746065143.812884:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263346432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065143.816938:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5693 00000100:00100000:0.0:1746065143.816951:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263345664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065143.816967:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065143.816989:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 34 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746065143.817012:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 34 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746065143.817032:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc146e3f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cf3 expref: 34 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746065143.817049:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.817051:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065143.817056:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.817063:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065143.817092:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065143.817102:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263268096:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065143.817178:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.820102:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.821251:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263268096:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065143.821268:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.821310:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263345664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4363us (10686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.821318:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5693 00000100:00100000:2.0:1746065143.822792:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346944 00000100:00100000:2.0:1746065143.822801:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346944 00002000:00100000:2.0:1746065143.822836:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2801664->2805759) req@ffff88011dad5c00 x1830881263346944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.822844:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5c00 with x1830881263346944 ext(2801664->2805759) 00002000:00010000:2.0:1746065143.822848:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad5c00 00000100:00100000:2.0:1746065143.822872:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3519 00000100:00100000:2.0:1746065143.822879:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263346944:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.822985:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263346944:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 106us (2890us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.822990:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3519 00002000:00100000:2.0:1746065143.823006:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2801664->2805759) req@ffff88011dad5c00 x1830881263346944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.823012:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5c00 with x1830881263346944 ext(2801664->2805759) 00002000:00010000:2.0:1746065143.823015:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad5c00 00000100:00100000:2.0:1746065143.829113:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263344896:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 23366us (23708us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065143.829123:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3512 00002000:00100000:2.0:1746065143.829132:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012edaf480 x1830881263344896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.829141:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf480 with x1830881263344896 ext(1048576->2097151) 00002000:00010000:2.0:1746065143.829146:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf480 00000100:00100000:3.0:1746065143.834927:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263345152:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 28728us (29469us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.834936:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3513 00002000:00100000:3.0:1746065143.834945:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88011dad6d80 x1830881263345152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.834952:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6d80 with x1830881263345152 ext(1048576->2097151) 00002000:00010000:3.0:1746065143.834957:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad6d80 00000100:00100000:3.0:1746065143.846009:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263345408:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 37988us (40516us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.846019:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3514 00002000:00100000:3.0:1746065143.846028:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88011dad7b80 x1830881263345408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.846037:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7b80 with x1830881263345408 ext(1048576->2097151) 00002000:00010000:3.0:1746065143.846042:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad7b80 00000100:00100000:1.0:1746065143.850566:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263346176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 38664us (38846us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065143.850575:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3515 00002000:00100000:1.0:1746065143.850585:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097f50a80 x1830881263346176/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.850593:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50a80 with x1830881263346176 ext(1048576->2097151) 00002000:00010000:1.0:1746065143.850598:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f50a80 00000100:00100000:3.0:1746065143.860141:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263346048:12345-192.168.202.27@tcp:3:cat.0 Request processed in 47947us (48398us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.860151:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3516 00002000:00100000:3.0:1746065143.860160:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097f53100 x1830881263346048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.860168:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53100 with x1830881263346048 ext(0->1048575) 00002000:00010000:3.0:1746065143.860173:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53100 00000100:00100000:1.0:1746065143.863866:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263346688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 51328us (52108us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065143.863878:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3517 00002000:00100000:1.0:1746065143.863890:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097a6d880 x1830881263346688/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.863898:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d880 with x1830881263346688 ext(1048576->2097151) 00002000:00010000:1.0:1746065143.863903:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6d880 00000100:00100000:0.0:1746065143.864235:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.864420:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.864487:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347200 00000100:00100000:1.0:1746065143.864496:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347200 00002000:00100000:1.0:1746065143.864530:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88011dad7100 x1830881263347200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 504/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.864537:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7100 with x1830881263347200 ext(2097152->4194303) 00002000:00010000:1.0:1746065143.864541:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad7100 00000100:00100000:1.0:1746065143.864556:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347456 00000100:00100000:1.0:1746065143.864559:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347456 00002000:00100000:1.0:1746065143.864571:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88011dad4000 x1830881263347456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065143.864577:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4000 with x1830881263347456 ext(2097152->4194303) 00002000:00010000:1.0:1746065143.864580:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad4000 00000100:00100000:1.0:1746065143.864592:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3520 00000100:00100000:1.0:1746065143.864598:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263347200:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065143.864981:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3521 00000100:00100000:2.0:1746065143.864989:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263347456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065143.867600:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263346432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 54707us (54769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.867612:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3518 00002000:00100000:3.0:1746065143.867621:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880098dd8700 x1830881263346432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.867629:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8700 with x1830881263346432 ext(1048576->2097151) 00002000:00010000:3.0:1746065143.867634:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd8700 00000100:00100000:0.0:1746065143.893298:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065143.893411:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065143.894508:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347584 00000100:00100000:2.0:1746065143.894518:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347584 00000100:00100000:2.0:1746065143.894563:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12761 00000100:00100000:2.0:1746065143.894571:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:32014:x1830881263347584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.894588:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.894602:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d47 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.894631:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.894639:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.894641:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.894644:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.894669:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.894678:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 32 pid: 9550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.894688:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263268224:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.894799:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.898271:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263347200:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33662us (36275us total) trans 0 rc 2093056/2093056 00000100:00100000:0.0:1746065143.898282:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3520 00002000:00100000:0.0:1746065143.898293:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88011dad7100 x1830881263347200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 504/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.898300:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7100 with x1830881263347200 ext(2097152->4194303) 00010000:00010000:0.0:1746065143.898309:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 31 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746065143.898321:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 31 pid: 9550 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746065143.898327:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011dad7100 00000100:00100000:2.0:1746065143.901162:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263268224:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.901188:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.901201:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4a00, rc 0) 00000100:00100000:2.0:1746065143.901241:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+18:32014:x1830881263347584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6670us (7950us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.901248:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12761 00000100:00100000:1.0:1746065143.909809:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.910010:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263347456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 45020us (45588us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065143.910020:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3521 00002000:00100000:2.0:1746065143.910029:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88011dad4000 x1830881263347456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.910037:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4000 with x1830881263347456 ext(2097152->4194303) 00002000:00010000:2.0:1746065143.910042:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad4000 00000100:00100000:0.0:1746065143.910110:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347968 00000100:00100000:0.0:1746065143.910117:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347968 00000100:00100000:0.0:1746065143.910155:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4863 00000100:00100000:0.0:1746065143.910160:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:32004:x1830881263347968:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065143.910309:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+28:32004:x1830881263347968:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 148us (507us total) trans 8589935854 rc 0/0 00000100:00100000:0.0:1746065143.910314:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4863 00000100:00100000:0.0:1746065143.912244:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.912416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.912979:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348096 00000100:00100000:2.0:1746065143.912987:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348096 00002000:00100000:2.0:1746065143.913035:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2801664->3117055) req@ffff880134b00380 x1830881263348096/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.913044:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881263348096 ext(2801664->3117055) 00010000:00010000:2.0:1746065143.913053:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 31 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.913066:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 31 pid: 9550 timeout: 839 lvb_type: 0 00002000:00010000:2.0:1746065143.913072:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b00380 00000100:00100000:2.0:1746065143.913104:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1243 00000100:00100000:2.0:1746065143.913111:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263348096:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065143.914635:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348224 00000100:00100000:3.0:1746065143.914642:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348224 00000100:00100000:3.0:1746065143.914678:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12762 00000100:00100000:3.0:1746065143.914684:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+18:32009:x1830881263348224:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065143.914697:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065143.914711:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d4e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.914733:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.914735:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065143.914738:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3399680->4194303] (req 3399680->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.914748:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3399680->4194303] (req 3399680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065143.914756:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c4800, rc 0) 00000100:00100000:3.0:1746065143.914816:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+19:32009:x1830881263348224:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 131us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065143.914822:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12762 00000100:00100000:0.0:1746065143.920364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.921476:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348352 00000100:00100000:1.0:1746065143.921483:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348352 00000100:00100000:1.0:1746065143.921528:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12763 00000100:00100000:1.0:1746065143.921535:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+35:32007:x1830881263348352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065143.921548:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065143.921561:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d55 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.921581:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065143.921586:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->4194303] (req 3399680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.921592:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065143.921595:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 36 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.921622:0:9548:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->4194303] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.921632:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 36 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.921640:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdae00, rc 0) 00000100:00100000:1.0:1746065143.921684:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+36:32007:x1830881263348352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 150us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.921689:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12763 00000100:00100000:3.0:1746065143.923034:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263348096:12345-192.168.202.27@tcp:4:cat.0 Request processed in 9918us (10789us total) trans 21474840837 rc 0/0 00000100:00100000:3.0:1746065143.923043:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1243 00002000:00100000:3.0:1746065143.923050:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2801664->3117055) req@ffff880134b00380 x1830881263348096/t21474840837(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.923059:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881263348096 ext(2801664->3117055) 00010000:00010000:3.0:1746065143.923066:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 34 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.923078:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 34 pid: 9550 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065143.923084:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b00380 00000100:00100000:0.0:1746065143.927150:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.927229:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348480 00000100:00100000:1.0:1746065143.927236:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348480 00010000:00010000:1.0:1746065143.927264:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 34 pid: 9550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.928084:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5694 00000100:00100000:1.0:1746065143.928094:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263348480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.928108:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065143.928122:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065143 -> 1746065144 00002000:00010000:1.0:1746065143.928125:0:7192:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065143 -> 1746065144 00002000:00010000:1.0:1746065143.928126:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065143 -> 1746065144 00010000:00010000:1.0:1746065143.928131:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 34 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.928142:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 34 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.928162:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc146e468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2801664->3117055) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d40 expref: 34 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.928184:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.928186:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.928192:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.928199:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.928207:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.928208:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.928210:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.928215:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.928241:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.928252:0:7192:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 18 pid: 9550 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746065143.928261:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263268480:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065143.928343:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065143.928354:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263268608:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065143.928372:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.935081:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.935727:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348736 00000100:00100000:3.0:1746065143.935736:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348736 00002000:00100000:3.0:1746065143.935802:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3399680->3403775) req@ffff880134b01880 x1830881263348736/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.935812:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01880 with x1830881263348736 ext(3399680->3403775) 00010000:00010000:3.0:1746065143.935821:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 19 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.935834:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 19 pid: 9550 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065143.935841:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01880 00000100:00100000:3.0:1746065143.935862:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1244 00000100:00100000:3.0:1746065143.935869:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263348736:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065143.935982:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263268480:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065143.935983:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263348736:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 113us (909us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065143.935989:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1244 00000100:00100000:1.0:1746065143.936001:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263268608:192.168.202.27@tcp:105: 00002000:00100000:3.0:1746065143.936004:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3399680->3403775) req@ffff880134b01880 x1830881263348736/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.936012:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01880 with x1830881263348736 ext(3399680->3403775) 00010000:00010000:3.0:1746065143.936016:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 19 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746065143.936018:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065143.936025:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 19 pid: 9550 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065143.936030:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01880 00000100:00100000:1.0:1746065143.936043:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263348480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7951us (8901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.936051:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5694 00000100:00100000:1.0:1746065143.939364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.939411:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.939607:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349120 00000100:00100000:0.0:1746065143.939614:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349120 00002000:00100000:0.0:1746065143.939648:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88008f3e4380 x1830881263349120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.939656:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4380 with x1830881263349120 ext(2097152->3145727) 00002000:00010000:0.0:1746065143.939660:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e4380 00000100:00100000:0.0:1746065143.939688:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3522 00000100:00100000:0.0:1746065143.939695:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263349120:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.939717:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349248 00000100:00100000:2.0:1746065143.939722:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349248 00002000:00100000:2.0:1746065143.939738:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88008f3e5500 x1830881263349248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.939746:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881263349248 ext(2097152->3145727) 00002000:00010000:2.0:1746065143.939749:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e5500 00000100:00100000:2.0:1746065143.939789:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3523 00000100:00100000:2.0:1746065143.939794:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263349248:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065143.952874:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.952925:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.952939:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349504 00000100:00100000:3.0:1746065143.952953:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349504 00002000:00100000:3.0:1746065143.953012:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3399680->4194303) req@ffff880134b02680 x1830881263349504/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.953027:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02680 with x1830881263349504 ext(3399680->4194303) 00010000:00010000:3.0:1746065143.953040:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 21 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.953058:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 21 pid: 9550 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065143.953075:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b02680 00000100:00100000:3.0:1746065143.953109:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1245 00000100:00100000:3.0:1746065143.953121:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263349504:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065143.953382:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349632 00000100:00100000:2.0:1746065143.953389:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349632 00000100:00100000:2.0:1746065143.953430:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12764 00000100:00100000:2.0:1746065143.953440:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+14:32009:x1830881263349632:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065143.953453:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.953472:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d5c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.953500:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 30 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.953509:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 15 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.953515:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.953516:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.953519:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.953542:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 15 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.953549:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 15 pid: 11461 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.953564:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263268736:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065143.954194:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 30 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065143.954203:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 30 pid: 11461 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.954210:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263268864:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.954240:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065143.954300:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263349120:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 14604us (14942us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065143.954307:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3522 00002000:00100000:0.0:1746065143.954314:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88008f3e4380 x1830881263349120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065143.954321:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4380 with x1830881263349120 ext(2097152->3145727) 00010000:00010000:0.0:1746065143.954326:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 14 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746065143.954334:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 14 pid: 11461 timeout: 839 lvb_type: 1 00002000:00010000:0.0:1746065143.954344:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e4380 00000100:00100000:1.0:1746065143.961966:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.961988:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349760 00000100:00100000:1.0:1746065143.962009:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349760 00010000:00010000:1.0:1746065143.962039:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 14 pid: 11461 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.962070:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5695 00000100:00100000:1.0:1746065143.962089:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263349760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.962103:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.962119:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 14 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.962128:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 14 pid: 11461 timeout: 839 lvb_type: 1 00000100:00100000:2.0:1746065143.962138:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263268736:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.962149:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263268864:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065143.962150:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4c00/0xad6b7ddc146e453 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d39 expref: 14 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.962165:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065143.962171:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.962181:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4800, rc 0) 00000100:00100000:1.0:1746065143.962195:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881263349760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.962202:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5695 00000100:00100000:2.0:1746065143.962203:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+13:32009:x1830881263349632:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8764us (9277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.962210:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12764 00000100:00100000:3.0:1746065143.962465:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263349248:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 22669us (23053us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.962472:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3523 00002000:00100000:3.0:1746065143.962479:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88008f3e5500 x1830881263349248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.962486:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881263349248 ext(2097152->3145727) 00002000:00010000:3.0:1746065143.962490:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e5500 00000100:00100000:0.0:1746065143.965688:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065143.965769:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349888 00000100:00100000:1.0:1746065143.965811:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349888 00010000:00010000:1.0:1746065143.965838:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 31 pid: 11461 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746065143.965868:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5696 00000100:00100000:1.0:1746065143.965875:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263349888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065143.965886:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065143.965900:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 31 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.965908:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 31 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.965926:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146e3ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cfa expref: 31 pid: 11461 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746065143.965937:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.965939:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065143.965945:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.965950:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065143.965974:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065143.965984:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263268992:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065143.966061:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065143.966603:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263349504:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13484us (13736us total) trans 21474840838 rc 0/0 00000100:00100000:3.0:1746065143.966612:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1245 00002000:00100000:3.0:1746065143.966620:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3399680->4194303) req@ffff880134b02680 x1830881263349504/t21474840838(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/448 e 0 to 0 dl 1746065154 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.966628:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02680 with x1830881263349504 ext(3399680->4194303) 00010000:00010000:3.0:1746065143.966634:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 21 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:3.0:1746065143.966644:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 21 pid: 9550 timeout: 839 lvb_type: 0 00002000:00010000:3.0:1746065143.966653:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b02680 00000100:00100000:2.0:1746065143.972324:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.972346:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350016 00000100:00100000:2.0:1746065143.972353:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350016 00010000:00010000:2.0:1746065143.972379:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 21 pid: 9550 timeout: 839 lvb_type: 0 00000100:00100000:2.0:1746065143.972410:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5697 00000100:00100000:2.0:1746065143.972417:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263350016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065143.972427:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065143.972444:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 21 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.972455:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 21 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.972473:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4800/0xad6b7ddc146e476 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d4e expref: 21 pid: 9550 timeout: 839 lvb_type: 0 00010000:00010000:2.0:1746065143.972490:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.972492:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065143.972497:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.972504:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.972530:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065143.972541:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263269120:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065143.972600:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065143.972634:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.972705:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350272 00000100:00100000:2.0:1746065143.972709:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350272 00002000:00100000:2.0:1746065143.972730:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3334144->3338239) req@ffff880097242680 x1830881263350272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.972738:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097242680 with x1830881263350272 ext(3334144->3338239) 00002000:00010000:2.0:1746065143.972742:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097242680 00000100:00100000:2.0:1746065143.972753:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3524 00000100:00100000:2.0:1746065143.972758:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263350272:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.972873:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263350272:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 113us (237us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065143.972879:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3524 00002000:00100000:2.0:1746065143.972883:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3334144->3338239) req@ffff880097242680 x1830881263350272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.972891:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097242680 with x1830881263350272 ext(3334144->3338239) 00002000:00010000:2.0:1746065143.972894:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097242680 00000100:00100000:1.0:1746065143.973027:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263268992:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065143.973041:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065143.973068:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263349888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7193us (7387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065143.973074:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5696 00000100:00100000:2.0:1746065143.976546:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263269120:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065143.976566:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065143.976602:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263350016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4185us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065143.976612:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5697 00000100:00100000:0.0:1746065143.979365:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065143.979409:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.979982:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350656 00000100:00100000:2.0:1746065143.980001:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350656 00002000:00100000:2.0:1746065143.980041:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880134b02300 x1830881263350656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.980055:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02300 with x1830881263350656 ext(3145728->4194303) 00002000:00010000:2.0:1746065143.980060:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b02300 00000100:00100000:2.0:1746065143.980071:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350784 00000100:00100000:2.0:1746065143.980074:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350784 00002000:00100000:2.0:1746065143.980092:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880134b00700 x1830881263350784/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/0 e 0 to 0 dl 1746065154 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.980098:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00700 with x1830881263350784 ext(2097152->3145727) 00002000:00010000:2.0:1746065143.980101:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00700 00000100:00100000:2.0:1746065143.980118:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3525 00000100:00100000:2.0:1746065143.980125:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263350656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065143.980183:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3526 00000100:00100000:3.0:1746065143.980190:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263350784:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065143.983402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065143.983486:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351040 00000100:00100000:3.0:1746065143.983494:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351040 00000100:00100000:3.0:1746065143.984636:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4864 00000100:00100000:3.0:1746065143.984646:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32009:x1830881263351040:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065143.985217:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+10:32009:x1830881263351040:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 571us (1820us total) trans 8589935855 rc 0/0 00000100:00100000:3.0:1746065143.985223:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4864 00000100:00100000:2.0:1746065143.993524:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263350656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13389us (14155us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065143.993535:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3525 00002000:00100000:2.0:1746065143.993545:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880134b02300 x1830881263350656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065143.993553:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02300 with x1830881263350656 ext(3145728->4194303) 00002000:00010000:2.0:1746065143.993558:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b02300 00000100:00100000:3.0:1746065143.997618:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263350784:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17420us (18200us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065143.997628:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3526 00002000:00100000:3.0:1746065143.997638:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880134b00700 x1830881263350784/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:59/0 lens 488/440 e 0 to 0 dl 1746065154 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065143.997646:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00700 with x1830881263350784 ext(2097152->3145727) 00002000:00010000:3.0:1746065143.997650:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00700 00000100:00100000:0.0:1746065143.998045:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065143.998095:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351168 00000100:00100000:2.0:1746065143.998102:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351168 00000100:00100000:2.0:1746065143.998140:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12765 00000100:00100000:2.0:1746065143.998146:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:32007:x1830881263351168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065143.998161:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065143.998175:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d63 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998198:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998205:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.998206:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065143.998209:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998233:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065143.998243:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 11 pid: 9550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065143.998253:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263269248:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065143.998308:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.002486:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.002553:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351296 00000100:00100000:3.0:1746065144.002561:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351296 00002000:00100000:3.0:1746065144.002598:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3338239) req@ffff880135221f80 x1830881263351296/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.002605:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221f80 with x1830881263351296 ext(3145728->3338239) 00010000:00010000:3.0:1746065144.002613:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 12 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.002624:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 12 pid: 9550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065144.002630:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135221f80 00000100:00100000:3.0:1746065144.002660:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1246 00000100:00100000:3.0:1746065144.002665:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263351296:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065144.003211:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263269248:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.003233:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.003248:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090176600, rc 0) 00000100:00100000:2.0:1746065144.003457:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:32007:x1830881263351168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5308us (5410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.003464:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12765 00000100:00100000:0.0:1746065144.003532:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.003731:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351424 00000100:00100000:3.0:1746065144.003734:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351424 00000100:00100000:3.0:1746065144.003764:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12766 00000100:00100000:3.0:1746065144.003769:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+20:32014:x1830881263351424:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.003795:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.003809:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d6a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.003823:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.003824:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.003831:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.003842:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.003849:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358600, rc 0) 00000100:00100000:3.0:1746065144.003879:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+21:32014:x1830881263351424:12345-192.168.202.27@tcp:101:cat.0 Request processed in 110us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.003891:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12766 00000100:00100000:3.0:1746065144.006981:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263351296:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 4307us (4494us total) trans 17179873396 rc 0/0 00000100:00100000:3.0:1746065144.006999:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1246 00002000:00100000:3.0:1746065144.007009:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3338239) req@ffff880135221f80 x1830881263351296/t17179873396(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.007017:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221f80 with x1830881263351296 ext(3145728->3338239) 00010000:00010000:3.0:1746065144.007025:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 14 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.007037:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 14 pid: 9550 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065144.007043:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135221f80 00000100:00100000:0.0:1746065144.007825:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.007887:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351680 00000100:00100000:3.0:1746065144.007892:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351680 00002000:00100000:3.0:1746065144.007918:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880135220380 x1830881263351680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.007925:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220380 with x1830881263351680 ext(3145728->4194303) 00002000:00010000:3.0:1746065144.007928:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135220380 00000100:00100000:3.0:1746065144.008057:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3527 00000100:00100000:3.0:1746065144.008065:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263351680:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065144.017564:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.018403:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351808 00000100:00100000:2.0:1746065144.018412:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351808 00010000:00010000:2.0:1746065144.018442:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 14 pid: 9550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.018476:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5698 00000100:00100000:2.0:1746065144.018483:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263351808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.018494:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065144.018508:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065143 -> 1746065144 00002000:00010000:2.0:1746065144.018511:0:8352:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065143 -> 1746065144 00010000:00010000:2.0:1746065144.018516:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 14 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.018527:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 14 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.018547:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4800/0xad6b7ddc146e484 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d5c expref: 14 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.018571:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.018573:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.018580:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.018587:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.018616:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.018628:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263269376:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065144.019684:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.019798:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263351680:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11709us (11950us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.019806:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3527 00002000:00100000:2.0:1746065144.019813:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880135220380 x1830881263351680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.019822:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220380 with x1830881263351680 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.019825:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135220380 00000100:00100000:2.0:1746065144.022984:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263269376:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065144.023013:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.023061:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263351808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4577us (5503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.023069:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5698 00000100:00100000:0.0:1746065144.024805:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.024927:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351936 00000100:00100000:2.0:1746065144.024933:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351936 00000100:00100000:2.0:1746065144.024978:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12767 00000100:00100000:2.0:1746065144.024985:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+13:32014:x1830881263351936:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.025008:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.025021:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d71 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.025041:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.025043:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.025049:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 14 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.025060:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 14 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.025068:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:2.0:1746065144.025107:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+14:32014:x1830881263351936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 123us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.025112:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12767 00000100:00100000:0.0:1746065144.026649:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.026721:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352192 00000100:00100000:2.0:1746065144.026726:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352192 00002000:00100000:2.0:1746065144.026754:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880135221500 x1830881263352192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.028594:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221500 with x1830881263352192 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.028599:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221500 00000100:00100000:2.0:1746065144.028632:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3528 00000100:00100000:2.0:1746065144.028642:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263352192:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065144.029742:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.034656:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352448 00000100:00100000:2.0:1746065144.034667:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352448 00002000:00100000:2.0:1746065144.034705:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88008f3e7800 x1830881263352448/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.034714:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881263352448 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.034719:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e7800 00000100:00100000:2.0:1746065144.034751:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3529 00000100:00100000:2.0:1746065144.034758:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263352448:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065144.042076:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.042119:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352704 00000100:00100000:0.0:1746065144.042126:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352704 00000100:00100000:0.0:1746065144.042164:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13544 00000100:00100000:0.0:1746065144.042171:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+28:32018:x1830881263352704:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065144.042192:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.042209:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146e4a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d78 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.042272:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042282:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042292:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042319:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042325:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042330:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042409:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042418:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042424:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065144.042432:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065144.042596:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042603:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042608:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042613:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042617:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065144.042621:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042630:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042639:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065144.042642:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065144.042645:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042650:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e4a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042678:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042682:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042686:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042690:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065144.042692:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042696:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042702:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097b72000) 00010000:00010000:0.0:1746065144.042704:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065144.042706:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042710:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146e4ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065144.042740:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146e4a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 31 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.042751:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.042756:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065144.042758:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065144.042761:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06600, rc 0) 00000100:00100000:0.0:1746065144.042827:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+30:32018:x1830881263352704:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 656us (758us total) trans 8589935856 rc 0/0 00000100:00100000:0.0:1746065144.042834:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13544 00000100:00100000:3.0:1746065144.043650:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263352192:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15009us (17004us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065144.043662:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3528 00002000:00100000:3.0:1746065144.043669:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880135221500 x1830881263352192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.043677:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221500 with x1830881263352192 ext(3145728->4194303) 00002000:00010000:3.0:1746065144.043681:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221500 00000100:00100000:2.0:1746065144.044850:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263352448:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10088us (15106us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.044857:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3529 00002000:00100000:2.0:1746065144.044863:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88008f3e7800 x1830881263352448/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.044870:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881263352448 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.044873:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e7800 00000100:00100000:2.0:1746065144.049889:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.052062:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352960 00000100:00100000:3.0:1746065144.052072:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352960 00002000:00100000:3.0:1746065144.052115:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097243800 x1830881263352960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.052124:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243800 with x1830881263352960 ext(4194304->5021695) 00002000:00010000:3.0:1746065144.052128:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097243800 00000100:00100000:3.0:1746065144.052164:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3530 00000100:00100000:3.0:1746065144.052171:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263352960:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065144.062166:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263352960:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9983us (12271us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065144.062179:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3530 00002000:00100000:3.0:1746065144.062192:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097243800 x1830881263352960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.062200:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243800 with x1830881263352960 ext(4194304->5021695) 00002000:00010000:3.0:1746065144.062207:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097243800 00000100:00100000:0.0:1746065144.064333:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.064493:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353216 00000100:00100000:3.0:1746065144.064500:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353216 00002000:00100000:3.0:1746065144.064533:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88013513ad80 x1830881263353216/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.064546:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513ad80 with x1830881263353216 ext(4194304->5021695) 00002000:00010000:3.0:1746065144.064551:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513ad80 00000100:00100000:3.0:1746065144.064601:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3531 00000100:00100000:3.0:1746065144.064608:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263353216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065144.072475:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.072663:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353472 00000100:00100000:3.0:1746065144.072673:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353472 00000100:00100000:3.0:1746065144.072722:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4865 00000100:00100000:3.0:1746065144.072731:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32007:x1830881263353472:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065144.073062:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263353216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8453us (8735us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065144.073070:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3531 00002000:00100000:2.0:1746065144.073076:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88013513ad80 x1830881263353216/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.073083:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513ad80 with x1830881263353216 ext(4194304->5021695) 00002000:00010000:2.0:1746065144.073089:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513ad80 00000100:00100000:3.0:1746065144.073134:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:32007:x1830881263353472:12345-192.168.202.27@tcp:35:cat.0 Request processed in 404us (669us total) trans 8589935857 rc 0/0 00000100:00100000:3.0:1746065144.073140:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4865 00000100:00100000:0.0:1746065144.077917:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.078001:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353728 00000100:00100000:2.0:1746065144.078009:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353728 00000100:00100000:2.0:1746065144.078050:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4866 00000100:00100000:2.0:1746065144.078057:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+10:32014:x1830881263353728:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065144.078226:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+11:32014:x1830881263353728:12345-192.168.202.27@tcp:35:cat.0 Request processed in 169us (314us total) trans 8589935858 rc 0/0 00000100:00100000:2.0:1746065144.078231:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4866 00000100:00100000:0.0:1746065144.107910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.107988:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353856 00000100:00100000:2.0:1746065144.108005:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353856 00000100:00100000:2.0:1746065144.108121:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13545 00000100:00100000:2.0:1746065144.108127:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:32021:x1830881263353856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065144.108149:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.108164:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e4c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d7f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.108215:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108226:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108234:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108245:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108249:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108254:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108313:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108321:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108326:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065144.108359:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065144.108363:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065144.108375:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108382:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108389:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108393:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108397:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108402:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108407:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.108410:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108415:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108423:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065144.108425:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.108429:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.108434:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e4ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.116944:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.116957:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.116963:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.116967:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.116970:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.116976:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.117018:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e3d9300) 00010000:00010000:2.0:1746065144.117020:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.117023:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.117028:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e4d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.117076:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e4c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.117087:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.117093:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.117096:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065144.117098:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718200, rc 0) 00000100:00100000:2.0:1746065144.117168:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32021:x1830881263353856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9039us (9262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.117176:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13545 00000100:00100000:2.0:1746065144.120052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.120087:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.120096:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353984 00000100:00100000:2.0:1746065144.120100:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.120103:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353984 00000100:00100000:2.0:1746065144.120112:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.120122:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.120156:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.120220:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354240 00000100:00100000:3.0:1746065144.120223:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354240 00000100:00100000:2.0:1746065144.120231:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354496 00000100:00100000:2.0:1746065144.120233:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354496 00000100:00100000:3.0:1746065144.120238:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354112 00000100:00100000:3.0:1746065144.120240:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354112 00000100:00100000:2.0:1746065144.120246:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354368 00000100:00100000:2.0:1746065144.120247:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354368 00000100:00100000:3.0:1746065144.120248:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354624 00000100:00100000:3.0:1746065144.120250:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354624 00000100:00100000:3.0:1746065144.120258:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12768 00000100:00100000:3.0:1746065144.120264:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263353984:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065144.120264:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12769 00000100:00100000:2.0:1746065144.120268:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263354240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065144.120276:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.120276:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.120290:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d86 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.120290:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d94 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.120306:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.120306:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.120308:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.120309:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.120315:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.120315:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.120326:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.120326:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.120334:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46e00, rc 0) 00010000:00010000:2.0:1746065144.120336:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8600, rc 0) 00000100:00100000:2.0:1746065144.120368:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263354240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.120373:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12769 00000100:00100000:2.0:1746065144.120387:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12770 00000100:00100000:2.0:1746065144.120395:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263354496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065144.120401:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.120410:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932da2 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.120419:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.120421:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.120425:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.120433:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.120440:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52b0400, rc 0) 00000100:00100000:3.0:1746065144.120468:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263353984:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 203us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.120469:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12771 00000100:00100000:3.0:1746065144.120473:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12768 00000100:00100000:1.0:1746065144.120475:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263354112:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065144.120480:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12772 00010000:00010000:1.0:1746065144.120481:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065144.120484:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263354368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065144.120487:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d8d expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.120488:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.120493:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932d9b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.120496:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.120497:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.120501:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.120501:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.120502:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.120505:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 13 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.120509:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.120512:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 13 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.120515:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ae00, rc 0) 00010000:00010000:3.0:1746065144.120518:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47600, rc 0) 00000100:00100000:1.0:1746065144.120529:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263354112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 55us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.120534:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12771 00000100:00100000:3.0:1746065144.120535:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263354368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 50us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.120541:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12772 00000100:00100000:1.0:1746065144.120544:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12773 00000100:00100000:1.0:1746065144.120548:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263354624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065144.120553:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.120558:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932da9 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.120567:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.120568:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.120572:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.120579:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.120584:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a800, rc 0) 00000100:00100000:1.0:1746065144.120598:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263354624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.120605:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12773 00000100:00100000:2.0:1746065144.120654:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263354496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 261us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.120659:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12770 00000100:00100000:0.0:1746065144.123285:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.123360:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354880 00000100:00100000:2.0:1746065144.123367:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354880 00000100:00100000:2.0:1746065144.123413:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13546 00000100:00100000:2.0:1746065144.123421:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32021:x1830881263354880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065144.123435:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.123448:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e509 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932db0 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.123529:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.123541:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.123548:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.123553:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.123559:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.123584:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.123592:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 8 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.123602:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263269504:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.123683:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.123694:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 30 pid: 9571 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.123701:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263269632:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.123723:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.123730:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 10 pid: 9571 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.123737:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263269760:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.123751:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.127882:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.127927:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.128025:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263269504:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.128036:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263269632:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.128042:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263269760:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.128066:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065144.128131:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355008 00000100:00100000:1.0:1746065144.128137:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355008 00010000:00010000:1.0:1746065144.128164:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 31 pid: 9571 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.128182:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355136 00000100:00100000:1.0:1746065144.128183:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355136 00010000:00010000:1.0:1746065144.128191:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 11 pid: 9571 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.128204:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5699 00000100:00100000:1.0:1746065144.128210:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263355008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.128221:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.128226:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 31 pid: 9571 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.128233:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 31 pid: 9571 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.128251:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e4b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d78 expref: 31 pid: 9571 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.128269:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065144.128274:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065144.128284:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065144.128289:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.128319:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263355008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.128325:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5699 00000100:00100000:1.0:1746065144.128340:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5700 00000100:00100000:1.0:1746065144.128349:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263355136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.128356:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.128360:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 11 pid: 9571 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.128366:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 11 pid: 9571 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.128376:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146e429 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d08 expref: 11 pid: 9571 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.128383:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065144.128386:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065144.128390:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065144.128394:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.128407:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263355136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.128411:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5700 00000100:00100000:3.0:1746065144.128664:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.128734:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355264 00000100:00100000:2.0:1746065144.128737:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355264 00010000:00010000:2.0:1746065144.128750:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.128790:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5701 00000100:00100000:2.0:1746065144.128795:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263355264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.128804:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.128807:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.128814:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.128824:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e4d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d7f expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.128834:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.128837:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.128842:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.128847:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.128858:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.128873:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263355264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.128877:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5701 00010000:00010000:2.0:1746065144.128888:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.128892:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065144.128904:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065144.129007:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e509 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.129017:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.129023:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.129025:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065144.129027:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718600, rc 0) 00000100:00100000:2.0:1746065144.129046:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32021:x1830881263354880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5627us (5768us total) trans 8589935859 rc 0/0 00000100:00100000:2.0:1746065144.129051:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13546 00000100:00100000:0.0:1746065144.134646:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.136419:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355392 00000100:00100000:2.0:1746065144.136428:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355392 00000100:00100000:2.0:1746065144.136466:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13547 00000100:00100000:2.0:1746065144.136473:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32021:x1830881263355392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065144.136491:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.136507:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8400/0xad6b7ddc146e51e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932db7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.136574:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.136585:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.136592:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.136616:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.136626:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.136636:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263269888:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.136710:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.138438:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263269888:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.138460:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065144.140483:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.140748:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355520 00000100:00100000:1.0:1746065144.140758:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355520 00010000:00010000:1.0:1746065144.140829:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 10 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.140875:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5702 00000100:00100000:1.0:1746065144.140884:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263355520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.140897:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.140903:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 10 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.140913:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 10 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.140932:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc146e510 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db0 expref: 10 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.140966:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065144.140971:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065144.140980:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065144.140986:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065144.141020:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.141063:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263355520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 179us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.141069:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5702 00010000:00010000:3.0:1746065144.141533:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065144.141540:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065144.141584:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065144.141589:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065144.141606:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065144.141636:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d8400/0xad6b7ddc146e51e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.142555:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.142562:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065144.142564:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065144.142566:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718400, rc 0) 00000100:00100000:3.0:1746065144.142943:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32021:x1830881263355392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6469us (8302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.142949:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13547 00000100:00100000:0.0:1746065144.147693:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.149097:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355776 00000100:00100000:2.0:1746065144.149106:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355776 00000100:00100000:2.0:1746065144.149158:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13548 00000100:00100000:2.0:1746065144.149165:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32021:x1830881263355776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065144.149182:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.149197:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e52c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932dbe expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.149545:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149556:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149565:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149575:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149583:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149588:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149592:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c719800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.149595:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149600:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149608:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.149610:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065144.149614:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.149618:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc146e533 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.151022:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e52c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dbe expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.151031:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc146e52c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dbe expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.151039:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718200, rc 0) 00000100:00100000:2.0:1746065144.151099:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32021:x1830881263355776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1933us (3413us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065144.151106:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13548 00000100:00100000:0.0:1746065144.154182:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.154260:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356032 00000100:00100000:2.0:1746065144.154268:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356032 00000100:00100000:2.0:1746065144.154312:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4867 00000100:00100000:2.0:1746065144.154318:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32021:x1830881263356032:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065144.154458:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32021:x1830881263356032:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 139us (282us total) trans 8589935860 rc 0/0 00000100:00100000:2.0:1746065144.154464:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4867 00000100:00100000:0.0:1746065144.162080:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.162657:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356160 00000100:00100000:2.0:1746065144.162666:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356160 00000100:00100000:2.0:1746065144.162715:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12774 00000100:00100000:2.0:1746065144.162723:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+31:32018:x1830881263356160:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065144.162738:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.162753:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932dc5 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.162807:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.162815:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.162822:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.162827:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.162829:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.162831:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2990080->3145727] (req 2990080->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.162857:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.162868:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 13 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.162879:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263270016:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.162975:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.162982:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 8 pid: 12258 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746065144.162998:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263270144:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.163025:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.163032:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 32 pid: 9550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.163040:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263270272:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.163055:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.171181:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.171251:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.171519:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.171721:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356416 00000100:00100000:3.0:1746065144.171730:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356416 00010000:00010000:3.0:1746065144.171760:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 14 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.171811:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356288 00000100:00100000:3.0:1746065144.171814:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356288 00010000:00010000:3.0:1746065144.171823:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 9 pid: 12258 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746065144.171834:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356544 00000100:00100000:3.0:1746065144.171836:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356544 00010000:00010000:3.0:1746065144.171844:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 33 pid: 9550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.171857:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5703 00000100:00100000:3.0:1746065144.171862:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263356416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.171874:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.171895:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 14 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.171904:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 14 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.171924:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065144.171931:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718a00/0xad6b7ddc146e499 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d71 expref: 14 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.171950:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263270016:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.171952:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881263356416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.171958:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5703 00000100:00100000:2.0:1746065144.171959:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263270144:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.171964:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263270272:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.171969:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5704 00000100:00100000:3.0:1746065144.171973:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263356288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.171981:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.171985:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2990080->3145727] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.171987:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 9 pid: 12258 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746065144.172004:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 9 pid: 12258 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746065144.172017:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718200, rc 0) 00000100:00100000:2.0:1746065144.172035:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32018:x1830881263356160:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9314us (9964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.172041:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12774 00000100:00100000:2.0:1746065144.172078:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5705 00000100:00100000:2.0:1746065144.172084:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263356544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.172089:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.172097:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 32 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.172104:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 32 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.172116:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090176600/0xad6b7ddc146e48b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d63 expref: 32 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.172124:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.172136:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263356544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.172141:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5705 00010000:00010000:3.0:1746065144.172198:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a800/0xad6b7ddc146e502 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da9 expref: 9 pid: 12258 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746065144.172218:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.172220:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.172225:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.172232:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.172255:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.172265:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263270400:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065144.172304:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.173645:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263270400:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065144.173655:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.173691:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263356288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1716us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.173699:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5704 00000100:00100000:0.0:1746065144.173826:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.174029:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356800 00000100:00100000:2.0:1746065144.174034:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356800 00002000:00100000:2.0:1746065144.174059:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2990080->2994175) req@ffff88009a6ddc00 x1830881263356800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.174067:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddc00 with x1830881263356800 ext(2990080->2994175) 00002000:00010000:2.0:1746065144.174070:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddc00 00000100:00100000:2.0:1746065144.174082:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3532 00000100:00100000:2.0:1746065144.174086:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263356800:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065144.174178:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263356800:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 91us (351us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065144.174184:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3532 00002000:00100000:2.0:1746065144.174188:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2990080->2994175) req@ffff88009a6ddc00 x1830881263356800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.174194:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddc00 with x1830881263356800 ext(2990080->2994175) 00002000:00010000:2.0:1746065144.174196:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddc00 00000100:00100000:0.0:1746065144.177961:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.178132:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356928 00000100:00100000:2.0:1746065144.178140:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356928 00000100:00100000:2.0:1746065144.178178:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12775 00000100:00100000:2.0:1746065144.178184:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32018:x1830881263356928:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065144.178199:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.178215:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932dcc expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.178244:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.178251:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.178258:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.178263:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.178265:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.178268:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->3792895] (req 3145728->3792895) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.178290:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.178301:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 20 pid: 9550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.178311:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263270528:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.178394:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.178402:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 11 pid: 10219 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746065144.178415:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263270656:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.178439:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.178476:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.178484:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263270784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.178502:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.183492:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263270528:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.183503:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263270656:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.183511:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263270784:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.183537:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->3792895] (req 3145728->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.183551:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae22600, rc 0) 00000100:00100000:2.0:1746065144.183595:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+34:32018:x1830881263356928:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5410us (5640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.183602:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12775 00000100:00100000:0.0:1746065144.183852:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.183979:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357056 00000100:00100000:3.0:1746065144.183985:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357056 00010000:00010000:3.0:1746065144.184015:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 12 pid: 10219 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746065144.184043:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5706 00000100:00100000:3.0:1746065144.184052:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263357056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.184063:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.184078:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 12 pid: 10219 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746065144.184086:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 12 pid: 10219 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746065144.184105:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e4ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932da2 expref: 12 pid: 10219 timeout: 840 lvb_type: 1 00010000:00010000:3.0:1746065144.184118:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.184148:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263357056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.184153:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5706 00000100:00100000:2.0:1746065144.184559:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.185179:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357184 00000100:00100000:0.0:1746065144.185184:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357184 00010000:00010000:0.0:1746065144.185201:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065144.185339:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5707 00000100:00100000:0.0:1746065144.185346:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263357184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065144.185353:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065144.185364:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.185374:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.185387:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc146e47d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d55 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.185408:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065144.185430:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263357184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.185435:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5707 00000100:00100000:0.0:1746065144.186122:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.186158:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357312 00000100:00100000:2.0:1746065144.186162:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357312 00010000:00010000:2.0:1746065144.186175:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.186198:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5708 00000100:00100000:2.0:1746065144.186203:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263357312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.186211:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.186223:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.186231:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.186244:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146e492 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d6a expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.186266:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.186268:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.186274:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.186308:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.186333:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.186343:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263270912:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065144.186396:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.187815:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263270912:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065144.187827:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.187852:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263357312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1648us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.187858:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5708 00000100:00100000:0.0:1746065144.193422:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.193744:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357568 00000100:00100000:2.0:1746065144.193752:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357568 00000100:00100000:2.0:1746065144.193934:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13549 00000100:00100000:2.0:1746065144.193942:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:32025:x1830881263357568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.193964:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.193979:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc146e548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932dd3 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.194049:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194061:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194070:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194080:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194086:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194091:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194164:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194172:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194177:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065144.194184:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065144.194235:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194240:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194246:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065144.194247:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065144.194250:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194255:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a5cea00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.194258:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194263:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065144.194264:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357824 00000100:00100000:0.0:1746065144.194267:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357824 00010000:00010000:2.0:1746065144.194272:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065144.194274:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.194277:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.194282:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc146e54f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00002000:00100000:0.0:1746065144.194290:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3788800->3792895) req@ffff88009a6ddf80 x1830881263357824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065144.194299:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddf80 with x1830881263357824 ext(3788800->3792895) 00002000:00010000:0.0:1746065144.194303:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6ddf80 00000100:00100000:0.0:1746065144.194315:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3533 00000100:00100000:0.0:1746065144.194320:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263357824:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065144.194616:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263357824:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 294us (368us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065144.194622:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3533 00002000:00100000:0.0:1746065144.194628:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3788800->3792895) req@ffff88009a6ddf80 x1830881263357824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065144.194634:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddf80 with x1830881263357824 ext(3788800->3792895) 00002000:00010000:0.0:1746065144.194637:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6ddf80 00010000:00010000:2.0:1746065144.195093:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.195100:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.195105:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.195109:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b52b0400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.195112:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.195116:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.195123:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e3d9b00) 00010000:00010000:2.0:1746065144.195126:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.195128:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.195133:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc146e556 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.195164:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc146e548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.195173:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.195178:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.195181:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065144.195183:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae23c00, rc 0) 00000100:00100000:2.0:1746065144.195208:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+32:32025:x1830881263357568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1268us (1795us total) trans 8589935861 rc 0/0 00000100:00100000:2.0:1746065144.195214:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13549 00000100:00100000:0.0:1746065144.197577:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.198868:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358080 00000100:00100000:3.0:1746065144.198879:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358080 00000100:00100000:3.0:1746065144.198923:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4868 00000100:00100000:3.0:1746065144.198929:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+32:32018:x1830881263358080:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065144.199117:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+33:32018:x1830881263358080:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 189us (1547us total) trans 8589935862 rc 0/0 00000100:00100000:3.0:1746065144.199122:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4868 00000100:00100000:0.0:1746065144.199582:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.199724:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358208 00000100:00100000:2.0:1746065144.199729:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358208 00000100:00100000:2.0:1746065144.199752:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12776 00000100:00100000:2.0:1746065144.199757:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263358208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.199767:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.199798:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718600/0xad6b7ddc146e56b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932dda expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.199837:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263271040:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065144.201055:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.202158:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263271040:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065144.202187:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c718600/0xad6b7ddc146e56b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dda expref: 34 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.202198:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718600/0xad6b7ddc146e56b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dda expref: 34 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.202206:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718600, rc 0) 00000100:00100000:2.0:1746065144.202245:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263358208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2487us (2663us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065144.202252:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12776 00000100:00100000:0.0:1746065144.208497:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.208541:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358464 00000100:00100000:3.0:1746065144.208550:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358464 00002000:00100000:3.0:1746065144.208584:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009a6dd880 x1830881263358464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.208590:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dd880 with x1830881263358464 ext(0->1048575) 00002000:00010000:3.0:1746065144.208594:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dd880 00000100:00100000:3.0:1746065144.208615:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3534 00000100:00100000:3.0:1746065144.208622:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263358464:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065144.214324:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263358464:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5692us (5826us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065144.214335:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3534 00002000:00100000:3.0:1746065144.214344:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009a6dd880 x1830881263358464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.214352:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dd880 with x1830881263358464 ext(0->1048575) 00002000:00010000:3.0:1746065144.214357:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dd880 00000100:00100000:0.0:1746065144.223062:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.223251:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358720 00000100:00100000:2.0:1746065144.223260:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358720 00000100:00100000:2.0:1746065144.223309:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13550 00000100:00100000:2.0:1746065144.223316:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+10:32028:x1830881263358720:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065144.223337:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.223351:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc146e572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932de1 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.223411:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223422:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223431:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223442:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223448:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223453:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223526:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223534:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223539:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065144.223550:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065144.223606:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223612:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223616:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223621:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223627:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552f600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.223629:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223634:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223643:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065144.223645:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.223648:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223652:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc146e579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223680:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223684:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223691:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223695:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552f400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.223697:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223700:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223706:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e3d9300) 00010000:00010000:2.0:1746065144.223708:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.223710:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223714:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f400/0xad6b7ddc146e580 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.223744:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc146e572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.223753:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.223759:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.223761:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065144.223762:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552ee00, rc 0) 00000100:00100000:2.0:1746065144.223827:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+12:32028:x1830881263358720:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 510us (772us total) trans 8589935863 rc 0/0 00000100:00100000:2.0:1746065144.223832:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13550 00000100:00100000:0.0:1746065144.227223:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.227403:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358848 00000100:00100000:2.0:1746065144.227411:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358848 00000100:00100000:2.0:1746065144.231111:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12777 00000100:00100000:2.0:1746065144.231125:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32025:x1830881263358848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.231142:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.231157:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932de8 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.231179:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.231180:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.231187:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.231198:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.231206:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e800, rc 0) 00000100:00100000:2.0:1746065144.231265:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+34:32025:x1830881263358848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 145us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.231271:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12777 00000100:00100000:0.0:1746065144.243583:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.243659:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.245410:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263359104 00000100:00100000:1.0:1746065144.245422:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263359104 00002000:00100000:1.0:1746065144.245469:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88008f7fdc00 x1830881263359104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 504/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.245479:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdc00 with x1830881263359104 ext(2097152->4194303) 00002000:00010000:1.0:1746065144.245493:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fdc00 00000100:00100000:1.0:1746065144.245535:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263359360 00000100:00100000:1.0:1746065144.245540:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263359360 00002000:00100000:1.0:1746065144.245558:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008f7fe300 x1830881263359360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 504/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.245564:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe300 with x1830881263359360 ext(2097152->4194303) 00002000:00010000:1.0:1746065144.245568:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fe300 00000100:00100000:1.0:1746065144.245603:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3535 00000100:00100000:1.0:1746065144.245613:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263359104:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065144.246758:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3536 00000100:00100000:2.0:1746065144.246766:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263359360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065144.264035:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263359104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18417us (20454us total) trans 0 rc 1449984/1449984 00000100:00100000:1.0:1746065144.264045:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3535 00002000:00100000:1.0:1746065144.264053:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88008f7fdc00 x1830881263359104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 504/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1449984/1449984 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.264062:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdc00 with x1830881263359104 ext(2097152->4194303) 00002000:00010000:1.0:1746065144.264073:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fdc00 00000100:00100000:2.0:1746065144.280142:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263359360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33368us (36476us total) trans 0 rc 1941504/1941504 00000100:00100000:2.0:1746065144.280152:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3536 00002000:00100000:2.0:1746065144.280162:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008f7fe300 x1830881263359360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 504/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1941504/1941504 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.280175:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe300 with x1830881263359360 ext(2097152->4194303) 00002000:00010000:2.0:1746065144.280181:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fe300 00000100:00100000:0.0:1746065144.294258:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.294980:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263359488 00000100:00100000:1.0:1746065144.294995:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263359488 00000100:00100000:1.0:1746065144.295042:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12778 00000100:00100000:1.0:1746065144.295048:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263359488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065144.295065:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.295080:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146e59c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932def expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065144.295122:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263271168:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065144.295198:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065144.298401:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263271168:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065144.298426:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146e59c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932def expref: 35 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.298438:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc146e59c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932def expref: 35 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.299331:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a600, rc 0) 00000100:00100000:1.0:1746065144.299370:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263359488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4320us (5122us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065144.299376:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12778 00000100:00100000:0.0:1746065144.304418:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.304971:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263359744 00000100:00100000:2.0:1746065144.304979:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263359744 00002000:00100000:2.0:1746065144.305026:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008f7fd180 x1830881263359744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.305035:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd180 with x1830881263359744 ext(4194304->5021695) 00002000:00010000:2.0:1746065144.305039:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd180 00000100:00100000:2.0:1746065144.305062:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3537 00000100:00100000:2.0:1746065144.305069:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263359744:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065144.306748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.314842:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360000 00000100:00100000:3.0:1746065144.314854:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360000 00000100:00100000:3.0:1746065144.314902:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13551 00000100:00100000:3.0:1746065144.314909:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+12:32031:x1830881263360000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.314930:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.314945:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2800/0xad6b7ddc146e5a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932df6 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.315036:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.315048:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.315056:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065144.315064:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065144.315145:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2800/0xad6b7ddc146e5a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.315163:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 14 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.315170:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065144.315173:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065144.315175:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3a00, rc 0) 00000100:00100000:3.0:1746065144.315233:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+14:32031:x1830881263360000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 324us (8489us total) trans 8589935864 rc 0/0 00000100:00100000:3.0:1746065144.315238:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13551 00000100:00100000:0.0:1746065144.318601:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.318747:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263359744:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13677us (14334us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065144.318757:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3537 00002000:00100000:2.0:1746065144.318765:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008f7fd180 x1830881263359744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.318790:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd180 with x1830881263359744 ext(4194304->5021695) 00002000:00010000:2.0:1746065144.318795:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd180 00000100:00100000:1.0:1746065144.319011:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360128 00000100:00100000:1.0:1746065144.319018:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360128 00000100:00100000:1.0:1746065144.319146:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12779 00000100:00100000:1.0:1746065144.319152:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263360128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065144.319165:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.319177:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc146e5b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932dfd expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065144.319216:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263271296:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065144.322496:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.325762:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.325762:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.326092:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360256 00000100:00100000:3.0:1746065144.326101:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360256 00000100:00100000:2.0:1746065144.326159:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360512 00000100:00100000:2.0:1746065144.326163:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360512 00000100:00100000:2.0:1746065144.326201:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13552 00000100:00100000:2.0:1746065144.326207:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+33:32033:x1830881263360512:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065144.326227:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.326239:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146e5bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e0b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.326318:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.326329:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.326336:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.326341:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.326347:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.326375:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.326386:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 13 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.326396:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263271424:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.326468:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.326476:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 34 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.326488:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097243100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263271552:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.326522:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.326530:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 8 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.326538:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263271680:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.326564:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.326865:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12780 00000100:00100000:3.0:1746065144.326872:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263360256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.326880:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.326889:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146e5cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e04 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.326918:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263271808:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065144.326960:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.327884:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.328056:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360640 00000100:00100000:2.0:1746065144.328060:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360640 00000100:00100000:1.0:1746065144.328151:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263271296:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065144.328173:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc146e5b8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dfd expref: 21 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.328183:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc146e5b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dfd expref: 21 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065144.328633:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12781 00000100:00100000:2.0:1746065144.328642:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263360640:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065144.328924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.328961:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360896 00000100:00100000:0.0:1746065144.328967:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360896 00010000:00010000:0.0:1746065144.328999:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.330780:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.330795:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146e5d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e12 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.330835:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263271936:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065144.330888:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.330911:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263271424:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.330918:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097243100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263271552:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.330925:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263271680:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.330940:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065144.331064:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1bc00, rc 0) 00000100:00100000:1.0:1746065144.331093:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263360128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11939us (12496us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065144.331101:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12779 00000100:00100000:3.0:1746065144.331680:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5709 00000100:00100000:3.0:1746065144.331692:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263360896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.331706:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.331714:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.331723:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.331741:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146e525 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932db7 expref: 9 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.331760:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065144.331765:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065144.331789:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065144.331794:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.331814:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263360896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 126us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.331819:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5709 00000100:00100000:0.0:1746065144.332040:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.332053:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360768 00000100:00100000:0.0:1746065144.332057:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360768 00010000:00010000:0.0:1746065144.332071:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 14 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065144.332085:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5710 00000100:00100000:0.0:1746065144.332089:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263360768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065144.332095:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065144.332098:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 14 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.332105:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 14 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.332115:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc146e587 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de1 expref: 14 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.332126:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065144.332129:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065144.332137:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065144.332141:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065144.332156:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881263360768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.332161:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5710 00000100:00100000:0.0:1746065144.332194:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.332204:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361024 00000100:00100000:0.0:1746065144.332206:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361024 00010000:00010000:0.0:1746065144.332216:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 35 pid: 7231 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065144.332229:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5711 00000100:00100000:0.0:1746065144.332233:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263361024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065144.332238:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065144.332242:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 35 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.332249:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 35 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.332259:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146e55d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dd3 expref: 35 pid: 7231 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.332266:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065144.332268:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065144.332274:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065144.332279:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065144.332290:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065144.332304:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263361024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.332309:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5711 00002000:00010000:0.0:1746065144.332423:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065143 -> 1746065144 00000100:00100000:0.0:1746065144.332436:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263271808:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065144.332453:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146e5cd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e04 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065144.332463:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146e5cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e04 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065144.332469:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:0.0:1746065144.332487:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263360256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5616us (6731us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065144.332492:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12780 00010000:00010000:2.0:1746065144.332590:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.332598:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065144.332638:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065144.332757:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146e5bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 35 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.332809:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.332815:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.332818:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065144.332820:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00000100:00100000:2.0:1746065144.332851:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+34:32033:x1830881263360512:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6642us (7093us total) trans 8589935865 rc 0/0 00000100:00100000:2.0:1746065144.332857:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13552 00000100:00100000:3.0:1746065144.334701:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263271936:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065144.334723:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146e5d4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e12 expref: 35 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.334733:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc146e5d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e12 expref: 35 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.334741:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44c00, rc 0) 00000100:00100000:3.0:1746065144.334768:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263360640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6128us (6886us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065144.334799:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12781 00000100:00100000:0.0:1746065144.355876:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.355935:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.356011:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.356062:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361152 00000100:00100000:0.0:1746065144.356072:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361152 00000100:00100000:0.0:1746065144.356122:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361408 00000100:00100000:0.0:1746065144.356126:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361408 00000100:00100000:0.0:1746065144.356168:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361280 00000100:00100000:0.0:1746065144.356172:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361280 00000100:00100000:0.0:1746065144.356195:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12782 00000100:00100000:0.0:1746065144.356203:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263361152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065144.356222:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.356239:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146e5e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e19 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065144.356292:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263272064:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065144.356383:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.356408:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12783 00000100:00100000:0.0:1746065144.356416:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881263361408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065144.356425:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.356436:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146e5e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e27 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065144.356467:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263272192:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065144.356498:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23f8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.356630:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12784 00000100:00100000:0.0:1746065144.356638:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263361280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065144.356646:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.356654:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146e5f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e20 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065144.356683:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263272320:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065144.356718:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.360610:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263272192:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065144.360632:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263272320:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065144.360647:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146e5e9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e27 expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065144.360647:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146e5f0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e20 expref: 21 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.360658:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146e5e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e27 expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065144.360658:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146e5f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e20 expref: 21 pid: 1880 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065144.360749:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263272064:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065144.360810:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146e5e2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e19 expref: 35 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.360818:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc146e5e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e19 expref: 35 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.361498:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a1e200, rc 0) 00000100:00100000:2.0:1746065144.361551:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881263361408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5135us (5616us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065144.361558:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12783 00010000:00010000:1.0:1746065144.361689:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:1.0:1746065144.361712:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263361152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5510us (5846us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065144.361717:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12782 00010000:00010000:0.0:1746065144.367016:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:1.0:1746065144.367205:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263361280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10559us (11186us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065144.367216:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12784 00000100:00100000:0.0:1746065144.378444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.378585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.378638:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361792 00000100:00100000:0.0:1746065144.378647:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361792 00000100:00100000:0.0:1746065144.378692:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12785 00000100:00100000:0.0:1746065144.378702:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+13:32031:x1830881263361792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065144.378719:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.378736:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e2e expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.378764:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.378796:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065144.378800:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065144.378805:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 14 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.378842:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.378853:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 30 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065144.378865:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263272448:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.379270:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361664 00000100:00100000:3.0:1746065144.379300:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361664 00000100:00100000:3.0:1746065144.379351:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4869 00000100:00100000:3.0:1746065144.379359:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+34:32025:x1830881263361664:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065144.379624:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+35:32025:x1830881263361664:12345-192.168.202.27@tcp:35:cat.0 Request processed in 264us (1187us total) trans 8589935866 rc 0/0 00000100:00100000:3.0:1746065144.379631:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4869 00000100:00100000:0.0:1746065144.385116:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.400379:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263272448:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.400413:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 14 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.400429:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:2.0:1746065144.402397:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+14:32031:x1830881263361792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 23691us (23807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.402407:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12785 00000100:00100000:0.0:1746065144.402554:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.402623:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361920 00000100:00100000:0.0:1746065144.402629:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361920 00002000:00100000:0.0:1746065144.402669:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2990080->3145727) req@ffff880097c31f80 x1830881263361920/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065144.402677:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c31f80 with x1830881263361920 ext(2990080->3145727) 00010000:00010000:0.0:1746065144.402684:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 31 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.402694:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 31 pid: 9548 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065144.402699:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097c31f80 00000100:00100000:0.0:1746065144.402711:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1247 00000100:00100000:0.0:1746065144.402715:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263361920:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065144.408156:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.408237:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362048 00000100:00100000:2.0:1746065144.408245:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362048 00000100:00100000:2.0:1746065144.408284:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12786 00000100:00100000:2.0:1746065144.408290:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+20:32028:x1830881263362048:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065144.408304:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.408320:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e35 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.408342:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.408349:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.408355:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065144.408357:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065144.408359:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.408380:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.408389:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.408398:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263272576:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065144.409247:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.409255:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.409262:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263272704:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.409290:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.416400:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.416411:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263272576:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.416430:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362176 00000100:00100000:3.0:1746065144.416435:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362176 00010000:00010000:3.0:1746065144.416464:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.416486:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5712 00000100:00100000:3.0:1746065144.416492:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263362176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.416502:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.416533:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.416542:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.416560:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146e595 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932de8 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.416576:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.416620:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263362176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 126us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.416626:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5712 00000100:00100000:0.0:1746065144.420025:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.420171:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263272704:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065144.420208:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.420226:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45c00, rc 0) 00000100:00100000:3.0:1746065144.420302:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+21:32028:x1830881263362048:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12011us (12152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.420310:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12786 00000100:00100000:1.0:1746065144.420551:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362304 00000100:00100000:1.0:1746065144.420559:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362304 00010000:00010000:1.0:1746065144.420585:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.420612:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5713 00000100:00100000:1.0:1746065144.420622:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263362304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.420636:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.420657:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.420666:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.420687:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146e46f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d47 expref: 21 pid: 9550 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.420705:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.420707:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.420713:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.420721:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.420754:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065144.420767:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263272832:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065144.420868:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.421470:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263361920:12345-192.168.202.27@tcp:4:cat.0 Request processed in 18753us (18914us total) trans 17179873397 rc 0/0 00000100:00100000:2.0:1746065144.421477:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1247 00002000:00100000:2.0:1746065144.421483:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2990080->3145727) req@ffff880097c31f80 x1830881263361920/t17179873397(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.421491:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c31f80 with x1830881263361920 ext(2990080->3145727) 00010000:00010000:2.0:1746065144.421497:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.421507:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065144.421512:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097c31f80 00000100:00100000:0.0:1746065144.426573:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.426931:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263272832:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065144.426954:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.427170:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362560 00000100:00100000:2.0:1746065144.427177:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362560 00002000:00100000:2.0:1746065144.427207:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2641920->2646015) req@ffff880097c30380 x1830881263362560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.427216:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c30380 with x1830881263362560 ext(2641920->2646015) 00002000:00010000:2.0:1746065144.427219:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c30380 00000100:00100000:1.0:1746065144.427492:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263362304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6871us (7477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.427501:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5713 00000100:00100000:2.0:1746065144.427566:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3538 00000100:00100000:2.0:1746065144.427572:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263362560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065144.427655:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.427670:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263362560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 98us (1103us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065144.427675:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3538 00002000:00100000:2.0:1746065144.427680:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2641920->2646015) req@ffff880097c30380 x1830881263362560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.427686:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c30380 with x1830881263362560 ext(2641920->2646015) 00002000:00010000:2.0:1746065144.427689:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c30380 00000100:00100000:1.0:1746065144.427999:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362688 00000100:00100000:1.0:1746065144.428002:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362688 00010000:00010000:1.0:1746065144.428019:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.428046:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5714 00000100:00100000:1.0:1746065144.428051:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263362688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.428060:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.428072:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.428081:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.428100:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc146e53a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dc5 expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.428119:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.429220:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.429228:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.429236:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.429265:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065144.429274:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263272960:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065144.430021:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065144.434097:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263272960:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065144.434117:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.434164:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263362688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6112us (6509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.434174:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5714 00000100:00100000:0.0:1746065144.435269:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.435369:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362944 00000100:00100000:2.0:1746065144.435377:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362944 00002000:00100000:2.0:1746065144.435417:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880097c31c00 x1830881263362944/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.435427:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c31c00 with x1830881263362944 ext(2097152->3145727) 00002000:00010000:2.0:1746065144.435432:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c31c00 00000100:00100000:2.0:1746065144.435454:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3539 00000100:00100000:2.0:1746065144.435463:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263362944:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065144.452636:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263362944:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17166us (17363us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.452646:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3539 00002000:00100000:2.0:1746065144.452656:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880097c31c00 x1830881263362944/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.452664:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c31c00 with x1830881263362944 ext(2097152->3145727) 00002000:00010000:2.0:1746065144.452668:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c31c00 00000100:00100000:1.0:1746065144.458447:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.458471:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363072 00000100:00100000:3.0:1746065144.458478:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363072 00000100:00100000:1.0:1746065144.458509:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.458588:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363200 00000100:00100000:3.0:1746065144.458591:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363200 00000100:00100000:3.0:1746065144.458637:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12787 00000100:00100000:3.0:1746065144.458646:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+20:32031:x1830881263363072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.458663:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.458678:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e3c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.458704:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.458711:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.458713:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.458716:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.458744:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.458756:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 32 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.458767:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263273088:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065144.458833:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12788 00000100:00100000:1.0:1746065144.458840:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+14:32028:x1830881263363200:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065144.458848:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.458857:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e43 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.458865:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00010000:00010000:1.0:1746065144.458871:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 15 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.458876:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.458877:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.458879:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->2498559] (req 2097152->2498559) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.458892:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 15 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.458898:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 15 pid: 1880 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.458906:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263273216:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065144.458927:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.462696:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.462744:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.462805:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363456 00000100:00100000:0.0:1746065144.462812:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363456 00010000:00010000:0.0:1746065144.462842:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 16 pid: 1880 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746065144.462866:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5715 00000100:00100000:0.0:1746065144.462873:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263363456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065144.462884:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065144.462901:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 16 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.462911:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 16 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.462931:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065144.462932:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065144.462939:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.462947:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.462978:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065144.463002:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263273344:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065144.463072:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.463227:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363328 00000100:00100000:2.0:1746065144.463232:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363328 00002000:00100000:2.0:1746065144.463258:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->3792895) req@ffff880097c33800 x1830881263363328/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.463265:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c33800 with x1830881263363328 ext(3145728->3792895) 00010000:00010000:2.0:1746065144.463272:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.463282:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 33 pid: 9548 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065144.463287:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097c33800 00000100:00100000:2.0:1746065144.463300:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1248 00000100:00100000:2.0:1746065144.463305:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263363328:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065144.463509:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263273088:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065144.463528:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.463538:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2400, rc 0) 00000100:00100000:3.0:1746065144.463563:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+21:32031:x1830881263363072:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4918us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.463569:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12787 00010000:00010000:1.0:1746065144.463693:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc146e5f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e2e expref: 16 pid: 1880 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.463708:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263273216:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065144.463721:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.463728:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0600, rc 0) 00000100:00100000:1.0:1746065144.463750:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+15:32028:x1830881263363200:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4910us (5240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.463756:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12788 00000100:00100000:2.0:1746065144.468876:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263273344:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065144.468897:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.468945:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263363456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6071us (6200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.468955:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5715 00000100:00100000:1.0:1746065144.472951:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.473037:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363584 00000100:00100000:2.0:1746065144.473045:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363584 00000100:00100000:2.0:1746065144.474607:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12789 00000100:00100000:2.0:1746065144.474619:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+37:32033:x1830881263363584:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065144.474633:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.474648:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e4a expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.474673:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.474680:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.474682:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.474685:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 38 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.474710:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.474718:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 20 pid: 1880 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.474729:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263273472:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.474809:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.475468:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263363328:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12160us (12777us total) trans 21474840839 rc 0/0 00000100:00100000:0.0:1746065144.475477:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1248 00002000:00100000:0.0:1746065144.475486:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->3792895) req@ffff880097c33800 x1830881263363328/t21474840839(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065144.475494:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c33800 with x1830881263363328 ext(3145728->3792895) 00010000:00010000:0.0:1746065144.475500:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 37 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.475508:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 37 pid: 9548 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065144.475513:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097c33800 00000100:00100000:1.0:1746065144.475590:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.475829:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363840 00000100:00100000:0.0:1746065144.475835:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363840 00002000:00100000:0.0:1746065144.475855:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2494464->2498559) req@ffff88008f3e6a00 x1830881263363840/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065144.475863:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6a00 with x1830881263363840 ext(2494464->2498559) 00002000:00010000:0.0:1746065144.475866:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e6a00 00000100:00100000:0.0:1746065144.475932:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3540 00000100:00100000:0.0:1746065144.475937:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263363840:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065144.476142:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263363840:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 203us (550us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065144.476147:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3540 00002000:00100000:0.0:1746065144.476152:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2494464->2498559) req@ffff88008f3e6a00 x1830881263363840/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065144.476158:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6a00 with x1830881263363840 ext(2494464->2498559) 00002000:00010000:0.0:1746065144.476161:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e6a00 00000100:00100000:2.0:1746065144.477312:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263273472:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.477337:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 36 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.477350:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45800, rc 0) 00000100:00100000:2.0:1746065144.477377:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+36:32033:x1830881263363584:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2761us (4434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.477383:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12789 00000100:00100000:0.0:1746065144.478096:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.478156:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363968 00000100:00100000:2.0:1746065144.478161:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363968 00002000:00100000:2.0:1746065144.478188:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2641920->3145727) req@ffff880097fa2a00 x1830881263363968/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.478196:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2a00 with x1830881263363968 ext(2641920->3145727) 00010000:00010000:2.0:1746065144.478202:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 21 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.478210:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 21 pid: 1880 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065144.478216:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa2a00 00000100:00100000:2.0:1746065144.478229:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1249 00000100:00100000:2.0:1746065144.478235:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263363968:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065144.479709:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.480369:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364224 00000100:00100000:2.0:1746065144.480375:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364224 00000100:00100000:2.0:1746065144.480416:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4870 00000100:00100000:2.0:1746065144.480423:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+13:32028:x1830881263364224:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065144.480885:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+14:32028:x1830881263364224:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 461us (1179us total) trans 8589935867 rc 0/0 00000100:00100000:2.0:1746065144.480891:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4870 00000100:00100000:0.0:1746065144.481151:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.481570:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364352 00000100:00100000:3.0:1746065144.481574:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364352 00010000:00010000:3.0:1746065144.481594:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 36 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.481802:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5716 00000100:00100000:3.0:1746065144.481810:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263364352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.481819:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.481832:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 36 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.481840:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 36 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.481857:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146e541 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3792895) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932dcc expref: 36 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.481886:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.481888:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.481893:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.481900:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.481924:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.481934:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263273600:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065144.481984:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.483237:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263363968:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 4999us (5140us total) trans 21474840840 rc 0/0 00000100:00100000:2.0:1746065144.483249:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1249 00002000:00100000:2.0:1746065144.483256:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2641920->3145727) req@ffff880097fa2a00 x1830881263363968/t21474840840(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.483264:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2a00 with x1830881263363968 ext(2641920->3145727) 00010000:00010000:2.0:1746065144.483269:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 23 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.483279:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 23 pid: 1880 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065144.483285:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa2a00 00000100:00100000:3.0:1746065144.484347:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263273600:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065144.484363:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.484387:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263364352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2578us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.484394:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5716 00000100:00100000:0.0:1746065144.487653:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.487801:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364480 00000100:00100000:3.0:1746065144.487809:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364480 00010000:00010000:3.0:1746065144.487835:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 23 pid: 1880 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.488062:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5717 00000100:00100000:3.0:1746065144.488069:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263364480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.488081:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.488097:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 23 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.488106:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 23 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.488122:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45c00/0xad6b7ddc146e5fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e35 expref: 23 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.489100:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.489103:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.489111:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.489118:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.489146:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.489155:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263273728:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065144.490472:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.490502:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.490548:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.490942:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364864 00000100:00100000:2.0:1746065144.490949:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364864 00002000:00100000:2.0:1746065144.490994:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097fa1880 x1830881263364864/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.491003:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1880 with x1830881263364864 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.491006:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1880 00000100:00100000:2.0:1746065144.491018:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364992 00000100:00100000:2.0:1746065144.491020:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364992 00002000:00100000:2.0:1746065144.491031:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa3100 x1830881263364992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.491038:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3100 with x1830881263364992 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.491040:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3100 00000100:00100000:2.0:1746065144.491062:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3541 00000100:00100000:2.0:1746065144.491069:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263364864:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065144.491699:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3542 00000100:00100000:0.0:1746065144.491707:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263364992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065144.494231:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263273728:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065144.494249:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.494274:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263364480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6205us (6629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.494284:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5717 00000100:00100000:0.0:1746065144.495811:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.496423:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365248 00000100:00100000:1.0:1746065144.496430:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365248 00002000:00100000:1.0:1746065144.496461:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3117056->3121151) req@ffff88009577d500 x1830881263365248/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.496470:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d500 with x1830881263365248 ext(3117056->3121151) 00002000:00010000:1.0:1746065144.496474:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577d500 00000100:00100000:1.0:1746065144.496498:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3543 00000100:00100000:1.0:1746065144.496504:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263365248:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065144.496595:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263365248:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 91us (790us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.496601:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3543 00002000:00100000:1.0:1746065144.496605:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3117056->3121151) req@ffff88009577d500 x1830881263365248/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.496612:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d500 with x1830881263365248 ext(3117056->3121151) 00002000:00010000:1.0:1746065144.496615:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577d500 00000100:00100000:2.0:1746065144.500124:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263364864:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9047us (9648us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.500133:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3541 00002000:00100000:2.0:1746065144.500141:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097fa1880 x1830881263364864/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.500150:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1880 with x1830881263364864 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.500154:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1880 00000100:00100000:2.0:1746065144.503308:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263364992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11594us (12797us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.503319:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3542 00002000:00100000:2.0:1746065144.503824:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa3100 x1830881263364992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.503833:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3100 with x1830881263364992 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.503837:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3100 00000100:00100000:0.0:1746065144.504582:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.505839:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365376 00000100:00100000:3.0:1746065144.505847:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365376 00000100:00100000:3.0:1746065144.505894:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12790 00000100:00100000:3.0:1746065144.505900:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+32:32033:x1830881263365376:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065144.505914:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.505928:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e51 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.505951:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.505957:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.505958:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.505961:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->2891775] (req 2097152->2891775) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.505982:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.506002:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 13 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.506012:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263273856:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.506090:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.508855:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.509095:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365632 00000100:00100000:2.0:1746065144.509100:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365632 00002000:00100000:2.0:1746065144.509133:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88009577f800 x1830881263365632/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.509146:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f800 with x1830881263365632 ext(4194304->5021695) 00002000:00010000:2.0:1746065144.509151:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f800 00000100:00100000:2.0:1746065144.509174:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3544 00000100:00100000:2.0:1746065144.509181:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263365632:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065144.509327:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263273856:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065144.509346:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->2891775] (req 2097152->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.509357:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97e00, rc 0) 00000100:00100000:3.0:1746065144.509397:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32033:x1830881263365376:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3497us (4817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.509403:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12790 00000100:00100000:1.0:1746065144.510094:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.510199:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.510754:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365888 00000100:00100000:3.0:1746065144.510758:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365888 00000100:00100000:3.0:1746065144.510798:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12791 00000100:00100000:3.0:1746065144.510804:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+14:32031:x1830881263365888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.510813:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.510824:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e58 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.510906:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.510908:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.510911:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.510920:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.510927:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:3.0:1746065144.510951:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+15:32031:x1830881263365888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 148us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.510957:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12791 00000100:00100000:0.0:1746065144.511214:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365760 00000100:00100000:0.0:1746065144.511218:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365760 00002000:00100000:0.0:1746065144.511237:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2498559) req@ffff880097d06a00 x1830881263365760/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065144.511245:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06a00 with x1830881263365760 ext(2097152->2498559) 00010000:00010000:0.0:1746065144.511251:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 15 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746065144.511261:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 15 pid: 9548 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746065144.511266:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d06a00 00000100:00100000:0.0:1746065144.511291:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1250 00000100:00100000:0.0:1746065144.511296:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263365760:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065144.519053:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263365760:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7746us (8844us total) trans 17179873398 rc 0/0 00000100:00100000:1.0:1746065144.519064:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1250 00002000:00100000:1.0:1746065144.519074:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2498559) req@ffff880097d06a00 x1830881263365760/t17179873398(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.519085:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06a00 with x1830881263365760 ext(2097152->2498559) 00010000:00010000:1.0:1746065144.519095:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 17 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.519109:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 17 pid: 9548 timeout: 840 lvb_type: 0 00002000:00010000:1.0:1746065144.519115:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d06a00 00000100:00100000:3.0:1746065144.519330:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263365632:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10148us (10478us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065144.519337:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3544 00002000:00100000:3.0:1746065144.519342:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88009577f800 x1830881263365632/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 827392/827392 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.519348:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f800 with x1830881263365632 ext(4194304->5021695) 00002000:00010000:3.0:1746065144.519351:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f800 00000100:00100000:0.0:1746065144.522457:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.522514:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366016 00000100:00100000:3.0:1746065144.522522:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366016 00010000:00010000:3.0:1746065144.522551:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 17 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.522586:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5718 00000100:00100000:3.0:1746065144.522593:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263366016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.522606:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.522621:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 17 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.522631:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 17 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.522648:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146e60c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2498559) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e43 expref: 17 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.522677:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.522679:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.522685:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.522692:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.522699:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.522700:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.522702:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.522708:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.522734:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.522743:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263273984:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065144.522848:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.522856:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263274112:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065144.522874:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.526047:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263274112:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065144.527203:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263273984:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065144.527220:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065144.527264:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263366016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4670us (4812us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.527273:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5718 00000100:00100000:0.0:1746065144.530013:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.530104:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366272 00000100:00100000:3.0:1746065144.530111:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366272 00002000:00100000:3.0:1746065144.530146:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009577d180 x1830881263366272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.530155:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d180 with x1830881263366272 ext(3145728->4194303) 00002000:00010000:3.0:1746065144.530159:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577d180 00000100:00100000:3.0:1746065144.530432:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3545 00000100:00100000:3.0:1746065144.530440:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263366272:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065144.531150:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.532056:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366528 00000100:00100000:1.0:1746065144.532061:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366528 00002000:00100000:1.0:1746065144.532086:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2887680->2891775) req@ffff88009577f100 x1830881263366528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.532094:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f100 with x1830881263366528 ext(2887680->2891775) 00002000:00010000:1.0:1746065144.532097:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577f100 00000100:00100000:1.0:1746065144.532125:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3546 00000100:00100000:1.0:1746065144.532133:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263366528:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065144.532228:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263366528:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 96us (1078us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.532234:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3546 00002000:00100000:1.0:1746065144.532240:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2887680->2891775) req@ffff88009577f100 x1830881263366528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.532247:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f100 with x1830881263366528 ext(2887680->2891775) 00002000:00010000:1.0:1746065144.532250:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577f100 00000100:00100000:3.0:1746065144.536544:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263366272:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 6097us (6529us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065144.536553:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3545 00002000:00100000:3.0:1746065144.536562:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009577d180 x1830881263366272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.536570:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d180 with x1830881263366272 ext(3145728->4194303) 00002000:00010000:3.0:1746065144.536575:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577d180 00000100:00100000:0.0:1746065144.539763:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.539833:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.539905:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366656 00000100:00100000:3.0:1746065144.539912:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366656 00000100:00100000:3.0:1746065144.539960:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366784 00000100:00100000:3.0:1746065144.539962:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366784 00000100:00100000:3.0:1746065144.539975:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12792 00000100:00100000:3.0:1746065144.539981:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263366656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.540004:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.540018:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146e628 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e5f expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.540047:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146e628 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e5f expref: 23 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.540057:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96800/0xad6b7ddc146e628 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e5f expref: 23 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.540069:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96800, rc 0) 00000100:00100000:3.0:1746065144.540099:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263366656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 119us (343us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065144.540105:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12792 00000100:00100000:3.0:1746065144.540115:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12793 00000100:00100000:3.0:1746065144.540119:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263366784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.540125:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.540131:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc146e62f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e66 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.540143:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc146e62f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e66 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.540150:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc146e62f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e66 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.540155:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96c00, rc 0) 00000100:00100000:3.0:1746065144.540165:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263366784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 46us (333us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065144.540169:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12793 00000100:00100000:0.0:1746065144.544011:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.544051:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.544115:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366912 00000100:00100000:2.0:1746065144.544124:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366912 00000100:00100000:2.0:1746065144.544165:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367040 00000100:00100000:2.0:1746065144.544167:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367040 00000100:00100000:1.0:1746065144.544169:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12794 00000100:00100000:1.0:1746065144.544178:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263366912:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065144.544180:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12795 00000100:00100000:2.0:1746065144.544183:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263367040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.544192:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.544192:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.544204:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577bc00/0xad6b7ddc146e636 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e74 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.544204:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c0600/0xad6b7ddc146e63d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e6d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.544228:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577bc00/0xad6b7ddc146e636 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e74 expref: 17 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.544228:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0600/0xad6b7ddc146e63d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e6d expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.544237:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577bc00/0xad6b7ddc146e636 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e74 expref: 17 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.544237:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0600/0xad6b7ddc146e63d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e6d expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.544250:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0600, rc 0) 00010000:00010000:2.0:1746065144.544258:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577bc00, rc 0) 00000100:00100000:1.0:1746065144.544288:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263366912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 111us (284us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065144.544293:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12794 00000100:00100000:2.0:1746065144.544353:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263367040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 167us (301us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065144.544358:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12795 00000100:00100000:0.0:1746065144.546588:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.546614:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.546659:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367168 00000100:00100000:1.0:1746065144.546664:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367168 00000100:00100000:3.0:1746065144.546668:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367296 00000100:00100000:3.0:1746065144.546671:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367296 00000100:00100000:1.0:1746065144.546826:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12796 00000100:00100000:1.0:1746065144.546832:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263367296:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065144.546844:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.546855:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc146e644 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e82 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.546875:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc146e644 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e82 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.546884:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc146e644 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e82 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.546893:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:0.0:1746065144.546893:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12797 00000100:00100000:0.0:1746065144.546900:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263367168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065144.546906:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.546913:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e64b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e7b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065144.546919:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263367296:12345-192.168.202.27@tcp:101:cat.0 Request processed in 88us (304us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065144.546924:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12796 00010000:00010000:0.0:1746065144.546925:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e64b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e7b expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065144.546936:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc146e64b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e7b expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065144.546946:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:0.0:1746065144.546961:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263367168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 61us (376us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065144.546965:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12797 00000100:00100000:0.0:1746065144.604124:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.604277:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367552 00000100:00100000:2.0:1746065144.604285:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367552 00000100:00100000:2.0:1746065144.604332:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13553 00000100:00100000:2.0:1746065144.604340:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+14:32040:x1830881263367552:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065144.604361:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.604376:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e89 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.604438:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604449:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604458:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604468:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604473:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604477:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604556:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604564:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604570:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065144.604577:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065144.604634:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604639:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604643:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604648:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604653:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.604656:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604661:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604670:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065144.604672:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.604676:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604680:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc146e659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604703:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604707:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604712:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604715:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.604717:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604721:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604727:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e3d9e00) 00010000:00010000:2.0:1746065144.604729:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.604732:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604735:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e660 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065144.604766:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.604795:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.604801:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.604803:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065144.604805:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ae00, rc 0) 00000100:00100000:2.0:1746065144.604857:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+16:32040:x1830881263367552:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 517us (742us total) trans 8589935868 rc 0/0 00000100:00100000:2.0:1746065144.604863:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13553 00000100:00100000:0.0:1746065144.627589:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.628347:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367808 00000100:00100000:2.0:1746065144.628355:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367808 00000100:00100000:2.0:1746065144.628399:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13554 00000100:00100000:2.0:1746065144.628405:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+35:32043:x1830881263367808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.628427:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.628441:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ba00/0xad6b7ddc146e675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e90 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.628499:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628510:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628518:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628530:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628535:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628539:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628604:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628611:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628616:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065144.628623:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065144.628670:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628675:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628680:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628685:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628689:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.628692:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628697:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628705:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065144.628708:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.628710:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628714:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc146e67c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628736:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628740:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628744:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628747:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.628749:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628752:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.628756:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e3d9600) 00010000:00010000:2.0:1746065144.628758:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.628759:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.630316:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc146e683 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065144.630370:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ba00/0xad6b7ddc146e675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 38 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.630380:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 37 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.630387:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.630389:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065144.630391:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a400, rc 0) 00000100:00100000:2.0:1746065144.630453:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+37:32043:x1830881263367808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2047us (2870us total) trans 8589935869 rc 0/0 00000100:00100000:2.0:1746065144.630460:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13554 00000100:00100000:0.0:1746065144.633890:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.633974:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367936 00000100:00100000:3.0:1746065144.633981:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367936 00000100:00100000:3.0:1746065144.634233:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12798 00000100:00100000:3.0:1746065144.634241:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+16:32040:x1830881263367936:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065144.634257:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.634272:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e97 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.634298:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 32 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.634305:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.634310:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.634315:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.634317:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.634319:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1294336->1646591] (req 1294336->1646591) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.634347:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.634361:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 17 pid: 11461 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746065144.634371:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263274240:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065144.634462:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.634470:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 7 pid: 10219 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746065144.634477:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263274368:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065144.634503:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 32 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.634511:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 32 pid: 3067 timeout: 840 lvb_type: 1 00000100:00100000:3.0:1746065144.634518:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263274496:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.634533:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.639751:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.640417:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263274368:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.640429:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263274496:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.640663:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368064 00000100:00100000:2.0:1746065144.640669:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368064 00010000:00010000:2.0:1746065144.640701:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 8 pid: 10219 timeout: 840 lvb_type: 1 00000100:00100000:2.0:1746065144.640737:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5719 00000100:00100000:2.0:1746065144.640744:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263368064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.640757:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.640791:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 8 pid: 10219 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746065144.640800:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 8 pid: 10219 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746065144.640819:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc146e4e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d94 expref: 8 pid: 10219 timeout: 840 lvb_type: 1 00010000:00010000:2.0:1746065144.640842:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.640877:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263368064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 133us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.640882:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5719 00000100:00100000:1.0:1746065144.642892:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.642924:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.643007:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263274240:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065144.643036:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1294336->1646591] (req 1294336->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.643049:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97200, rc 0) 00000100:00100000:3.0:1746065144.643091:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+17:32040:x1830881263367936:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8851us (9206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.643099:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12798 00000100:00100000:3.0:1746065144.643119:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368192 00000100:00100000:3.0:1746065144.643123:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368192 00000100:00100000:3.0:1746065144.643142:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368320 00000100:00100000:3.0:1746065144.643144:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368320 00000100:00100000:3.0:1746065144.643155:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12799 00000100:00100000:3.0:1746065144.643160:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263368192:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.643169:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.643181:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc146e69f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932e9e expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.643194:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.643201:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc146e69f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e9e expref: 34 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.643208:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc146e69f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e9e expref: 34 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.643218:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96e00, rc 0) 00000100:00100000:3.0:1746065144.643234:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263368192:12345-192.168.202.27@tcp:101:cat.0 Request processed in 73us (348us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065144.643241:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12799 00000100:00100000:3.0:1746065144.643250:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12800 00000100:00100000:3.0:1746065144.643254:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263368320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.643261:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.643269:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc146e6a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ea5 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.643282:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc146e6a6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ea5 expref: 36 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.643289:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96200/0xad6b7ddc146e6a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ea5 expref: 36 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.643295:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96200, rc 0) 00000100:00100000:3.0:1746065144.643309:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263368320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (384us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065144.643314:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12800 00000100:00100000:0.0:1746065144.645229:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.646112:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.646152:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.646350:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368576 00000100:00100000:1.0:1746065144.646357:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368576 00010000:00010000:1.0:1746065144.646386:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 33 pid: 3067 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746065144.646413:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368704 00000100:00100000:1.0:1746065144.646415:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368704 00010000:00010000:1.0:1746065144.646423:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 17 pid: 11461 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746065144.646434:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5720 00000100:00100000:1.0:1746065144.646440:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263368576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.646449:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.646463:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 33 pid: 3067 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746065144.646472:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 33 pid: 3067 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746065144.646489:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8a00/0xad6b7ddc146e3ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ce5 expref: 33 pid: 3067 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746065144.646504:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.646532:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263368576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.646538:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5720 00000100:00100000:1.0:1746065144.646550:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5721 00000100:00100000:1.0:1746065144.646554:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263368704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.646559:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.646565:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 17 pid: 11461 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746065144.646573:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 17 pid: 11461 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746065144.646583:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146e45a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d24 expref: 17 pid: 11461 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746065144.646589:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.646591:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.646596:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.646603:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.646627:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065144.646637:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263274624:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065144.646699:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.647320:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368448 00000100:00100000:2.0:1746065144.647326:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368448 00000100:00100000:2.0:1746065144.647359:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12801 00000100:00100000:2.0:1746065144.647364:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263368448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.647376:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.647384:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc146e6ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932eac expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.647399:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc146e6ad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eac expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.647406:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc146e6ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eac expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.647413:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ac00, rc 0) 00000100:00100000:2.0:1746065144.647439:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263368448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 76us (2394us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065144.647444:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12801 00000100:00100000:0.0:1746065144.650954:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.652392:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263274624:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065144.652411:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.652455:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263368704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5899us (6302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.652465:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5721 00000100:00100000:3.0:1746065144.653090:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368960 00000100:00100000:3.0:1746065144.653097:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368960 00002000:00100000:3.0:1746065144.653130:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1294336->1298431) req@ffff880091b65180 x1830881263368960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.653139:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65180 with x1830881263368960 ext(1294336->1298431) 00002000:00010000:3.0:1746065144.653143:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65180 00000100:00100000:3.0:1746065144.653159:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3547 00000100:00100000:3.0:1746065144.653165:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263368960:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065144.653277:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263368960:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 111us (2330us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065144.653282:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3547 00002000:00100000:3.0:1746065144.653286:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1294336->1298431) req@ffff880091b65180 x1830881263368960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.653293:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65180 with x1830881263368960 ext(1294336->1298431) 00002000:00010000:3.0:1746065144.653295:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65180 00000100:00100000:0.0:1746065144.663898:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.663948:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.664005:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369344 00000100:00100000:3.0:1746065144.664013:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369344 00002000:00100000:3.0:1746065144.664046:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1642496->1646591) req@ffff880091b65880 x1830881263369344/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.664055:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65880 with x1830881263369344 ext(1642496->1646591) 00002000:00010000:3.0:1746065144.664060:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65880 00000100:00100000:3.0:1746065144.664089:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3548 00000100:00100000:3.0:1746065144.664097:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263369344:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065144.664217:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263369344:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 120us (268us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065144.664223:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3548 00002000:00100000:3.0:1746065144.664228:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1642496->1646591) req@ffff880091b65880 x1830881263369344/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.664235:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65880 with x1830881263369344 ext(1642496->1646591) 00002000:00010000:3.0:1746065144.664238:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65880 00000100:00100000:2.0:1746065144.664341:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369088 00000100:00100000:2.0:1746065144.664345:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369088 00000100:00100000:2.0:1746065144.664380:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12802 00000100:00100000:2.0:1746065144.664386:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+32:32043:x1830881263369088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.664396:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.664409:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932eb3 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.664429:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.664436:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.664438:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.664441:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 33 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.664462:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.664471:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 15 pid: 12260 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.664480:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263274752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065144.664544:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23f8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065144.669698:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.669877:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065144.669891:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263274880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746065144.669928:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.670406:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369600 00000100:00100000:2.0:1746065144.670412:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369600 00000100:00100000:2.0:1746065144.670447:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4871 00000100:00100000:2.0:1746065144.670453:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+16:32040:x1830881263369600:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065144.670600:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+17:32040:x1830881263369600:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 146us (906us total) trans 8589935870 rc 0/0 00000100:00100000:2.0:1746065144.670605:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4871 00000100:00100000:0.0:1746065144.673192:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274880 00000100:00100000:0.0:1746065144.673201:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274880 00000100:00100000:0.0:1746065144.673255:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1746065144.673262:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263274880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065144.673293:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065144.673406:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263274880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (3476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.673412:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1746065144.674655:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263274880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746065144.675359:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.675464:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263274752:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.675486:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 33 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.675501:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b000, rc 0) 00000100:00100000:2.0:1746065144.675548:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+33:32043:x1830881263369088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11161us (11657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.675556:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12802 00000100:00100000:2.0:1746065144.678548:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369728 00000100:00100000:2.0:1746065144.678557:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369728 00002000:00100000:2.0:1746065144.678590:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1294336->1646591) req@ffff880097d05500 x1830881263369728/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.678599:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05500 with x1830881263369728 ext(1294336->1646591) 00010000:00010000:2.0:1746065144.678684:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 16 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.678701:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 16 pid: 12260 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065144.678707:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d05500 00000100:00100000:2.0:1746065144.679448:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1251 00000100:00100000:2.0:1746065144.679457:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263369728:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065144.684764:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.684837:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369984 00000100:00100000:3.0:1746065144.684845:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369984 00000100:00100000:3.0:1746065144.684883:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13555 00000100:00100000:3.0:1746065144.684890:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+37:32045:x1830881263369984:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065144.684909:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.684925:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146e6bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932eba expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.685000:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685011:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685020:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685029:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685035:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685040:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685108:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146e6d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685119:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146e6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685125:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146e6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065144.685133:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065144.685190:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685195:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685200:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685205:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685210:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065144.685213:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685218:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685226:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065144.685228:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065144.685231:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.685235:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc146e6c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00000100:00100000:2.0:1746065144.685435:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ceddf226-8ddf-479f-9953-8a74c62285a9:3759:1830881263275008:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.685469:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.685496:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263275520:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.685512:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.685523:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3759:1830881263276032:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.685534:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.685545:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746065144.685550:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263275136:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.685565:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.685576:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881263275648:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.685589:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.685599:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263276160:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.685654:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.685695:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276032 00000100:00100000:2.0:1746065144.685698:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276032 00010000:00010000:3.0:1746065144.687359:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.687369:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.687374:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.687379:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065144.687382:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.687387:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.687397:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2ae00) 00010000:00010000:3.0:1746065144.687400:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065144.687402:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.687406:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc146e6c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065144.687453:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146e6bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eba expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.687464:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146e6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eba expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.687470:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065144.687472:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065144.687475:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97400, rc 0) 00000100:00100000:2.0:1746065144.687891:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275648 00000100:00100000:2.0:1746065144.687897:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275648 00000100:00100000:2.0:1746065144.687913:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1746065144.687919:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3759:x1830881263276032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.687965:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3759:x1830881263276032:12345-0@lo:400:kworker.0 Request processed in 46us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.687970:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1746065144.687981:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1746065144.687996:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881263275648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.688016:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881263275648:12345-0@lo:400:kworker.0 Request processed in 31us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.688021:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1746065144.688049:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881263275648:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.688060:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3759:1830881263276032:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.688081:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275136 00000100:00100000:2.0:1746065144.688083:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275136 00000100:00100000:2.0:1746065144.688101:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1746065144.688105:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263275136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065144.688113:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275008 00000100:00100000:0.0:1746065144.688118:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275008 00000100:00100000:2.0:1746065144.688130:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263275136:12345-0@lo:400:kworker.0 Request processed in 24us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.688134:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1746065144.688141:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1746065144.688146:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3759:x1830881263275008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.688149:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263275136:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.688164:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263275392:0@lo:400:kworker.0 00000100:00100000:0.0:1746065144.688180:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a91bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3759:x1830881263275008:12345-0@lo:400:kworker.0 Request processed in 34us (2709us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.688185:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1746065144.688187:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.688202:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881263275904:0@lo:400:kworker.0 00000100:00100000:0.0:1746065144.688213:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275520 00000100:00100000:0.0:1746065144.688216:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275520 00000100:00100000:2.0:1746065144.688217:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065144.688320:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275904 00000100:00100000:0.0:1746065144.688324:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275904 00000100:00100000:0.0:1746065144.688341:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:0.0:1746065144.688346:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881263275904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.688367:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+39:32045:x1830881263369984:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3476us (3610us total) trans 8589935871 rc 0/0 00000100:00100000:0.0:1746065144.688370:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881263275904:12345-0@lo:400:kworker.0 Request processed in 24us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.688373:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13555 00000100:00100000:0.0:1746065144.688376:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1746065144.688391:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276160 00000100:00100000:3.0:1746065144.688394:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276160 00000100:00100000:0.0:1746065144.688404:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275392 00000100:00100000:0.0:1746065144.688406:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275392 00000100:00100000:3.0:1746065144.688410:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1746065144.688414:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263275520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065144.688423:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1746065144.688427:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263276160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.688440:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263275520:12345-0@lo:400:kworker.0 Request processed in 25us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.688444:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1746065144.688450:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263276160:12345-0@lo:400:kworker.0 Request processed in 22us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.688453:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1746065144.688456:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1746065144.688457:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263275392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.688475:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263275392:12345-0@lo:400:kworker.0 Request processed in 18us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.688480:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1746065144.688494:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3761:1830881263275264:0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.688511:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065144.688532:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275264 00000100:00100000:3.0:1746065144.688535:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275264 00000100:00100000:3.0:1746065144.688548:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1746065144.688552:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3761:x1830881263275264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.688574:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3761:x1830881263275264:12345-0@lo:400:kworker.0 Request processed in 21us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.688578:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00080000:1.0:1746065144.688629:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065144.688632:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065144.688634:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746065144.688636:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065144.689412:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881263275904:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.689419:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881263276416:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.689439:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065144.689475:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263275392:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.689494:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263276160:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.689502:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ceddf226-8ddf-479f-9953-8a74c62285a9:3759:1830881263275008:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.689510:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263275520:0@lo:400:kworker.0 00000100:00100000:1.0:1746065144.689602:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276416 00000100:00100000:1.0:1746065144.689606:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276416 00000100:00100000:1.0:1746065144.689631:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1746065144.689636:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881263276416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065144.689673:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881263276416:12345-0@lo:400:kworker.0 Request processed in 37us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.689678:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1746065144.690054:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881263276416:0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.690442:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3761:1830881263275264:0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.690448:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3761:1830881263275776:0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.690468:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065144.690888:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263276288:0@lo:400:kworker.0 00000100:00100000:3.0:1746065144.690906:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065144.691156:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276288 00000100:00100000:0.0:1746065144.691160:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276288 00000100:00100000:0.0:1746065144.691188:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1746065144.691193:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263276288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065144.691230:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263276288:12345-0@lo:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.691235:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1746065144.691433:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275776 00000100:00100000:1.0:1746065144.691436:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275776 00000100:00100000:1.0:1746065144.691463:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1746065144.691467:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3761:x1830881263275776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065144.691491:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3761:x1830881263275776:12345-0@lo:400:kworker.0 Request processed in 24us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.691496:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00080000:1.0:1746065144.691508:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065144.691557:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3761:1830881263275776:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.691565:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263276288:0@lo:400:kworker.0 00000100:00100000:2.0:1746065144.692850:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263369728:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13391us (17489us total) trans 17179873399 rc 0/0 00000100:00100000:2.0:1746065144.692858:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1251 00002000:00100000:2.0:1746065144.692868:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1294336->1646591) req@ffff880097d05500 x1830881263369728/t17179873399(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.692876:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05500 with x1830881263369728 ext(1294336->1646591) 00010000:00010000:2.0:1746065144.692884:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 18 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.692896:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 18 pid: 12260 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065144.692903:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d05500 00000100:00100000:0.0:1746065144.693212:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.693309:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.693568:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370240 00000100:00100000:3.0:1746065144.693573:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370240 00000100:00100000:3.0:1746065144.693605:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4872 00000100:00100000:3.0:1746065144.693611:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+39:32045:x1830881263370240:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065144.693745:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+40:32045:x1830881263370240:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 135us (534us total) trans 8589935872 rc 0/0 00000100:00100000:3.0:1746065144.693751:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4872 00000100:00100000:1.0:1746065144.694056:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370368 00000100:00100000:1.0:1746065144.694060:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370368 00000100:00100000:1.0:1746065144.694084:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 713 00000100:00100000:1.0:1746065144.694088:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263370368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.694096:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.694113:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146e6d0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eba expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.694135:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065144.694139:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.694156:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263370368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.694162:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 713 00000100:00100000:0.0:1746065144.695518:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.695590:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370496 00000100:00100000:2.0:1746065144.695594:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370496 00010000:00010000:2.0:1746065144.695611:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 18 pid: 12260 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.696379:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5722 00000100:00100000:1.0:1746065144.696390:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263370496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.696404:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065144.696419:0:9565:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065142 -> 1746065144 00002000:00010000:1.0:1746065144.696422:0:9565:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065142 -> 1746065144 00010000:00010000:1.0:1746065144.696429:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 18 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.696440:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 18 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.696464:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97200/0xad6b7ddc146e698 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1646591) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e97 expref: 18 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746065144.696478:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.696479:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.696486:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 32 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.696493:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 32 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.696525:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 32 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065144.696538:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263276544:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065144.696640:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065144.703281:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263276544:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065144.703303:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.706224:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263370496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9826us (10697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.706235:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5722 00000100:00100000:0.0:1746065144.706414:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.706850:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370752 00000100:00100000:2.0:1746065144.706856:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370752 00002000:00100000:2.0:1746065144.706885:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880091b64a80 x1830881263370752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.706894:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64a80 with x1830881263370752 ext(1048576->2097151) 00002000:00010000:2.0:1746065144.706899:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64a80 00000100:00100000:2.0:1746065144.706919:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3549 00000100:00100000:2.0:1746065144.706924:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263370752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065144.732844:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263370752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25910us (26421us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.732855:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3549 00002000:00100000:2.0:1746065144.732863:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880091b64a80 x1830881263370752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.732871:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64a80 with x1830881263370752 ext(1048576->2097151) 00002000:00010000:2.0:1746065144.732875:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64a80 00000100:00100000:0.0:1746065144.733579:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.733654:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370880 00000100:00100000:3.0:1746065144.733661:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370880 00000100:00100000:3.0:1746065144.734143:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12803 00000100:00100000:3.0:1746065144.734150:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:32045:x1830881263370880:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065144.734164:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.734178:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ec1 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.734199:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.734205:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.734207:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065144.734210:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->3850239] (req 3424256->3850239) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.734232:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.734242:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 21 pid: 1880 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.734251:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263276672:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.735078:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065144.738203:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263276672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065144.738226:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->3850239] (req 3424256->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.738240:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00000100:00100000:3.0:1746065144.738306:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+36:32045:x1830881263370880:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4155us (4727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.738314:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12803 00000100:00100000:0.0:1746065144.743306:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.743429:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371008 00000100:00100000:3.0:1746065144.743437:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371008 00000100:00100000:3.0:1746065144.743488:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12804 00000100:00100000:3.0:1746065144.743495:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263371008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.743511:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.743525:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3ddc00/0xad6b7ddc146e6e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ec8 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.743582:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3ddc00/0xad6b7ddc146e6e5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec8 expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.743591:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3ddc00/0xad6b7ddc146e6e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec8 expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065144.743609:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3ddc00, rc 0) 00000100:00100000:3.0:1746065144.743650:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263371008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 155us (900us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065144.743656:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12804 00000100:00100000:2.0:1746065144.743897:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.744124:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.744193:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371136 00000100:00100000:0.0:1746065144.744198:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371136 00010000:00010000:0.0:1746065144.744216:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 22 pid: 1880 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.744310:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371264 00000100:00100000:2.0:1746065144.744313:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371264 00000100:00100000:3.0:1746065144.744387:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5723 00000100:00100000:3.0:1746065144.744393:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263371136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.744402:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.744418:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 22 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.744428:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 22 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.744443:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146e605 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e3c expref: 22 pid: 1880 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.744454:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.744455:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.744461:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.744468:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.744493:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.744504:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263276800:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065144.744545:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.744624:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12805 00000100:00100000:2.0:1746065144.744630:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263371264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.744638:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.744645:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc146e6ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ecf expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.744660:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc146e6ec lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ecf expref: 34 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.744671:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc146e6ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ecf expref: 34 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065144.744685:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2800, rc 0) 00000100:00100000:2.0:1746065144.744700:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263371264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (577us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065144.744704:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12805 00000100:00100000:0.0:1746065144.748025:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.748066:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371392 00000100:00100000:0.0:1746065144.748069:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.748073:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371392 00000100:00100000:0.0:1746065144.748094:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371648 00000100:00100000:0.0:1746065144.748097:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371648 00000100:00100000:2.0:1746065144.748107:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12806 00000100:00100000:2.0:1746065144.748112:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+37:32043:x1830881263371392:12345-192.168.202.27@tcp:101:cat.0 00002000:00100000:0.0:1746065144.748121:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3424256->3428351) req@ffff880091b65f80 x1830881263371648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065144.748124:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746065144.748129:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65f80 with x1830881263371648 ext(3424256->3428351) 00002000:00010000:0.0:1746065144.748132:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b65f80 00010000:00010000:2.0:1746065144.748136:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ed6 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065144.748142:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3550 00000100:00100000:0.0:1746065144.748146:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263371648:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065144.748158:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 38 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.748163:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.748165:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065144.748167:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.748189:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 38 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.748202:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 38 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.748211:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263276928:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065144.748240:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263371648:12345-192.168.202.27@tcp:3:cat.0 Request processed in 93us (170us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065144.748246:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3550 00002000:00100000:0.0:1746065144.748251:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3424256->3428351) req@ffff880091b65f80 x1830881263371648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065144.748258:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65f80 with x1830881263371648 ext(3424256->3428351) 00002000:00010000:0.0:1746065144.748260:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b65f80 00000100:00100000:3.0:1746065144.748298:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263276800:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065144.748311:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.748634:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.748871:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065144.748881:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263277056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065144.748909:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065144.748966:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277056 00000100:00100000:0.0:1746065144.748970:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277056 00000100:00100000:0.0:1746065144.749003:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1746065144.749008:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881263277056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746065144.749029:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445675008 avail 1316212736 00000100:00100000:0.0:1746065144.749056:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881263277056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.749060:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1746065144.749083:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263277056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746065144.749233:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263371136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4838us (5334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.749240:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5723 00000100:00100000:2.0:1746065144.750411:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263276928:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.750431:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 37 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.750445:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3c00, rc 0) 00000100:00100000:2.0:1746065144.750472:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+37:32043:x1830881263371392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2359us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.750479:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12806 00000100:00100000:0.0:1746065144.752607:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.752659:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371776 00000100:00100000:3.0:1746065144.752665:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371776 00002000:00100000:3.0:1746065144.752699:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3117056->3145727) req@ffff880091b66a00 x1830881263371776/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.752707:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66a00 with x1830881263371776 ext(3117056->3145727) 00010000:00010000:3.0:1746065144.752714:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 37 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.752724:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 37 pid: 9548 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065144.752735:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b66a00 00000100:00100000:3.0:1746065144.752749:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1252 00000100:00100000:3.0:1746065144.752755:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263371776:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065144.764691:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.765628:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372032 00000100:00100000:1.0:1746065144.765637:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372032 00002000:00100000:1.0:1746065144.765667:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3846144->3850239) req@ffff8800957da300 x1830881263372032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.765683:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881263372032 ext(3846144->3850239) 00002000:00010000:1.0:1746065144.765688:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:1.0:1746065144.765715:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3551 00000100:00100000:1.0:1746065144.765722:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263372032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065144.765828:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263372032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 105us (1143us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065144.765834:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3551 00002000:00100000:1.0:1746065144.765840:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3846144->3850239) req@ffff8800957da300 x1830881263372032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065144.765847:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881263372032 ext(3846144->3850239) 00002000:00010000:1.0:1746065144.765849:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:3.0:1746065144.767111:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263371776:12345-192.168.202.27@tcp:4:cat.0 Request processed in 14351us (14506us total) trans 21474840841 rc 0/0 00000100:00100000:3.0:1746065144.767119:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1252 00002000:00100000:3.0:1746065144.767124:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3117056->3145727) req@ffff880091b66a00 x1830881263371776/t21474840841(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.767131:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66a00 with x1830881263371776 ext(3117056->3145727) 00010000:00010000:3.0:1746065144.767138:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 39 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.767150:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 39 pid: 9548 timeout: 840 lvb_type: 0 00002000:00010000:3.0:1746065144.767156:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b66a00 00000100:00100000:2.0:1746065144.780992:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065144.781011:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263277184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065144.781070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065144.781208:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277184 00000100:00100000:1.0:1746065144.781214:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277184 00000100:00100000:1.0:1746065144.781253:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1746065144.781259:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263277184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746065144.781279:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 53248 granted 1209599424 pending 5263360 free 3903262720 avail 3671740416 00000100:00100000:1.0:1746065144.781322:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263277184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.781327:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1746065144.781490:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263277184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065144.781801:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.782280:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372288 00000100:00100000:1.0:1746065144.782284:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372288 00000100:00100000:1.0:1746065144.782319:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13556 00000100:00100000:1.0:1746065144.782325:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+17:32051:x1830881263372288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065144.782345:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.782361:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146e6fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932edd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.782420:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782431:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782439:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782449:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782453:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782458:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782523:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc146e70f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782530:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc146e70f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782535:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc146e70f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065144.782541:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065144.782590:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782598:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782603:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782608:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782611:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065144.782615:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782620:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782628:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065144.782630:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065144.782632:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782636:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc146e701 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782659:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782664:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782667:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782670:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065144.782673:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782677:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782681:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5700) 00010000:00010000:1.0:1746065144.782683:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065144.782685:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782688:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146e708 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.782712:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146e6fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932edd expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.782720:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc146e70f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932edd expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.782725:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065144.782726:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065144.782728:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07000, rc 0) 00000100:00100000:1.0:1746065144.782752:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+19:32051:x1830881263372288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 428us (953us total) trans 8589935873 rc 0/0 00000100:00100000:1.0:1746065144.782757:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13556 00000100:00100000:0.0:1746065144.787841:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.788022:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372416 00000100:00100000:2.0:1746065144.788030:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372416 00010000:00010000:2.0:1746065144.788062:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 39 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:2.0:1746065144.788098:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5724 00000100:00100000:2.0:1746065144.788105:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263372416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.788118:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.788137:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 39 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.788150:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 39 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.788169:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146e613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e4a expref: 39 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.788184:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.788186:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.788192:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.788199:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.788227:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065144.788237:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263277312:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065144.789561:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.789621:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372672 00000100:00100000:2.0:1746065144.789625:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372672 00000100:00100000:2.0:1746065144.789649:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4873 00000100:00100000:2.0:1746065144.789653:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+19:32051:x1830881263372672:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065144.789770:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+20:32051:x1830881263372672:12345-192.168.202.27@tcp:35:cat.0 Request processed in 115us (212us total) trans 8589935874 rc 0/0 00000100:00100000:2.0:1746065144.789796:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4873 00000100:00100000:2.0:1746065144.791444:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.791473:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263277312:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065144.791488:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.792119:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263372416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4011us (4281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.792127:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5724 00000100:00100000:0.0:1746065144.793450:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.794154:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372800 00000100:00100000:2.0:1746065144.794162:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372800 00000100:00100000:2.0:1746065144.794600:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 714 00000100:00100000:2.0:1746065144.794608:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263372800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.794620:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.794641:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc146e70f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932edd expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.794654:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.794658:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.794697:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+19:2007:x1830881263372800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 91us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.794703:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 714 00000100:00100000:2.0:1746065144.797620:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065144.797637:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263277440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065144.797684:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065144.799532:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277440 00000100:00100000:0.0:1746065144.799541:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277440 00000100:00100000:0.0:1746065144.799584:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1746065144.799590:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263277440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065144.799611:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 819200 granted 1135966528 pending 2625536 free 3910807552 avail 3679285248 00000100:00100000:0.0:1746065144.799665:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263277440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.799670:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1746065144.800940:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263277440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065144.801113:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.801147:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.801160:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373184 00000100:00100000:2.0:1746065144.801164:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373184 00002000:00100000:2.0:1746065144.801189:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88012edae680 x1830881263373184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.801197:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae680 with x1830881263373184 ext(2097152->3145727) 00002000:00010000:2.0:1746065144.801202:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edae680 00000100:00100000:2.0:1746065144.801210:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373312 00000100:00100000:2.0:1746065144.801211:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373312 00002000:00100000:2.0:1746065144.801219:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2891776->3145727) req@ffff88012edaed80 x1830881263373312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.801226:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaed80 with x1830881263373312 ext(2891776->3145727) 00002000:00010000:2.0:1746065144.801229:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaed80 00000100:00100000:2.0:1746065144.801236:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3552 00000100:00100000:2.0:1746065144.801241:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263373184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065144.802520:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3553 00000100:00100000:3.0:1746065144.802529:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263373312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065144.814325:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.814364:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.814390:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.814420:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373440 00000100:00100000:1.0:1746065144.814428:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373440 00000100:00100000:1.0:1746065144.814470:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373696 00000100:00100000:1.0:1746065144.814472:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373696 00000100:00100000:1.0:1746065144.814481:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373568 00000100:00100000:1.0:1746065144.814483:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373568 00000100:00100000:1.0:1746065144.814495:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12807 00000100:00100000:1.0:1746065144.814501:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263373440:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065144.814505:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12808 00000100:00100000:0.0:1746065144.814509:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263373696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065144.814516:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.814516:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.814529:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ee4 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065144.814529:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146e71d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ef2 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.814546:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065144.814548:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065144.814553:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146e71d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ef2 expref: 20 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.814554:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 20 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065144.814561:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146e71d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ef2 expref: 20 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.814564:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 20 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.814572:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00010000:00010000:0.0:1746065144.814572:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44800, rc 0) 00000100:00100000:0.0:1746065144.814598:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263373696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 88us (233us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065144.814604:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12808 00000100:00100000:0.0:1746065144.814618:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12809 00000100:00100000:0.0:1746065144.814622:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263373568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065144.814631:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065144.814638:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146e72b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932eeb expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065144.814669:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263277568:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065144.815138:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263373440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 635us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.815143:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12807 00000100:00100000:0.0:1746065144.815696:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.815733:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263373184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14489us (14620us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.815741:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3552 00002000:00100000:2.0:1746065144.815749:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88012edae680 x1830881263373184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.815757:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae680 with x1830881263373184 ext(2097152->3145727) 00002000:00010000:2.0:1746065144.815770:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edae680 00002000:00010000:1.0:1746065144.817162:0:12258:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065144 -> 1746065145 00002000:00010000:1.0:1746065144.817167:0:12258:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065144 -> 1746065145 00002000:00010000:1.0:1746065144.817168:0:12258:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065144 -> 1746065145 00000100:00100000:1.0:1746065144.817184:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263277568:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065144.817211:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146e72b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eeb expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.817221:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146e72b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eeb expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065144.817248:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44600, rc 0) 00000100:00100000:1.0:1746065144.817279:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263373568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2655us (2887us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065144.817286:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12809 00000100:00100000:3.0:1746065144.817423:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263373312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14895us (16275us total) trans 0 rc 253952/253952 00000100:00100000:3.0:1746065144.817433:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3553 00002000:00100000:3.0:1746065144.817439:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2891776->3145727) req@ffff88012edaed80 x1830881263373312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 253952/253952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.817446:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaed80 with x1830881263373312 ext(2891776->3145727) 00002000:00010000:3.0:1746065144.817449:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaed80 00000100:00100000:0.0:1746065144.825407:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.825802:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373952 00000100:00100000:2.0:1746065144.825809:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373952 00000100:00100000:2.0:1746065144.825856:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13557 00000100:00100000:2.0:1746065144.825863:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+19:32054:x1830881263373952:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065144.825882:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.825897:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e732 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ef9 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.825949:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.825958:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.825966:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.825976:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.825981:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.825994:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826066:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146e747 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826074:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146e747 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826079:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146e747 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065144.826085:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065144.826133:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826138:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826143:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826149:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826153:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.826157:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826163:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826171:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065144.826174:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.826177:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826180:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047000/0xad6b7ddc146e739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826203:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826208:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826213:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826216:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065144.826218:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826226:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826231:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090dc5a00) 00010000:00010000:2.0:1746065144.826232:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065144.826234:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826238:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146e740 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065144.826262:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146e732 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ef9 expref: 22 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.826274:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146e747 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ef9 expref: 21 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.826279:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.826280:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065144.826282:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046800, rc 0) 00000100:00100000:2.0:1746065144.826315:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+21:32054:x1830881263373952:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 453us (917us total) trans 8589935875 rc 0/0 00000100:00100000:2.0:1746065144.826321:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13557 00000100:00100000:0.0:1746065144.846652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.846731:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.846797:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374464 00000100:00100000:3.0:1746065144.846805:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374464 00002000:00100000:3.0:1746065144.846843:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88012f09ce00 x1830881263374464/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.846853:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ce00 with x1830881263374464 ext(1048576->2097151) 00002000:00010000:3.0:1746065144.846858:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ce00 00000100:00100000:3.0:1746065144.846889:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3554 00000100:00100000:3.0:1746065144.846896:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263374464:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065144.847266:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374080 00000100:00100000:1.0:1746065144.847270:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374080 00000100:00100000:1.0:1746065144.847304:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12810 00000100:00100000:1.0:1746065144.847308:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+38:32043:x1830881263374080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065144.847318:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.847330:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f00 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.847349:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 39 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.847356:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065144.847357:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065144.847360:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.847383:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 39 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.847393:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 39 pid: 12260 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.847407:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263277696:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065144.847474:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065144.856372:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.856769:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374208 00000100:00100000:1.0:1746065144.856806:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374208 00000100:00100000:1.0:1746065144.856887:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 715 00000100:00100000:1.0:1746065144.856898:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263374208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065144.856914:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065144.856941:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146e747 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ef9 expref: 21 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.856995:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065144.857001:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065144.857054:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263374208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 155us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.857061:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 715 00000100:00100000:2.0:1746065144.857251:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263277696:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065144.857276:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.857297:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06e00, rc 0) 00000100:00100000:2.0:1746065144.857315:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+39:32043:x1830881263374080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10007us (10674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.857322:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12810 00000100:00100000:2.0:1746065144.862398:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.862420:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374592 00000100:00100000:2.0:1746065144.862427:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374592 00002000:00100000:2.0:1746065144.862459:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3424256->3850239) req@ffff880091b65c00 x1830881263374592/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.862467:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65c00 with x1830881263374592 ext(3424256->3850239) 00010000:00010000:2.0:1746065144.862475:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 39 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.862487:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 39 pid: 12260 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065144.862493:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b65c00 00000100:00100000:2.0:1746065144.862514:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1253 00000100:00100000:2.0:1746065144.862520:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263374592:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065144.862756:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263374464:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15860us (16026us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.862762:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3554 00002000:00100000:2.0:1746065144.862768:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88012f09ce00 x1830881263374464/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.862793:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ce00 with x1830881263374464 ext(1048576->2097151) 00002000:00010000:2.0:1746065144.862796:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ce00 00000100:00100000:2.0:1746065144.879822:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263374592:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17293us (17423us total) trans 21474840842 rc 0/0 00000100:00100000:2.0:1746065144.879832:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1253 00002000:00100000:2.0:1746065144.879842:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3424256->3850239) req@ffff880091b65c00 x1830881263374592/t21474840842(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.879851:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65c00 with x1830881263374592 ext(3424256->3850239) 00010000:00010000:2.0:1746065144.879859:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 41 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:2.0:1746065144.879872:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 41 pid: 12260 timeout: 840 lvb_type: 0 00002000:00010000:2.0:1746065144.879878:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b65c00 00000100:00100000:1.0:1746065144.886672:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.886846:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.887015:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374720 00000100:00100000:2.0:1746065144.887024:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374720 00000100:00100000:2.0:1746065144.887071:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12811 00000100:00100000:2.0:1746065144.887077:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+21:32051:x1830881263374720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065144.887092:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065144.887105:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f07 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.887125:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.887127:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065144.887134:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.887146:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.887156:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047e00, rc 0) 00000100:00100000:2.0:1746065144.887208:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+22:32051:x1830881263374720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 128us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.887214:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12811 00000100:00100000:3.0:1746065144.887484:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374848 00000100:00100000:3.0:1746065144.887488:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374848 00010000:00010000:3.0:1746065144.887506:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 41 pid: 12260 timeout: 840 lvb_type: 0 00000100:00100000:3.0:1746065144.887523:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5725 00000100:00100000:3.0:1746065144.887527:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263374848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065144.887535:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065144.887548:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 41 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.887562:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 41 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.887575:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146e6de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3424256->18446744073709551615] (req 3424256->3850239) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ec1 expref: 41 pid: 12260 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.887588:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.887589:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.887593:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 40 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.887599:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 40 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.887621:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 40 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065144.887630:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263277824:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065144.887678:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bf00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065144.895382:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065144.911363:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.911437:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.911501:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263277824:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065144.911516:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065144.911552:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263374848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 24023us (24704us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065144.911561:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5725 00000100:00100000:2.0:1746065144.911721:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375104 00000100:00100000:2.0:1746065144.911729:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375104 00002000:00100000:2.0:1746065144.911770:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88012f09c700 x1830881263375104/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.911831:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c700 with x1830881263375104 ext(2097152->3145727) 00002000:00010000:2.0:1746065144.911835:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c700 00000100:00100000:2.0:1746065144.911861:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375360 00000100:00100000:2.0:1746065144.911866:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375360 00002000:00100000:2.0:1746065144.911885:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88012f09d880 x1830881263375360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.911891:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d880 with x1830881263375360 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.911894:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d880 00000100:00100000:2.0:1746065144.911922:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3555 00000100:00100000:2.0:1746065144.911930:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263375104:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065144.912589:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3556 00000100:00100000:2.0:1746065144.912596:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263375360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065144.939186:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065144.939324:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375616 00000100:00100000:1.0:1746065144.939332:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375616 00000100:00100000:1.0:1746065144.939379:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13558 00000100:00100000:1.0:1746065144.939386:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+39:32056:x1830881263375616:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065144.939404:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.939421:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc146e763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f0e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.939489:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939501:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939511:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939522:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939527:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939531:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939613:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0800/0xad6b7ddc146e778 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939622:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0800/0xad6b7ddc146e778 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939627:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0800/0xad6b7ddc146e778 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065144.939634:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065144.939689:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939694:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939701:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939706:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.939710:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065144.939713:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.940861:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.940871:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065144.940873:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065144.940876:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.940881:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc146e76a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.941373:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.941379:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.941383:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.941386:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065144.941388:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.941396:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.941402:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5400) 00010000:00010000:1.0:1746065144.941403:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065144.941405:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.941409:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e771 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065144.941448:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc146e763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f0e expref: 42 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.941458:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0800/0xad6b7ddc146e778 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f0e expref: 41 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.941464:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065144.941465:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065144.941467:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0800, rc 0) 00000100:00100000:1.0:1746065144.941516:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+41:32056:x1830881263375616:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2130us (2337us total) trans 8589935876 rc 0/0 00000100:00100000:1.0:1746065144.941523:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13558 00000100:00100000:3.0:1746065144.947245:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263375104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 35308us (35883us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065144.947255:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3555 00002000:00100000:3.0:1746065144.947264:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88012f09c700 x1830881263375104/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.947272:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c700 with x1830881263375104 ext(2097152->3145727) 00002000:00010000:3.0:1746065144.947277:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c700 00000100:00100000:2.0:1746065144.961888:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263375360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 49284us (50442us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065144.961898:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3556 00002000:00100000:2.0:1746065144.961909:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88012f09d880 x1830881263375360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065144.961917:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d880 with x1830881263375360 ext(3145728->4194303) 00002000:00010000:2.0:1746065144.961922:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d880 00000100:00100000:0.0:1746065144.964384:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.964443:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065144.964683:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376000 00000100:00100000:2.0:1746065144.964691:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376000 00000100:00100000:2.0:1746065144.964744:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4874 00000100:00100000:2.0:1746065144.964751:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+41:32056:x1830881263376000:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065144.965633:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+42:32056:x1830881263376000:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 880us (1188us total) trans 8589935877 rc 0/0 00000100:00100000:2.0:1746065144.965639:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4874 00000100:00100000:1.0:1746065144.965943:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375744 00000100:00100000:1.0:1746065144.965947:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375744 00000100:00100000:1.0:1746065144.965972:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12812 00000100:00100000:1.0:1746065144.965976:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+18:32051:x1830881263375744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065144.966714:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065144.966733:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f15 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.966758:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.966765:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065144.966767:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065144.966792:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.966820:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065144.966831:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 32 pid: 9548 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746065144.966841:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263277952:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065144.966912:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065144.970749:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.970889:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.970949:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376256 00000100:00100000:3.0:1746065144.970958:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376256 00000100:00100000:3.0:1746065144.971014:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12813 00000100:00100000:3.0:1746065144.971020:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+33:32043:x1830881263376256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065144.971037:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065144.971051:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f1c expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.971072:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.971074:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065144.971081:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.971093:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065144.971102:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167e00, rc 0) 00000100:00100000:3.0:1746065144.971139:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+34:32043:x1830881263376256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 119us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065144.971144:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12813 00000100:00100000:2.0:1746065144.971213:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376128 00000100:00100000:2.0:1746065144.971217:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376128 00000100:00100000:2.0:1746065144.971251:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 716 00000100:00100000:2.0:1746065144.971255:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263376128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065144.971264:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065144.971278:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0800/0xad6b7ddc146e778 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f0e expref: 42 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065144.971290:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065144.971293:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065144.971312:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263376128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 56us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065144.971317:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 716 00000100:00100000:0.0:1746065144.984248:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065144.985170:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065144.985241:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376384 00000100:00100000:3.0:1746065144.985249:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376384 00002000:00100000:3.0:1746065144.985285:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2891775) req@ffff880099ec5c00 x1830881263376384/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.985294:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5c00 with x1830881263376384 ext(2097152->2891775) 00010000:00010000:3.0:1746065144.985302:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 34 pid: 9548 timeout: 840 lvb_type: 0 00010000:00010000:3.0:1746065144.985315:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 34 pid: 9548 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065144.985321:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec5c00 00000100:00100000:3.0:1746065144.985339:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376640 00000100:00100000:1.0:1746065144.985339:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263277952:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065144.985341:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376640 00002000:00100000:3.0:1746065144.985352:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099ec5180 x1830881263376640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/0 e 0 to 0 dl 1746065155 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065144.985357:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5180 with x1830881263376640 ext(3145728->4194303) 00010000:00010000:1.0:1746065144.985359:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065144.985360:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec5180 00010000:00010000:1.0:1746065144.985370:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1600, rc 0) 00000100:00100000:3.0:1746065144.985371:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1254 00000100:00100000:3.0:1746065144.985376:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263376384:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065144.985405:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+19:32051:x1830881263375744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 19428us (21029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065144.985411:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12812 00000100:00100000:1.0:1746065144.985435:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3557 00000100:00100000:1.0:1746065144.985439:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881263376640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065144.997265:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.001927:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376768 00000100:00100000:1.0:1746065145.001941:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376768 00000100:00100000:1.0:1746065145.002022:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12814 00000100:00100000:1.0:1746065145.002034:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+22:32054:x1830881263376768:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065145.002053:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.002072:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f23 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.002101:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.002109:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.002111:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.002114:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.002147:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.002159:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 39 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065145.002172:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263278080:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065145.005309:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263376640:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19861us (20134us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065145.005324:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3557 00002000:00100000:0.0:1746065145.005334:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099ec5180 x1830881263376640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/440 e 0 to 0 dl 1746065155 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065145.005343:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5180 with x1830881263376640 ext(3145728->4194303) 00002000:00010000:0.0:1746065145.005348:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec5180 00000100:00080000:0.0:1746065145.005387:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065145.005674:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065145.006955:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263376384:12345-192.168.202.27@tcp:4:cat.0 Request processed in 21571us (22710us total) trans 17179873400 rc 0/0 00000100:00100000:2.0:1746065145.006966:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1254 00002000:00100000:2.0:1746065145.006975:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2891775) req@ffff880099ec5c00 x1830881263376384/t17179873400(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:60/0 lens 488/448 e 0 to 0 dl 1746065155 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.006993:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5c00 with x1830881263376384 ext(2097152->2891775) 00010000:00010000:2.0:1746065145.007002:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 36 pid: 9548 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.007014:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 36 pid: 9548 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065145.007020:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec5c00 00000100:00100000:1.0:1746065145.023877:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263278080:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.023906:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.023921:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:1.0:1746065145.023997:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+23:32054:x1830881263376768:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 21965us (26740us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.024005:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12814 00000100:00100000:0.0:1746065145.024679:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.024714:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.025893:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.025978:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376896 00000100:00100000:3.0:1746065145.025993:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376896 00010000:00010000:3.0:1746065145.026038:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 40 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.026060:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5726 00000100:00100000:3.0:1746065145.026066:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263376896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065145.026078:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065145.026094:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 40 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.026101:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 40 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.026121:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146e755 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f00 expref: 40 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.026137:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.026138:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.026144:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.026151:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.026175:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.026184:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263278208:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065145.026249:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065145.026407:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377152 00000100:00100000:2.0:1746065145.026411:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377152 00000100:00100000:2.0:1746065145.026433:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377024 00000100:00100000:2.0:1746065145.026434:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377024 00000100:00100000:2.0:1746065145.026446:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12815 00000100:00100000:2.0:1746065145.026450:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263377152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065145.026462:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065145.026472:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c55d200/0xad6b7ddc146e79b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f31 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.026489:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c55d200/0xad6b7ddc146e79b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f31 expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.026496:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c55d200/0xad6b7ddc146e79b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f31 expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.026506:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c55d200, rc 0) 00000100:00100000:2.0:1746065145.026525:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263377152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 74us (1810us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065145.026530:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12815 00000100:00100000:2.0:1746065145.026542:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12816 00000100:00100000:2.0:1746065145.026547:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263377024:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065145.026553:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065145.026560:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc146e7a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f2a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.026581:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263278336:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065145.026601:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23f8c00 going to sleep for 11 seconds 00000100:00080000:0.0:1746065145.026656:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065145.026659:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065145.036964:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.037050:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377280 00000100:00100000:2.0:1746065145.037059:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377280 00010000:00010000:2.0:1746065145.037087:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 36 pid: 9548 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.037121:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5727 00000100:00100000:2.0:1746065145.037127:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263377280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.037140:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065145.037152:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065144 -> 1746065145 00002000:00010000:2.0:1746065145.037155:0:8352:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065144 -> 1746065145 00010000:00010000:2.0:1746065145.037160:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 36 pid: 9548 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.037170:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 36 pid: 9548 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.037190:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc146e61a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->2891775) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e51 expref: 36 pid: 9548 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.037205:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.037207:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.037213:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.037219:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.037246:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.037257:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263278464:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065145.037327:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065145.038251:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263278336:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065145.038273:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc146e7a2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f2a expref: 41 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.038286:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc146e7a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f2a expref: 41 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.038293:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047000, rc 0) 00000100:00100000:2.0:1746065145.038318:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263377024:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11770us (12426us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065145.038324:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12816 00000100:00100000:3.0:1746065145.038384:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263278208:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065145.038393:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065145.038410:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263376896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12344us (13734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.038415:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5726 00000100:00100000:0.0:1746065145.041157:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.041655:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377536 00000100:00100000:2.0:1746065145.041663:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377536 00002000:00100000:2.0:1746065145.041696:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4157440->4161535) req@ffff88008c459f80 x1830881263377536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.041705:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459f80 with x1830881263377536 ext(4157440->4161535) 00002000:00010000:2.0:1746065145.041710:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459f80 00000100:00100000:2.0:1746065145.041725:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3558 00000100:00100000:2.0:1746065145.041731:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263377536:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065145.041855:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263377536:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 123us (705us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065145.041861:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3558 00002000:00100000:2.0:1746065145.041866:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4157440->4161535) req@ffff88008c459f80 x1830881263377536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.041872:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459f80 with x1830881263377536 ext(4157440->4161535) 00002000:00010000:2.0:1746065145.041875:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459f80 00000100:00100000:3.0:1746065145.041946:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263278464:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065145.041961:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065145.041994:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263377280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4856us (5034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.042005:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5727 00000100:00100000:0.0:1746065145.043941:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.044079:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377792 00000100:00100000:3.0:1746065145.044085:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377792 00002000:00100000:3.0:1746065145.044120:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88008c458380 x1830881263377792/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.044128:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458380 with x1830881263377792 ext(2097152->3145727) 00002000:00010000:3.0:1746065145.044132:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458380 00000100:00100000:3.0:1746065145.044160:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3559 00000100:00100000:3.0:1746065145.044167:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263377792:12345-192.168.202.27@tcp:3:multiop.0 00000100:00080000:1.0:1746065145.044377:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065145.047133:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.050546:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377920 00000100:00100000:3.0:1746065145.050558:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377920 00000100:00100000:3.0:1746065145.050607:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12817 00000100:00100000:3.0:1746065145.050614:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:32043:x1830881263377920:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065145.050631:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.050645:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f38 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.050670:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.050676:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065145.050678:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065145.050680:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->5021695] (req 4194304->5021695) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.050705:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.050716:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 22 pid: 10219 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.050726:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263278592:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.050814:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065145.054930:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263377792:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10755us (10987us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065145.054941:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3559 00002000:00100000:3.0:1746065145.054950:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88008c458380 x1830881263377792/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/440 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.054959:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458380 with x1830881263377792 ext(2097152->3145727) 00002000:00010000:3.0:1746065145.054964:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458380 00000100:00100000:0.0:1746065145.055566:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.055642:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263278592:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.055671:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->5021695] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.055688:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd80800, rc 0) 00000100:00100000:2.0:1746065145.056136:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378048 00000100:00100000:2.0:1746065145.056143:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378048 00002000:00100000:2.0:1746065145.056169:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4157440->4194303) req@ffff88008c459880 x1830881263378048/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.056177:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459880 with x1830881263378048 ext(4157440->4194303) 00010000:00010000:2.0:1746065145.056182:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 23 pid: 10219 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.056193:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 23 pid: 10219 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065145.056199:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c459880 00000100:00100000:2.0:1746065145.056223:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1255 00000100:00100000:2.0:1746065145.056229:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263378048:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065145.058643:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:32043:x1830881263377920:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8021us (11507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.058653:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12817 00000100:00100000:2.0:1746065145.067634:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263378048:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11396us (12060us total) trans 21474840843 rc 0/0 00000100:00100000:2.0:1746065145.067644:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1255 00002000:00100000:2.0:1746065145.067653:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4157440->4194303) req@ffff88008c459880 x1830881263378048/t21474840843(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/448 e 0 to 0 dl 1746065156 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.067661:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459880 with x1830881263378048 ext(4157440->4194303) 00010000:00010000:2.0:1746065145.067670:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 25 pid: 10219 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.067683:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 25 pid: 10219 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065145.067691:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c459880 00000100:00100000:0.0:1746065145.078680:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.078727:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.078807:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378176 00000100:00100000:3.0:1746065145.078815:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378176 00000100:00100000:3.0:1746065145.078848:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378304 00000100:00100000:3.0:1746065145.078850:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378304 00000100:00100000:3.0:1746065145.078875:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12818 00000100:00100000:3.0:1746065145.078882:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+25:32051:x1830881263378176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065145.078898:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.078914:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f3f expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.078937:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065145.078939:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065145.078943:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.078953:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.078961:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd80a00, rc 0) 00000100:00100000:3.0:1746065145.079007:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+26:32051:x1830881263378176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.079013:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12818 00000100:00100000:3.0:1746065145.079027:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12819 00000100:00100000:3.0:1746065145.079031:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+19:32054:x1830881263378304:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065145.079038:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.079045:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f46 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.079058:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.079068:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 20 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.079076:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.079081:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065145.079082:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065145.079084:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->3833855] (req 3145728->3833855) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.079107:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.079115:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 34 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.079126:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263278720:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.079184:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 20 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.079191:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 20 pid: 9548 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.079198:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263278848:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.079219:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.079226:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 20 pid: 10219 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.079232:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263278976:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.079247:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065145.080816:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.080888:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378432 00000100:00100000:3.0:1746065145.080892:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378432 00010000:00010000:3.0:1746065145.080912:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 26 pid: 10219 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.080931:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5728 00000100:00100000:3.0:1746065145.080937:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+26:2007:x1830881263378432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065145.080946:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065145.080961:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 26 pid: 10219 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.080969:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 26 pid: 10219 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.080995:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc146e794 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4157440->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f23 expref: 26 pid: 10219 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.081008:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.081010:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.081014:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.081021:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.081027:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.081029:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.081032:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.081037:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.081059:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.081068:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263279104:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065145.081495:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.081504:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263279232:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065145.081528:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065145.088931:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.088971:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.089058:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378688 00000100:00100000:2.0:1746065145.089066:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378688 00010000:00010000:2.0:1746065145.089094:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 21 pid: 9548 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.089115:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378560 00000100:00100000:2.0:1746065145.089117:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378560 00010000:00010000:2.0:1746065145.089126:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 35 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.089139:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5729 00000100:00100000:2.0:1746065145.089145:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263378688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.089155:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.089170:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 21 pid: 9548 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.089179:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 21 pid: 9548 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.089200:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.089234:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263378688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.089239:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5729 00000100:00100000:2.0:1746065145.089254:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5730 00000100:00100000:2.0:1746065145.089259:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881263378560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.089268:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.089275:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 35 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.089283:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 35 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.089293:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.089307:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881263378560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.089312:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5730 00010000:00010000:3.0:1746065145.089592:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146e78d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f1c expref: 34 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.089609:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263278720:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.089620:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146e621 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e58 expref: 20 pid: 9548 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.089627:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263278848:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065145.092832:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.093805:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378816 00000100:00100000:0.0:1746065145.093812:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378816 00010000:00010000:0.0:1746065145.093837:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 20 pid: 10219 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746065145.093858:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5731 00000100:00100000:0.0:1746065145.093864:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263378816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065145.093874:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065145.093887:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 20 pid: 10219 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065145.093897:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 20 pid: 10219 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746065145.093914:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065145.093916:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065145.093920:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065145.093927:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065145.093951:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065145.093960:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263279360:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065145.094029:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988463c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065145.094293:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1600/0xad6b7ddc146e786 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f15 expref: 20 pid: 10219 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.094303:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263278976:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.094321:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.094328:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd81e00, rc 0) 00000100:00100000:3.0:1746065145.095365:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+19:32054:x1830881263378304:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 16329us (16634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.095373:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12819 00000100:00100000:0.0:1746065145.107559:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.107880:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263279104:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065145.107889:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263279232:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065145.107902:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065145.108138:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263378432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 27199us (27324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.108147:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5728 00000100:00100000:0.0:1746065145.126142:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.126268:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379072 00000100:00100000:1.0:1746065145.126276:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379072 00002000:00100000:1.0:1746065145.126313:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800983b8e00 x1830881263379072/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065145.126323:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8e00 with x1830881263379072 ext(3145728->4194303) 00002000:00010000:1.0:1746065145.126327:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b8e00 00000100:00100000:1.0:1746065145.126341:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379328 00000100:00100000:1.0:1746065145.126343:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379328 00002000:00100000:1.0:1746065145.126352:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff8800983bbb80 x1830881263379328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065145.126358:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bbb80 with x1830881263379328 ext(4194304->5021695) 00002000:00010000:1.0:1746065145.126361:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bbb80 00000100:00100000:1.0:1746065145.126386:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3560 00000100:00100000:1.0:1746065145.126393:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+25:2006:x1830881263379072:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065145.126967:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3561 00000100:00100000:0.0:1746065145.126975:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263379328:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065145.133795:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263279360:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065145.133816:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.133851:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263378816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39986us (41083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.133861:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5731 00000100:00100000:0.0:1746065145.143448:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.143531:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379584 00000100:00100000:2.0:1746065145.143539:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379584 00002000:00100000:2.0:1746065145.143572:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3829760->3833855) req@ffff8800983b8000 x1830881263379584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.143582:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8000 with x1830881263379584 ext(3829760->3833855) 00002000:00010000:2.0:1746065145.143587:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983b8000 00000100:00100000:2.0:1746065145.143612:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3562 00000100:00100000:2.0:1746065145.143619:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263379584:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065145.143721:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263379584:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 102us (281us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065145.143727:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3562 00002000:00100000:2.0:1746065145.143731:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3829760->3833855) req@ffff8800983b8000 x1830881263379584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.143737:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8000 with x1830881263379584 ext(3829760->3833855) 00002000:00010000:2.0:1746065145.143740:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983b8000 00000100:00100000:1.0:1746065145.143891:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+25:2006:x1830881263379072:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17499us (36339us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065145.143901:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3560 00002000:00100000:1.0:1746065145.143905:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800983b8e00 x1830881263379072/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/440 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065145.143911:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8e00 with x1830881263379072 ext(3145728->4194303) 00002000:00010000:1.0:1746065145.143914:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b8e00 00000100:00100000:3.0:1746065145.150549:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263379328:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23565us (24404us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065145.150559:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3561 00002000:00100000:3.0:1746065145.150571:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff8800983bbb80 x1830881263379328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/440 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.150579:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bbb80 with x1830881263379328 ext(4194304->5021695) 00002000:00010000:3.0:1746065145.150584:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bbb80 00000100:00100000:0.0:1746065145.154351:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.154410:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.154510:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380096 00000100:00100000:2.0:1746065145.154518:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380096 00000100:00100000:2.0:1746065145.154578:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4875 00000100:00100000:2.0:1746065145.154586:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+20:32054:x1830881263380096:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065145.154764:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+21:32054:x1830881263380096:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 179us (352us total) trans 8589935878 rc 0/0 00000100:00100000:2.0:1746065145.154795:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4875 00000100:00100000:3.0:1746065145.154939:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379840 00000100:00100000:3.0:1746065145.154944:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379840 00002000:00100000:3.0:1746065145.154971:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (3833856->4194303) req@ffff8800983ba680 x1830881263379840/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.154992:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983ba680 with x1830881263379840 ext(3833856->4194303) 00002000:00010000:3.0:1746065145.155006:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983ba680 00000100:00100000:3.0:1746065145.155020:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3563 00000100:00100000:3.0:1746065145.155025:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263379840:12345-192.168.202.27@tcp:3:multiop.0 00000100:00080000:1.0:1746065145.155647:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065145.161702:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.161818:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380224 00000100:00100000:3.0:1746065145.161826:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380224 00000100:00100000:3.0:1746065145.161866:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12820 00000100:00100000:3.0:1746065145.161873:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263380224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065145.161887:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.161901:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146e7be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f4d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.161944:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263279488:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065145.162049:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065145.163999:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263379840:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8968us (9652us total) trans 0 rc 360448/360448 00000100:00100000:3.0:1746065145.164008:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3563 00002000:00100000:3.0:1746065145.164017:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (3833856->4194303) req@ffff8800983ba680 x1830881263379840/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/440 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 360448/360448 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.164025:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983ba680 with x1830881263379840 ext(3833856->4194303) 00002000:00010000:3.0:1746065145.164029:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983ba680 00002000:00010000:3.0:1746065145.169952:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065144 -> 1746065145 00000100:00100000:3.0:1746065145.169973:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263279488:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065145.170009:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146e7be lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f4d expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.170022:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146e7be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f4d expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.172044:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539a00, rc 0) 00000100:00100000:3.0:1746065145.172103:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263380224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10228us (10405us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065145.172111:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12820 00000100:00100000:0.0:1746065145.173487:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.175678:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380352 00000100:00100000:3.0:1746065145.175687:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380352 00000100:00100000:1.0:1746065145.175790:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12821 00000100:00100000:1.0:1746065145.175803:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+40:32056:x1830881263380352:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065145.175819:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.175834:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f54 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.175866:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.175877:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.175884:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 24 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.175888:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.175890:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.175892:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.175923:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 24 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.175932:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 24 pid: 11461 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746065145.175941:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263279616:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.178949:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.178963:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 10 pid: 9550 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746065145.178974:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263279744:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.179027:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.179035:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 41 pid: 3067 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746065145.179041:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263279872:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.179056:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065145.179687:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.179737:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.179786:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380736 00000100:00100000:3.0:1746065145.179791:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380608 00000100:00100000:2.0:1746065145.179793:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380736 00000100:00100000:3.0:1746065145.179795:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380608 00000100:00100000:2.0:1746065145.179823:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12822 00002000:00100000:3.0:1746065145.179824:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097d05180 x1830881263380608/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065145.179829:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263380736:12345-192.168.202.27@tcp:101:cat.0 00002000:00100000:3.0:1746065145.179833:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05180 with x1830881263380608 ext(4194304->5021695) 00002000:00010000:3.0:1746065145.179836:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d05180 00010000:00010000:2.0:1746065145.179839:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065145.179847:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3564 00000100:00100000:3.0:1746065145.179851:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263380608:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065145.179851:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc146e7cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f5b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.179881:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263280000:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065145.179908:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065145.185297:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263279616:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.185308:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263279744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.185316:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263279872:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.185343:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.185359:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a200, rc 0) 00000100:00100000:1.0:1746065145.185412:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+41:32056:x1830881263380352:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9613us (11927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.185419:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12821 00000100:00100000:0.0:1746065145.187968:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.190291:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.191468:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380864 00000100:00100000:2.0:1746065145.191477:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380864 00010000:00010000:2.0:1746065145.191507:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 27 pid: 11461 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.191532:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381120 00000100:00100000:2.0:1746065145.191535:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381120 00010000:00010000:2.0:1746065145.191545:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 41 pid: 3067 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.191559:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5732 00000100:00100000:2.0:1746065145.191565:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263380864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.191576:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.191590:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 27 pid: 11461 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.191600:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 27 pid: 11461 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.191617:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5800/0xad6b7ddc146e44c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d2b expref: 27 pid: 11461 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.191631:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.191662:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263380864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (3700us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.191667:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5732 00000100:00100000:2.0:1746065145.191679:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5733 00000100:00100000:2.0:1746065145.191682:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263381120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.191687:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.191692:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 41 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.191699:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 41 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.191707:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8200/0xad6b7ddc146e3f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cec expref: 41 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.191713:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.191722:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263381120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.191726:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5733 00000100:00100000:2.0:1746065145.192818:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.192836:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380992 00000100:00100000:2.0:1746065145.192839:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380992 00010000:00010000:2.0:1746065145.192860:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 11 pid: 9550 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.192875:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5734 00000100:00100000:2.0:1746065145.192879:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263380992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.192886:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.192893:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 11 pid: 9550 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.192902:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 11 pid: 9550 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.192917:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f47600/0xad6b7ddc146e4fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d9b expref: 11 pid: 9550 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.192926:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.192928:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.192933:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.192940:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.192963:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.192973:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263280128:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065145.193023:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23f8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065145.193643:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263380608:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13789us (13956us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065145.193651:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3564 00002000:00100000:3.0:1746065145.193659:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097d05180 x1830881263380608/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/440 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.193668:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05180 with x1830881263380608 ext(4194304->5021695) 00002000:00010000:3.0:1746065145.193672:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d05180 00000100:00100000:3.0:1746065145.193722:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263280000:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065145.193746:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc146e7cc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f5b expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.193755:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc146e7cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f5b expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.193786:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31a00, rc 0) 00000100:00100000:3.0:1746065145.193805:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263380736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 13976us (14068us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065145.193811:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12822 00000100:00080000:0.0:1746065145.194726:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065145.197117:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263280128:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065145.197133:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065145.197178:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263380992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4297us (4360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.197187:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5734 00000100:00100000:2.0:1746065145.199569:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.199636:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381376 00000100:00100000:3.0:1746065145.199643:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381376 00002000:00100000:3.0:1746065145.199675:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1699840->1703935) req@ffff880091b67800 x1830881263381376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.199683:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67800 with x1830881263381376 ext(1699840->1703935) 00002000:00010000:3.0:1746065145.199687:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b67800 00000100:00100000:3.0:1746065145.199700:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3565 00000100:00100000:3.0:1746065145.199705:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263381376:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065145.199832:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263381376:12345-192.168.202.27@tcp:3:cat.0 Request processed in 126us (268us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065145.199838:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3565 00002000:00100000:3.0:1746065145.199843:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1699840->1703935) req@ffff880091b67800 x1830881263381376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.199849:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67800 with x1830881263381376 ext(1699840->1703935) 00002000:00010000:3.0:1746065145.199851:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b67800 00000100:00100000:1.0:1746065145.206149:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.206183:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.206192:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381632 00000100:00100000:3.0:1746065145.206201:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381632 00000100:00100000:1.0:1746065145.206223:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.206264:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381888 00000100:00100000:2.0:1746065145.206268:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381888 00000100:00100000:2.0:1746065145.206312:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4876 00000100:00100000:2.0:1746065145.206319:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+41:32043:x1830881263381888:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065145.206468:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+42:32043:x1830881263381888:12345-192.168.202.27@tcp:35:cat.0 Request processed in 149us (244us total) trans 8589935879 rc 0/0 00000100:00100000:2.0:1746065145.206474:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4876 00000100:00080000:1.0:1746065145.206687:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065145.206710:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381760 00000100:00100000:3.0:1746065145.206713:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381760 00000100:00100000:3.0:1746065145.206727:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12823 00000100:00100000:3.0:1746065145.206731:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:32056:x1830881263381632:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065145.206739:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.206752:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f62 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206771:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206797:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206803:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206809:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206814:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065145.206815:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065145.206818:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 7/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->2523135] (req 2097152->2523135) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206838:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206846:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 24 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.206855:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263280256:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.206902:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206909:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 41 pid: 12260 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.206917:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263280384:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.206935:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206941:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 24 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.206948:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263280512:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.206961:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.206967:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 41 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.206972:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263280640:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.206994:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065145.207132:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12824 00000100:00100000:0.0:1746065145.207139:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263381760:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065145.207145:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065145.207151:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e7da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f69 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065145.207171:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263280768:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065145.207192:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065145.215900:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263280256:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.215914:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263280384:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.215919:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263280512:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.215926:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263280640:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.215958:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->2523135] (req 2097152->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.215977:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835dc00, rc 0) 00000100:00100000:3.0:1746065145.216039:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:32056:x1830881263381632:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9305us (9899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.216046:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12823 00002000:00010000:1.0:1746065145.216571:0:12258:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746065141 -> 1746065145 00002000:00010000:1.0:1746065145.216575:0:12258:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065141 -> 1746065145 00002000:00010000:1.0:1746065145.216577:0:12258:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746065141 -> 1746065145 00000100:00100000:1.0:1746065145.216590:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263280768:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065145.216609:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e7da lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f69 expref: 25 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.216617:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e7da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f69 expref: 25 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.216628:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc800, rc 0) 00000100:00100000:1.0:1746065145.216652:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263381760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9514us (10469us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065145.216657:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12824 00000100:00100000:2.0:1746065145.220121:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.220142:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.220164:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.220179:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382016 00000100:00100000:2.0:1746065145.220185:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382016 00010000:00010000:2.0:1746065145.220210:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 24 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.220228:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382272 00000100:00100000:2.0:1746065145.220230:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382272 00010000:00010000:2.0:1746065145.220237:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 41 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.220245:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382144 00000100:00100000:2.0:1746065145.220247:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382144 00010000:00010000:2.0:1746065145.220252:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 42 pid: 12260 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.220262:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5735 00000100:00100000:2.0:1746065145.220267:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263382016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.220279:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.220293:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 24 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220302:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 24 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220320:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047e00/0xad6b7ddc146e75c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f07 expref: 24 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220337:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.220366:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263382016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.220372:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5735 00000100:00100000:2.0:1746065145.220384:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5736 00000100:00100000:2.0:1746065145.220389:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263382272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.220402:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.220408:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 42 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220415:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 42 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220425:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd80800/0xad6b7ddc146e7a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f38 expref: 42 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220432:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.220444:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263382272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.220449:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5736 00000100:00100000:2.0:1746065145.220480:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5737 00000100:00100000:2.0:1746065145.220484:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263382144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.220490:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.220495:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 40 pid: 12260 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220502:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 40 pid: 12260 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220511:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146e6f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ed6 expref: 40 pid: 12260 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220518:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.220536:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263382144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.220540:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5737 00000100:00100000:2.0:1746065145.220571:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.220584:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382400 00000100:00100000:2.0:1746065145.220587:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382400 00010000:00010000:2.0:1746065145.220595:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 23 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.220608:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5738 00000100:00100000:2.0:1746065145.220612:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263382400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.220618:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.220625:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 23 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220633:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 23 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220642:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e7b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f3f expref: 23 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.220650:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.220652:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.220657:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.220664:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.220689:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.220700:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263280896:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065145.220737:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065145.220810:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.220935:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382528 00000100:00100000:0.0:1746065145.220939:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382528 00000100:00100000:0.0:1746065145.220959:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12825 00000100:00100000:0.0:1746065145.220963:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+23:32051:x1830881263382528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065145.220974:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065145.220993:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f70 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065145.221007:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065145.221012:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065145.221013:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065145.221016:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [5017600->5242879] (req 5017600->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065145.221029:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065145.221038:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 38 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746065145.221046:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263281024:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065145.221071:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065145.224785:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263280896:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065145.224804:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065145.224841:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263382400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4226us (4268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065145.224849:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5738 00000100:00100000:1.0:1746065145.224934:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263281024:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.224953:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [5017600->5242879] (req 5017600->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.224968:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc000, rc 0) 00000100:00100000:1.0:1746065145.224996:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+23:32051:x1830881263382528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4032us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.225002:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12825 00000100:00100000:0.0:1746065145.229383:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.229432:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382784 00000100:00100000:2.0:1746065145.229440:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382784 00002000:00100000:2.0:1746065145.229476:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2519040->2523135) req@ffff880090dd8a80 x1830881263382784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.229485:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8a80 with x1830881263382784 ext(2519040->2523135) 00010000:00010000:2.0:1746065145.229492:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 39 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.229503:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 39 pid: 1880 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065145.229509:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dd8a80 00000100:00100000:2.0:1746065145.229539:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1256 00000100:00100000:2.0:1746065145.229545:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263382784:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065145.229665:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263382784:12345-192.168.202.27@tcp:3:cat.0 Request processed in 120us (372us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065145.229671:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1256 00002000:00100000:2.0:1746065145.229676:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2519040->2523135) req@ffff880090dd8a80 x1830881263382784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746065156 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.229682:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8a80 with x1830881263382784 ext(2519040->2523135) 00010000:00010000:2.0:1746065145.229687:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 39 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.229694:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 39 pid: 1880 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065145.229699:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dd8a80 00000100:00100000:0.0:1746065145.235692:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.235714:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383040 00000100:00100000:2.0:1746065145.235721:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383040 00002000:00100000:2.0:1746065145.235755:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2523135) req@ffff880090dd9c00 x1830881263383040/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.235763:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9c00 with x1830881263383040 ext(2097152->2523135) 00010000:00010000:2.0:1746065145.235787:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 39 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.235801:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 39 pid: 1880 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065145.235812:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dd9c00 00000100:00100000:2.0:1746065145.235838:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1257 00000100:00100000:2.0:1746065145.235846:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263383040:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065145.244123:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263383040:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8269us (8430us total) trans 21474840844 rc 0/0 00000100:00100000:2.0:1746065145.244135:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1257 00002000:00100000:2.0:1746065145.244145:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2523135) req@ffff880090dd9c00 x1830881263383040/t21474840844(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/448 e 0 to 0 dl 1746065156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.244154:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9c00 with x1830881263383040 ext(2097152->2523135) 00010000:00010000:2.0:1746065145.244164:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 41 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.244178:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 41 pid: 1880 timeout: 841 lvb_type: 0 00002000:00010000:2.0:1746065145.244185:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dd9c00 00000100:00100000:0.0:1746065145.247038:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.248960:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383168 00000100:00100000:2.0:1746065145.248970:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383168 00010000:00010000:2.0:1746065145.249010:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 41 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.249042:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5739 00000100:00100000:2.0:1746065145.249050:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263383168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.249062:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.249078:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 41 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.249088:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 41 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.249106:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835dc00/0xad6b7ddc146e7d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f62 expref: 41 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.249120:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.249121:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.249127:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.249134:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.249159:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.249169:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263281152:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065145.249246:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065145.252046:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263281152:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065145.252066:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.252101:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263383168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3052us (5069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.252110:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5739 00000100:00100000:0.0:1746065145.252192:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.252521:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383296 00000100:00100000:1.0:1746065145.252527:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383296 00000100:00100000:1.0:1746065145.252555:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12826 00000100:00100000:1.0:1746065145.252561:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263383296:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065145.252575:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.252588:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f77 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065145.252629:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263281280:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065145.252680:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065145.255165:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263281280:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065145.255191:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7e8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f77 expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.255207:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f77 expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.255227:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7fa00, rc 0) 00000100:00100000:1.0:1746065145.255268:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263383296:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2706us (3076us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065145.255275:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12826 00000100:00100000:0.0:1746065145.257108:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.257282:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383552 00000100:00100000:2.0:1746065145.257289:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383552 00002000:00100000:2.0:1746065145.257425:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880090ddaa00 x1830881263383552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.257434:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddaa00 with x1830881263383552 ext(5017600->5021695) 00002000:00010000:2.0:1746065145.257439:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddaa00 00000100:00100000:2.0:1746065145.257466:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3566 00000100:00100000:2.0:1746065145.257474:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263383552:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065145.257600:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263383552:12345-192.168.202.27@tcp:3:cat.0 Request processed in 126us (498us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065145.257607:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3566 00002000:00100000:2.0:1746065145.257612:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880090ddaa00 x1830881263383552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746065156 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065145.257617:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddaa00 with x1830881263383552 ext(5017600->5021695) 00002000:00010000:2.0:1746065145.257620:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddaa00 00000100:00100000:0.0:1746065145.271578:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.271664:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383680 00000100:00100000:1.0:1746065145.271671:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383680 00000100:00080000:2.0:1746065145.271846:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065145.271925:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13559 00000100:00100000:1.0:1746065145.271933:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32061:x1830881263383680:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065145.271955:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.271969:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e600/0xad6b7ddc146e7ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f7e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.272029:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.272040:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.272050:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.272061:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.272066:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.272071:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.272129:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.272139:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 41 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.272144:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.272169:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 41 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.272180:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 41 pid: 7231 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065145.272190:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263281408:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.274875:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065145.277086:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.277400:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263281408:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.277419:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065145.278331:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383936 00000100:00100000:2.0:1746065145.278338:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383936 00000100:00100000:2.0:1746065145.278377:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4877 00000100:00100000:2.0:1746065145.278384:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+42:31232:x1830881263383936:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065145.279184:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+43:31232:x1830881263383936:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 798us (2104us total) trans 8589935880 rc 0/0 00000100:00100000:2.0:1746065145.279191:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4877 00000100:00100000:0.0:1746065145.281394:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.281524:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384064 00000100:00100000:2.0:1746065145.281532:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384064 00010000:00010000:2.0:1746065145.281563:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 43 pid: 7231 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.281675:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5740 00000100:00100000:2.0:1746065145.281683:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263384064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.281696:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.281700:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 43 pid: 7231 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.281718:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 43 pid: 7231 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.281736:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc146e5c6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e0b expref: 43 pid: 7231 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.281748:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065145.281752:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065145.281760:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065145.281769:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065145.282171:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065145.282183:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282190:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065145.282207:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263384064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 525us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.282213:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5740 00000004:00200000:1.0:1746065145.282425:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065145.282430:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065145.282447:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282455:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282463:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282467:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282472:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282477:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282482:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7f000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065145.282485:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282491:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282499:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065145.282501:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065145.282504:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282508:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146e7f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282537:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282542:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282547:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282550:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065145.282553:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282557:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282563:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5900) 00010000:00010000:1.0:1746065145.282565:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065145.282567:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282571:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146e7fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.282599:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e600/0xad6b7ddc146e7ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.282609:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.282614:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065145.282616:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065145.282617:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd80a00, rc 0) 00000100:00100000:1.0:1746065145.282654:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32061:x1830881263383680:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 10722us (11084us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.282660:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13559 00000100:00100000:0.0:1746065145.285252:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.285288:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.285933:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.286186:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.286206:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384192 00000100:00100000:1.0:1746065145.286215:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384192 00000100:00100000:1.0:1746065145.286270:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384448 00000100:00100000:1.0:1746065145.286272:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384448 00000100:00080000:3.0:1746065145.286281:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065145.286283:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384320 00000100:00100000:1.0:1746065145.286285:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384320 00000100:00100000:1.0:1746065145.286298:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12827 00000100:00100000:1.0:1746065145.286305:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263384192:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:3.0:1746065145.286307:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12828 00000100:00100000:3.0:1746065145.286315:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263384448:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065145.286320:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.286323:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.286334:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f93 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.286335:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f85 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.286354:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.286354:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.286355:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.286355:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.286362:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.286362:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.286374:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.286374:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.286384:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8000, rc 0) 00010000:00010000:1.0:1746065145.286384:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a800, rc 0) 00000100:00100000:3.0:1746065145.286439:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263384448:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 125us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.286444:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12828 00000100:00100000:3.0:1746065145.286460:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12829 00000100:00100000:3.0:1746065145.286465:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263384320:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065145.286471:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.286477:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9c00/0xad6b7ddc146e819 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f8c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.286509:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263281536:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065145.286549:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065145.286975:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384576 00000100:00100000:2.0:1746065145.286989:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384576 00000100:00100000:2.0:1746065145.287008:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12830 00000100:00100000:2.0:1746065145.287012:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263384576:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065145.287019:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065145.287025:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146e820 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932f9a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.287045:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263281664:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065145.287065:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065145.287441:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263384192:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1135us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.287447:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12827 00000100:00100000:3.0:1746065145.290093:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263281536:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065145.290125:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9c00/0xad6b7ddc146e819 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f8c expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.290139:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9c00/0xad6b7ddc146e819 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f8c expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.290152:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9c00, rc 0) 00000100:00100000:3.0:1746065145.290184:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263384320:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3719us (4253us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065145.290296:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263281664:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065145.290313:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146e820 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f9a expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.290321:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146e820 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f9a expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.290328:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:3.0:1746065145.290519:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12829 00000100:00100000:2.0:1746065145.290526:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263384576:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3512us (4340us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065145.290531:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12830 00000100:00100000:0.0:1746065145.294365:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.294567:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384832 00000100:00100000:1.0:1746065145.294575:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384832 00000100:00100000:1.0:1746065145.294623:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13560 00000100:00100000:1.0:1746065145.294630:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32061:x1830881263384832:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065145.294646:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.294661:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc146e827 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fa1 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.294741:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.294753:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.294759:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.294813:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.294823:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 10 pid: 7203 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065145.294833:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263281792:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.294907:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065145.297916:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.298011:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384960 00000100:00100000:2.0:1746065145.298018:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384960 00010000:00010000:2.0:1746065145.298047:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 11 pid: 7203 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.298071:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5741 00000100:00100000:2.0:1746065145.298078:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263384960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.298094:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.298098:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 11 pid: 7203 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.298108:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 11 pid: 7203 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.298127:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065145.298131:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065145.298138:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065145.298144:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065145.298158:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.298194:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263384960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.298199:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5741 00010000:00010000:1.0:1746065145.298285:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd80a00/0xad6b7ddc146e804 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f7e expref: 10 pid: 7203 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065145.298312:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263281792:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.298330:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.298336:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.298341:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065145.298357:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065145.298457:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc146e827 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fa1 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.298469:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fa1 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.298475:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065145.298477:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065145.298479:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ba00, rc 0) 00000100:00100000:1.0:1746065145.298515:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32061:x1830881263384832:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3885us (4158us total) trans 8589935881 rc 0/0 00000100:00100000:1.0:1746065145.298520:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13560 00000100:00100000:0.0:1746065145.301070:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.301157:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385216 00000100:00100000:1.0:1746065145.301163:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385216 00000100:00100000:1.0:1746065145.301205:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13561 00000100:00100000:1.0:1746065145.301213:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32061:x1830881263385216:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065145.301230:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.301233:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065145.301251:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc146e82e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fa1 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.301263:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065145.301266:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065145.301274:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146e83c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fa8 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.301497:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146e843 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.301508:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146e843 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065145.301515:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146e843 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065145.301523:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065145.301594:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146e83c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fa8 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.301604:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146e843 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fa8 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.301609:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065145.301611:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065145.301613:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:1.0:1746065145.301921:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32061:x1830881263385216:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 709us (857us total) trans 8589935882 rc 0/0 00000100:00100000:1.0:1746065145.301927:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13561 00000100:00100000:0.0:1746065145.303795:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.303871:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385344 00000100:00100000:1.0:1746065145.303877:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385344 00000100:00100000:1.0:1746065145.303923:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13562 00000100:00100000:1.0:1746065145.303930:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32061:x1830881263385344:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065145.303949:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.303964:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857e00/0xad6b7ddc146e851 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932faf expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.304014:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857e00/0xad6b7ddc146e851 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932faf expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.304024:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857e00/0xad6b7ddc146e851 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932faf expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.304037:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065145.304040:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065145.304042:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857e00, rc 0) 00000100:00100000:1.0:1746065145.304087:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32061:x1830881263385344:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 157us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.304092:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13562 00000100:00100000:0.0:1746065145.306372:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.306596:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.306621:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.306704:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.307336:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385472 00000100:00100000:2.0:1746065145.307336:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385728 00000100:00100000:3.0:1746065145.307344:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385472 00000100:00100000:2.0:1746065145.307344:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385728 00000100:00100000:3.0:1746065145.307373:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385984 00000100:00100000:2.0:1746065145.307374:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385600 00000100:00100000:3.0:1746065145.307375:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385984 00000100:00100000:2.0:1746065145.307376:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385600 00000100:00100000:2.0:1746065145.307387:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12831 00000100:00100000:2.0:1746065145.307393:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263385472:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:1.0:1746065145.307398:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12832 00000100:00100000:1.0:1746065145.307404:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263385728:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065145.307426:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.307426:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307441:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 39 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.307441:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 33 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.307447:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307448:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307455:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.307455:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307460:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.307460:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.307461:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.307461:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.307464:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.307464:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307485:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.307485:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307495:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 22 pid: 11461 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746065145.307495:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 17 pid: 1880 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.307506:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263282048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.307506:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263281920:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065145.307567:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065145.307567:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307574:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 12 pid: 9550 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746065145.307574:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 9 pid: 12258 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746065145.307581:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263282176:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065145.307586:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263282304:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.307600:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 33 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307604:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 39 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307611:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 39 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746065145.307611:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 33 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.307618:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263282560:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.307618:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263282432:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065145.307629:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065145.307629:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099e4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065145.307676:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12833 00000100:00100000:3.0:1746065145.307681:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12834 00000100:00100000:2.0:1746065145.307681:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263385600:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:3.0:1746065145.307686:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263385984:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065145.307697:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307697:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307706:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 33 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.307709:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307712:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.307715:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307718:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 17 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.307720:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.307721:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.307722:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.307723:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 5/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307724:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.307726:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.307736:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307736:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 17 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.307743:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 12 pid: 9548 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.307743:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 17 pid: 12258 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746065145.307750:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263282688:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065145.307750:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263282816:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.307788:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307791:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.307795:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 22 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.307797:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 9 pid: 12258 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746065145.307803:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263282944:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065145.307804:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263283072:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.307821:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00010000:00010000:2.0:1746065145.307829:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 33 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.307835:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 33 pid: 3067 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.307841:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263283200:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065145.307851:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065145.307865:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.307877:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385856 00000100:00100000:2.0:1746065145.307880:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385856 00000100:00100000:2.0:1746065145.307902:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12835 00000100:00100000:2.0:1746065145.307906:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263385856:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065145.307919:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307928:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.307932:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065145.307933:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065145.307934:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065145.307936:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.307942:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386112 00000100:00100000:3.0:1746065145.307944:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386112 00010000:00010000:2.0:1746065145.307949:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 39 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.307956:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 39 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.307957:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12836 00000100:00100000:3.0:1746065145.307960:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263386112:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065145.307963:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263283328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.307973:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.307977:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065145.307994:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.307999:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065145.308000:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065145.308002:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.308015:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.308023:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 17 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.308029:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263283456:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.308043:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065145.312525:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263281920:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065145.312574:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263282048:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065145.316218:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263282304:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065145.316334:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263282560:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065145.316349:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065145.316360:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065145.316371:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386368 00000100:00100000:0.0:1746065145.316377:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386368 00010000:00010000:0.0:1746065145.316403:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 14 pid: 9550 timeout: 841 lvb_type: 1 00000100:00100000:0.0:1746065145.316429:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5742 00000100:00100000:0.0:1746065145.316435:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263386368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065145.316445:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065145.316472:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 14 pid: 9550 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746065145.316544:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263282816:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.316679:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263282176:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065145.316689:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263282432:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065145.316713:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065145.317681:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 14 pid: 9550 timeout: 841 lvb_type: 1 00010000:00010000:0.0:1746065145.317703:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46e00/0xad6b7ddc146e4df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d86 expref: 14 pid: 9550 timeout: 841 lvb_type: 1 00010000:00010000:0.0:1746065145.317727:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065145.318139:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263386368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1702us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065145.318147:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5742 00000100:00100000:1.0:1746065145.318218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.318290:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.318320:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.318336:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386496 00000100:00100000:1.0:1746065145.318340:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386496 00010000:00010000:1.0:1746065145.318359:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 23 pid: 11461 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746065145.318375:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386752 00000100:00100000:1.0:1746065145.318377:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386752 00010000:00010000:1.0:1746065145.318387:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 18 pid: 12258 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746065145.318399:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386240 00000100:00100000:1.0:1746065145.318401:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386240 00010000:00010000:1.0:1746065145.318409:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 11 pid: 12258 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746065145.318421:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5743 00000100:00100000:1.0:1746065145.318426:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263386496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065145.318434:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065145.318448:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 23 pid: 11461 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746065145.318453:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065145.318456:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 23 pid: 11461 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746065145.318467:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc146e445 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d16 expref: 23 pid: 11461 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746065145.318485:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065145.318490:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263282688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.318533:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263282944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.318549:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.318603:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.318613:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.318624:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.318642:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.318643:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386624 00000100:00100000:2.0:1746065145.318647:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386624 00000100:00100000:3.0:1746065145.318652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065145.318661:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 40 pid: 3067 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746065145.318662:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.318673:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386880 00000100:00100000:2.0:1746065145.318675:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386880 00010000:00010000:2.0:1746065145.318682:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 23 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.318689:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387008 00000100:00100000:2.0:1746065145.318690:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387008 00000100:00100000:3.0:1746065145.318698:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263283456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.318708:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.318731:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.318745:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387648 00000100:00100000:3.0:1746065145.318748:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387648 00002000:00100000:3.0:1746065145.318769:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1699840->2097151) req@ffff88009a6dca80 x1830881263387648/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.318796:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881263387648 ext(1699840->2097151) 00010000:00010000:3.0:1746065145.318802:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.318814:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065145.318820:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6dca80 00000100:00100000:3.0:1746065145.318832:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1258 00000100:00100000:3.0:1746065145.318837:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263387648:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:2.0:1746065145.318894:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 12 pid: 12258 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.318906:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387136 00000100:00100000:2.0:1746065145.318909:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387136 00010000:00010000:2.0:1746065145.319187:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 13 pid: 9548 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.319198:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387264 00000100:00100000:2.0:1746065145.319200:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387264 00010000:00010000:2.0:1746065145.319209:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 34 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.319216:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387392 00000100:00100000:2.0:1746065145.319218:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387392 00010000:00010000:2.0:1746065145.319224:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 35 pid: 3067 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.319231:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387520 00000100:00100000:2.0:1746065145.319233:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387520 00010000:00010000:2.0:1746065145.319240:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 19 pid: 1880 timeout: 841 lvb_type: 1 00000100:00100000:2.0:1746065145.319248:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5744 00000100:00100000:2.0:1746065145.319252:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263386752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.319258:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.319269:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 19 pid: 12258 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319276:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 19 pid: 12258 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319288:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc146e43e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d1d expref: 19 pid: 12258 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319300:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.319316:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263386752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.319321:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5744 00000100:00100000:2.0:1746065145.319331:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5745 00000100:00100000:2.0:1746065145.319335:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263386240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.319340:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.319346:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 12 pid: 12258 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319352:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 12 pid: 12258 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319361:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a800/0xad6b7ddc146e80b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f85 expref: 12 pid: 12258 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319368:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.319378:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263386240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.319382:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5745 00000100:00100000:2.0:1746065145.319389:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5746 00000100:00100000:2.0:1746065145.319393:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263386624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.319397:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.319403:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 42 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319409:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 42 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319419:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc146e3dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cd7 expref: 42 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319425:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.319426:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.319431:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319437:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319452:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.319464:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263386624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.319466:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.319468:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5746 00000100:00100000:2.0:1746065145.319477:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5747 00000100:00100000:2.0:1746065145.319481:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263386880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.319486:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.319494:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 23 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.319500:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 23 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.319510:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146e7e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f70 expref: 23 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.319516:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065145.319525:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387776 00000100:00100000:3.0:1746065145.319528:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387776 00000100:00100000:2.0:1746065145.319531:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263386880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.319536:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5747 00002000:00100000:3.0:1746065145.319544:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3833855) req@ffff88008c45aa00 x1830881263387776/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/0 e 0 to 0 dl 1746065156 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065145.319546:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5748 00000100:00100000:2.0:1746065145.319550:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263387008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746065145.319552:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45aa00 with x1830881263387776 ext(3145728->3833855) 00010000:00010000:2.0:1746065145.319556:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065145.319557:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 18 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.319562:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 10 pid: 12258 timeout: 841 lvb_type: 1 00010000:00010000:3.0:1746065145.319565:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 18 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.319568:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 10 pid: 12258 timeout: 841 lvb_type: 1 00002000:00010000:3.0:1746065145.319571:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c45aa00 00010000:00010000:2.0:1746065145.319575:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.319585:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263387008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 35us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.319589:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1259 00000100:00100000:2.0:1746065145.319589:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5748 00000100:00100000:3.0:1746065145.319594:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263387776:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065145.319598:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5749 00000100:00100000:2.0:1746065145.319602:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263387136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.319608:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.319614:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 13 pid: 9548 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319619:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 13 pid: 9548 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319627:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146e812 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f93 expref: 13 pid: 9548 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319633:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.319635:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.319637:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319644:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319657:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.319669:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263387136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.319673:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5749 00000100:00100000:2.0:1746065145.319681:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5750 00000100:00100000:2.0:1746065145.319684:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263387264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065145.319685:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319689:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.319694:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 35 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.319696:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319701:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 35 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.319709:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319710:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577b000/0xad6b7ddc146e6b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932eb3 expref: 35 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.319715:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319717:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065145.319721:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.319726:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800727a8a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065145.319729:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.319729:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263387264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 44us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.319734:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5750 00010000:00010000:3.0:1746065145.319735:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.319744:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.319749:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8a00/0xad6b7ddc146e86d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.319754:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5751 00000100:00100000:2.0:1746065145.319759:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263387392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.319763:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.319769:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 33 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319797:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 33 pid: 3067 timeout: 841 lvb_type: 1 00000100:00100000:3.0:1746065145.319806:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263385984:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 12120us (13184us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065145.319807:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.319808:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.319810:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.319815:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12834 00010000:00010000:2.0:1746065145.319815:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319824:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.319837:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263387392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.319842:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5751 00000100:00100000:2.0:1746065145.319850:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5752 00000100:00100000:2.0:1746065145.319854:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263387520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.319860:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.319865:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 19 pid: 1880 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319872:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 19 pid: 1880 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319881:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146e724 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ee4 expref: 19 pid: 1880 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.319888:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.319889:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.319891:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319897:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.319907:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.319921:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263387520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.319925:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5752 00010000:00010000:2.0:1746065145.320802:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.320811:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320822:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc146e4f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d8d expref: 9 pid: 12258 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.320822:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.320827:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.320832:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263283072:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065145.320837:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320841:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146e3e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932cde expref: 32 pid: 3067 timeout: 841 lvb_type: 1 00010000:00010000:2.0:1746065145.320842:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065145.320844:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.320848:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263283200:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065145.320850:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.320859:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.320864:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc146e858 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320865:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320871:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320877:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320887:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.320892:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263385472:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 13498us (14525us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065145.320893:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.320897:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12831 00010000:00010000:3.0:1746065145.320899:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320905:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065145.320907:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320913:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.320922:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.320924:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263283328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.320927:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc146e866 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.320934:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.320955:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263385600:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 13273us (14250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.320961:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12833 00010000:00010000:3.0:1746065145.321089:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.321097:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.321109:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.321114:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.321120:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.321124:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065145.321127:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.321132:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.321140:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.321146:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc146e85f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065145.321176:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2006:x1830881263385728:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 13772us (14580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.321181:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12832 00000100:00100000:1.0:1746065145.321870:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263386496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.321880:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5743 00000100:00100000:3.0:1746065145.329866:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263387648:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11020us (11124us total) trans 21474840845 rc 0/0 00000100:00100000:3.0:1746065145.329877:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1258 00002000:00100000:3.0:1746065145.329887:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1699840->2097151) req@ffff88009a6dca80 x1830881263387648/t21474840845(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:61/0 lens 488/448 e 0 to 0 dl 1746065156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.329896:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881263387648 ext(1699840->2097151) 00010000:00010000:3.0:1746065145.329906:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.329917:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065145.329922:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6dca80 00000100:00100000:0.0:1746065145.341646:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.342716:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263387776:12345-192.168.202.27@tcp:4:cat.0 Request processed in 23117us (23245us total) trans 17179873401 rc 0/0 00000100:00100000:3.0:1746065145.342726:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1259 00002000:00100000:3.0:1746065145.342737:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3833855) req@ffff88008c45aa00 x1830881263387776/t17179873401(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:61/0 lens 488/448 e 0 to 0 dl 1746065156 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065145.342745:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45aa00 with x1830881263387776 ext(3145728->3833855) 00010000:00010000:3.0:1746065145.342754:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 18 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.342765:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 18 pid: 1880 timeout: 841 lvb_type: 0 00002000:00010000:3.0:1746065145.342770:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c45aa00 00000100:00100000:1.0:1746065145.344655:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387904 00000100:00100000:1.0:1746065145.344665:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387904 00010000:00010000:1.0:1746065145.344695:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065145.344725:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5753 00000100:00100000:1.0:1746065145.344731:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263387904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065145.344744:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065145.344760:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065145.344768:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065145.344802:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146e7c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f54 expref: 41 pid: 12258 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065145.344828:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.344830:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.344834:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.344842:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.344869:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065145.344909:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263387904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 178us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.344915:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5753 00010000:00010000:2.0:1746065145.345054:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.345067:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.345081:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.345087:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.345094:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.345100:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065145.345103:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.345109:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.345119:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.345125:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146e874 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.345168:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263385856:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 37260us (37302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.345177:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12835 00000100:00100000:0.0:1746065145.355371:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.355507:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388032 00000100:00100000:2.0:1746065145.355516:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388032 00010000:00010000:2.0:1746065145.355555:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 18 pid: 1880 timeout: 841 lvb_type: 0 00000100:00100000:2.0:1746065145.355594:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5754 00000100:00100000:2.0:1746065145.355603:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263388032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065145.355620:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065145.355639:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 18 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.355651:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 18 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.355674:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81e00/0xad6b7ddc146e7b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932f46 expref: 18 pid: 1880 timeout: 841 lvb_type: 0 00010000:00010000:2.0:1746065145.355703:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.355705:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.355709:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355715:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355734:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065145.355803:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263388032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 200us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.355809:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5754 00010000:00010000:2.0:1746065145.355839:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355846:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355860:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355872:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355878:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355883:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065145.355886:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355892:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355901:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065145.355940:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835c400/0xad6b7ddc146e87b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.355990:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2006:x1830881263386112:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 48016us (48045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065145.355998:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12836 00000100:00100000:0.0:1746065145.357435:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.357507:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388288 00000100:00100000:3.0:1746065145.357512:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388288 00000100:00100000:3.0:1746065145.357597:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13563 00000100:00100000:3.0:1746065145.357604:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32061:x1830881263388288:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:3.0:1746065145.357736:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065145.357755:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857e00/0xad6b7ddc146e851 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932faf expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.357912:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065145.357916:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065145.357936:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.357947:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.357952:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.357957:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.357961:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.357967:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.357999:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.358008:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 20 pid: 9571 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.358018:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263283584:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.358289:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.358297:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 41 pid: 9571 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.358305:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263283712:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.358329:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.358335:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 41 pid: 9571 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.358340:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263283840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065145.358360:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.358367:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 20 pid: 7231 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.358373:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263283968:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.358447:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065145.360369:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.360425:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388544 00000100:00100000:2.0:1746065145.360431:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388544 00000100:00100000:2.0:1746065145.360463:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4878 00000100:00100000:3.0:1746065145.360631:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263283584:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.360640:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263283712:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065145.360647:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263283840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065145.360661:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+21:8522:x1830881263388544:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065145.361026:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+22:8522:x1830881263388544:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 555us (662us total) trans 8589935883 rc 0/0 00000100:00100000:2.0:1746065145.361032:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4878 00000100:00100000:0.0:1746065145.361224:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.361346:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388672 00000100:00100000:1.0:1746065145.361349:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388672 00010000:00010000:1.0:1746065145.361367:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 42 pid: 9571 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065145.361397:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5755 00000100:00100000:1.0:1746065145.361403:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263388672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065145.361484:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.361499:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388800 00000100:00100000:3.0:1746065145.361502:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388800 00010000:00010000:3.0:1746065145.361598:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 43 pid: 9571 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.361613:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5756 00010000:00010000:1.0:1746065145.361614:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065145.361619:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263388800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065145.361620:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 43 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.361626:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065145.361628:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 43 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.361629:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 43 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.361635:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 43 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065145.361707:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9e00/0xad6b7ddc146e40d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932d01 expref: 43 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.361732:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc146e68a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e90 expref: 42 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.361741:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065145.361745:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.361753:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065145.361842:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065145.361846:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065145.361851:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065145.362074:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263388800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 455us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.362074:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263388672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 669us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.362079:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5755 00000100:00100000:3.0:1746065145.362105:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5756 00000100:00100000:0.0:1746065145.362201:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.362254:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263283968:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065145.362499:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:1.0:1746065145.362501:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388928 00000100:00100000:1.0:1746065145.362504:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388928 00010000:00010000:1.0:1746065145.362515:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 22 pid: 7231 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746065145.362538:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5757 00000100:00100000:1.0:1746065145.362543:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263388928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065145.362550:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065145.362553:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 22 pid: 7231 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065145.362560:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 22 pid: 7231 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065145.362570:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc146e667 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932e89 expref: 22 pid: 7231 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746065145.362579:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065145.362586:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065145.362590:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065145.362617:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263388928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.362623:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5757 00000100:00100000:0.0:1746065145.363044:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.363310:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389056 00000100:00100000:3.0:1746065145.363314:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389056 00010000:00010000:3.0:1746065145.363326:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 21 pid: 9571 timeout: 841 lvb_type: 0 00000100:00100000:3.0:1746065145.363348:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5758 00000100:00100000:3.0:1746065145.363354:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263389056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065145.363360:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065145.363363:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 21 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.363371:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 21 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.363381:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc146e5aa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932df6 expref: 21 pid: 9571 timeout: 841 lvb_type: 0 00010000:00010000:3.0:1746065145.363391:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065145.363394:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.363401:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.363407:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.363428:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065145.363446:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263389056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (402us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065145.363450:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065145.363451:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5758 00010000:00010000:2.0:1746065145.363456:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000040:00080000:2.0:1746065145.364227:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].513, 88 off53200 00000004:00080000:2.0:1746065145.364233:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382458839ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364336:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].460, 88 off48528 00000004:00080000:2.0:1746065145.364341:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741382567044ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065145.364367:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].461, 88 off48616 00000004:00080000:2.0:1746065145.364371:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741382597039ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065145.364460:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].514, 88 off53288 00000004:00080000:2.0:1746065145.364464:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382690614ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364492:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].515, 88 off53376 00000004:00080000:2.0:1746065145.364499:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382724917ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364531:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].462, 88 off48704 00000004:00080000:2.0:1746065145.364534:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741382760272ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065145.364555:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].463, 88 off48792 00000004:00080000:2.0:1746065145.364558:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741382784776ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065145.364574:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].464, 88 off48880 00000004:00080000:2.0:1746065145.364576:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741382802816ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065145.364585:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].516, 88 off53464 00000004:00080000:2.0:1746065145.364587:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382813697ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364596:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].465, 88 off48968 00000004:00080000:2.0:1746065145.364599:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741382825360ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065145.364606:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].517, 88 off53552 00000004:00080000:2.0:1746065145.364608:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382834857ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364615:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].466, 88 off49056 00000004:00080000:2.0:1746065145.364617:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741382843355ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065145.364624:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].518, 88 off53640 00000004:00080000:2.0:1746065145.364627:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382853340ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364633:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].519, 88 off53728 00000004:00080000:2.0:1746065145.364636:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382862150ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364641:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].520, 88 off53816 00000004:00080000:2.0:1746065145.364643:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382869735ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364649:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].521, 88 off53904 00000004:00080000:2.0:1746065145.364651:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 741382877456ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065145.364711:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].468, 88 off49240 00000004:00080000:2.0:1746065145.364715:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741382941047ns, next at 615601404258ns, rc = 0 00000001:00080000:2.0:1746065145.366243:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935884 is committed 00000004:00080000:2.0:1746065145.366250:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 462 committed 00000004:00080000:2.0:1746065145.366365:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 514 committed 00000004:00080000:2.0:1746065145.366486:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 513 committed 00000004:00080000:2.0:1746065145.366488:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 512 committed 00000004:00080000:2.0:1746065145.366489:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 511 committed 00000004:00080000:2.0:1746065145.366491:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 461 committed 00000004:00080000:2.0:1746065145.366493:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 510 committed 00000004:00080000:2.0:1746065145.366494:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 460 committed 00000004:00080000:2.0:1746065145.366495:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 509 committed 00000004:00080000:2.0:1746065145.366496:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 459 committed 00000004:00080000:2.0:1746065145.366497:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 458 committed 00000004:00080000:2.0:1746065145.366499:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 457 committed 00000004:00080000:2.0:1746065145.366500:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 508 committed 00000004:00080000:2.0:1746065145.366501:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 507 committed 00000004:00080000:2.0:1746065145.366502:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 456 committed 00000004:00080000:2.0:1746065145.366503:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 455 committed 00000004:00080000:2.0:1746065145.366504:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 506 committed 00000001:00080000:2.0:1746065145.366507:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935883 is committed 00000001:00080000:2.0:1746065145.366513:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935880 is committed 00000004:00010000:2.0:1746065145.366583:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009834c700 reply state ffff88006e98cc00 transno 8589935884 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065145.366599:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065145.366607:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065145.366610:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065145.366613:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746065145.366684:0:7204:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065145.367437:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32061:x1830881263388288:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 9829us (10001us total) trans 8589935884 rc 0/0 00000100:00100000:2.0:1746065145.367445:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13563 00000100:00100000:2.0:1746065145.367471:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263284480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065145.367517:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065145.367524:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263284352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065145.367542:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263284992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065145.367544:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065145.367556:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065145.367557:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263284864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065145.367566:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065145.367568:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065145.367570:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263284096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065145.367579:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746065145.367582:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065145.367583:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263284224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065145.367592:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263284608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065145.367597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065145.367603:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065145.367606:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263284736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065145.367616:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065145.367621:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284480 00000100:00100000:2.0:1746065145.367626:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284480 00000100:00100000:0.0:1746065145.367631:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284352 00000100:00100000:0.0:1746065145.367633:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284352 00000100:00100000:2.0:1746065145.367651:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284992 00000100:00100000:2.0:1746065145.367652:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284992 00000100:00100000:3.0:1746065145.368073:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263285248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065145.368097:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065145.368553:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263285760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065145.368571:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065145.368717:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284864 00000100:00100000:0.0:1746065145.368722:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284864 00000100:00100000:0.0:1746065145.368738:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284096 00000100:00100000:0.0:1746065145.368740:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284096 00000100:00100000:0.0:1746065145.368746:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284224 00000100:00100000:0.0:1746065145.368748:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284224 00000100:00100000:0.0:1746065145.368754:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284608 00000100:00100000:0.0:1746065145.368756:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284608 00000100:00100000:0.0:1746065145.368761:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284736 00000100:00100000:0.0:1746065145.368762:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284736 00000100:00100000:0.0:1746065145.368768:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285248 00000100:00100000:0.0:1746065145.368769:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285248 00000100:00100000:0.0:1746065145.368797:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12837 00000100:00100000:2.0:1746065145.368801:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12838 00000100:00100000:0.0:1746065145.368803:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3761:x1830881263284480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065145.368806:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3760:x1830881263284352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065145.368818:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263285376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065145.368843:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12839 00000100:00100000:0.0:1746065145.368848:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3761:x1830881263284992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065145.368909:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:0.0:1746065145.368912:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065145.368914:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065145.368916:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065145.368918:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:2.0:1746065145.368925:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3760:x1830881263284352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (1380us total) trans 17179873402 rc 0/0 00000100:00100000:2.0:1746065145.368931:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12838 00000100:00100000:0.0:1746065145.368933:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881263284992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1377us total) trans 21474840846 rc 0/0 00000100:00100000:0.0:1746065145.368938:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12839 00000100:00100000:2.0:1746065145.368942:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12840 00000100:00100000:2.0:1746065145.368946:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263284864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065145.368946:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12841 00000100:00100000:0.0:1746065145.368949:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3761:x1830881263284096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065145.369007:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881263284096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1423us total) trans 21474840847 rc 0/0 00000100:00100000:0.0:1746065145.369011:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12841 00000100:00100000:0.0:1746065145.369021:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12842 00000100:00100000:0.0:1746065145.369025:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3760:x1830881263284224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065145.369072:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3760:x1830881263284224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (1474us total) trans 17179873403 rc 0/0 00000100:00100000:0.0:1746065145.369076:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12842 00000100:00100000:0.0:1746065145.369085:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12843 00000100:00100000:0.0:1746065145.369089:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3761:x1830881263284608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065145.369210:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3761:x1830881263284480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 407us (1692us total) trans 17179873404 rc 0/0 00000100:00100000:1.0:1746065145.369214:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12837 00000100:00100000:1.0:1746065145.369224:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12844 00000100:00100000:1.0:1746065145.369227:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263284736:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065145.369365:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.369373:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.369379:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.369383:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065145.369387:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.369392:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.369404:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065145.369406:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065145.369409:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.369413:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146e882 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065145.369428:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263285120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065145.369447:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065145.369456:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263285632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065145.369468:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065145.369477:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065145.369480:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263285504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065145.369492:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065145.369498:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263286016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065145.369508:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065145.369522:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285760 00000100:00100000:3.0:1746065145.369524:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285760 00000100:00100000:3.0:1746065145.369536:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285120 00000100:00100000:3.0:1746065145.369537:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285120 00000100:00100000:3.0:1746065145.369543:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285632 00000100:00100000:3.0:1746065145.369544:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285632 00000100:00100000:3.0:1746065145.369549:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285504 00000100:00100000:3.0:1746065145.369551:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285504 00000100:00100000:3.0:1746065145.369555:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286016 00000100:00100000:3.0:1746065145.369557:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286016 00000100:00100000:3.0:1746065145.369563:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12845 00000100:00100000:3.0:1746065145.369567:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3759:x1830881263285248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065145.369623:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3759:x1830881263285248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (1525us total) trans 17179873405 rc 0/0 00000100:00100000:3.0:1746065145.369628:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12845 00000100:00100000:3.0:1746065145.370027:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12846 00000100:00100000:3.0:1746065145.370034:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263285760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065145.370090:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881263285760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1517us total) trans 21474840848 rc 0/0 00000100:00100000:3.0:1746065145.370095:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12846 00000100:00100000:3.0:1746065145.370106:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12847 00000100:00100000:3.0:1746065145.370110:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3762:x1830881263285120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065145.370146:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065145.370148:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065145.370150:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065145.370151:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065145.370153:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065145.370173:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263285120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (726us total) trans 17179873406 rc 0/0 00000100:00100000:3.0:1746065145.370178:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12847 00000100:00100000:3.0:1746065145.370186:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12848 00000100:00100000:3.0:1746065145.370190:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3762:x1830881263285632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065145.370240:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263285632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (770us total) trans 17179873407 rc 0/0 00000100:00100000:3.0:1746065145.370244:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12848 00000100:00100000:3.0:1746065145.370253:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12849 00000100:00100000:3.0:1746065145.370256:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3762:x1830881263285504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065145.370301:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263285504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (808us total) trans 17179873408 rc 0/0 00000100:00100000:3.0:1746065145.370306:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12849 00000100:00100000:3.0:1746065145.370314:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12850 00000100:00100000:3.0:1746065145.370318:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263286016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065145.370352:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:3.0:1746065145.370355:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065145.370356:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065145.370358:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065145.370359:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:3.0:1746065145.370376:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263286016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (867us total) trans 21474840849 rc 0/0 00000100:00100000:3.0:1746065145.370381:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12850 00000004:00080000:3.0:1746065145.370417:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138a80/2, rc 0, transno 17179873408 00000100:00100000:3.0:1746065145.370422:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263285504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065145.370430:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa4700/2, rc 0, transno 21474840849 00000100:00080000:2.0:1746065145.370502:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746065145.370505:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746065145.370524:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa6d80/2, rc 0, transno 21474840847 00000100:00100000:3.0:1746065145.371219:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263286016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065145.371234:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513a680/2, rc 0, transno 17179873406 00000100:00100000:3.0:1746065145.371237:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263285120:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065145.371243:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135139f80/2, rc 0, transno 17179873407 00000100:00100000:3.0:1746065145.371245:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263285632:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065145.371262:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa4380/2, rc 0, transno 21474840848 00000100:00100000:3.0:1746065145.371264:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263285760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065145.371271:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513aa00/2, rc 0, transno 17179873405 00000100:00100000:1.0:1746065145.371272:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263286144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065145.371273:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263285248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065145.371294:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065145.371325:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263284096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065145.371337:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa7b80/2, rc 0, transno 21474840846 00000100:00100000:2.0:1746065145.371340:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263284992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065145.371347:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098ddb480/2, rc 0, transno 17179873404 00000100:00100000:2.0:1746065145.371350:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263284480:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065145.371839:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065145.371842:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065145.371844:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065145.371845:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065145.371847:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746065145.371853:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263284608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2763us (4249us total) trans 21474840850 rc 0/0 00000100:00100000:0.0:1746065145.371860:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12843 00000100:00100000:2.0:1746065145.371868:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3760:x1830881263284864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2922us (4298us total) trans 21474840851 rc 0/0 00000100:00100000:2.0:1746065145.371872:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12840 00000100:00100000:0.0:1746065145.371912:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:3.0:1746065145.372003:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa7100/2, rc 0, transno 21474840850 00000100:00100000:3.0:1746065145.372006:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263284608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065145.372246:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3760:x1830881263284736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3017us (4627us total) trans 21474840852 rc 0/0 00000100:00100000:1.0:1746065145.372253:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12844 00000100:00100000:1.0:1746065145.372265:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286144 00000100:00100000:1.0:1746065145.372270:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286144 00000100:00100000:1.0:1746065145.372294:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12851 00000100:00100000:1.0:1746065145.372299:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263286144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065145.372360:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263286144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (1065us total) trans 21474840853 rc 0/0 00000100:00100000:1.0:1746065145.372365:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12851 00000004:00080000:1.0:1746065145.372391:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa6a00/2, rc 0, transno 21474840853 00000100:00100000:1.0:1746065145.372395:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263286144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065145.372533:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065145.372548:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263285888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065145.372563:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065145.372577:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8e00/2, rc 0, transno 17179873403 00000100:00100000:2.0:1746065145.372580:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263284224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065145.372586:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa7480/2, rc 0, transno 21474840852 00000100:00100000:2.0:1746065145.372588:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263284736:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065145.372595:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8a80/2, rc 0, transno 17179873402 00000100:00100000:2.0:1746065145.372597:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263284352:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065145.372603:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa7800/2, rc 0, transno 21474840851 00000100:00100000:2.0:1746065145.372607:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263284864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065145.372623:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285376 00000100:00100000:0.0:1746065145.372626:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285376 00000100:00100000:2.0:1746065145.372627:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285888 00000100:00100000:2.0:1746065145.372628:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285888 00000100:00100000:0.0:1746065145.372645:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12852 00000100:00100000:2.0:1746065145.372650:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12853 00000100:00100000:0.0:1746065145.372651:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3760:x1830881263285376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065145.372653:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3760:x1830881263285888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065145.372691:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065145.372693:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065145.372695:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065145.372696:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065145.372698:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:2.0:1746065145.372713:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3760:x1830881263285888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (149us total) trans 21474840854 rc 0/0 00000100:00100000:0.0:1746065145.372713:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3760:x1830881263285376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (180us total) trans 17179873409 rc 0/0 00000100:00100000:0.0:1746065145.372718:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12852 00000100:00100000:2.0:1746065145.372720:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12853 00000004:00080000:2.0:1746065145.372736:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138e00/2, rc 0, transno 17179873409 00000100:00100000:2.0:1746065145.372739:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263285376:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065145.372744:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa4000/2, rc 0, transno 21474840854 00000100:00100000:2.0:1746065145.372747:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263285888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065145.372762:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389184 00000100:00100000:3.0:1746065145.372765:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389184 00000100:00100000:3.0:1746065145.372802:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13564 00000100:00100000:3.0:1746065145.372806:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32061:x1830881263389184:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065145.372819:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.372831:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fb6 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.372874:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.372884:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.372896:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065145.372899:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065145.372901:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4000, rc 0) 00000100:00100000:3.0:1746065145.372926:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32061:x1830881263389184:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 120us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.372930:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13564 00000100:00100000:0.0:1746065145.375334:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.375501:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389312 00000100:00100000:3.0:1746065145.375507:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389312 00000100:00100000:3.0:1746065145.375545:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13565 00000100:00100000:3.0:1746065145.375552:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32061:x1830881263389312:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065145.375569:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.375582:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e890 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fbd expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.375642:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.375651:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.375660:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:3.0:1746065145.375677:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065145.375680:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065145.375691:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065145.375708:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5a00/0xad6b7ddc146e890 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.375861:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065145.375868:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065145.375870:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065145.375872:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5000, rc 0) 00000100:00100000:3.0:1746065145.375901:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32061:x1830881263389312:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 350us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.375906:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13565 00000100:00100000:0.0:1746065145.377524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.377557:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.377590:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065145.377651:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389440 00000100:00100000:1.0:1746065145.377657:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389440 00000100:00100000:1.0:1746065145.377682:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389696 00000100:00100000:1.0:1746065145.377685:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389696 00000100:00100000:1.0:1746065145.377695:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389952 00000100:00100000:1.0:1746065145.377701:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389952 00000100:00100000:1.0:1746065145.377714:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12854 00000100:00100000:1.0:1746065145.377719:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263389440:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065145.377731:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.377746:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fc4 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065145.377763:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12855 00002000:00010000:1.0:1746065145.377765:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6f7, atime: 0x6812d6f4, ctime: 0x6812d6f7, blocks: 0x7f8 00000100:00100000:0.0:1746065145.377769:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2007:x1830881263389696:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065145.377795:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065145.377796:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.377797:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.377804:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065145.377805:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fd2 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065145.377815:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746065145.377816:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6f8, atime: 0x6812d6f6, ctime: 0x6812d6f8, blocks: 0x800 00010000:00010000:0.0:1746065145.377823:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065145.377824:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065145.377826:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b200, rc 0) 00010000:00010000:0.0:1746065145.377828:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 7 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065145.377835:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 7 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065145.377841:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00000100:00100000:1.0:1746065145.377853:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263389440:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 134us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065145.377853:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263389696:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065145.377858:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12854 00000100:00100000:0.0:1746065145.377868:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12855 00000100:00100000:0.0:1746065145.377886:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12856 00000100:00100000:0.0:1746065145.377891:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263389952:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065145.377896:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065145.377903:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fe0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065145.377911:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d6f9, atime: 0x6812d6f9, ctime: 0x6812d6f9, blocks: 0x1650 00010000:00010000:0.0:1746065145.377922:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065145.377923:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065145.377927:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065145.377939:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065145.377946:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc400, rc 0) 00000100:00100000:0.0:1746065145.377960:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263389952:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 69us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065145.377965:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12856 00000100:00100000:0.0:1746065145.378046:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065145.378069:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065145.378078:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389824 00000100:00100000:0.0:1746065145.378078:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389568 00000100:00100000:2.0:1746065145.378081:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389824 00000100:00100000:0.0:1746065145.378081:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389568 00000100:00100000:0.0:1746065145.378105:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12857 00000100:00100000:0.0:1746065145.378110:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263389568:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065145.378116:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065145.378123:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fcb expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065145.378132:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12858 00002000:00010000:0.0:1746065145.378133:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6f7, atime: 0x6812d6f7, ctime: 0x6812d6f7, blocks: 0x808 00000100:00100000:2.0:1746065145.378137:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263389824:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065145.378141:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.378142:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065145.378142:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065145.378145:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 8 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.378149:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fd9 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065145.378153:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 8 pid: 9548 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746065145.378157:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6f9, atime: 0x6812d6f5, ctime: 0x6812d6f9, blocks: 0x808 00010000:00010000:0.0:1746065145.378163:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd600, rc 0) 00010000:00010000:2.0:1746065145.378164:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.378165:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065145.378168:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065145.378175:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065145.378177:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263389568:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 67us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065145.378181:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12857 00010000:00010000:2.0:1746065145.378182:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539000, rc 0) 00000100:00100000:2.0:1746065145.378194:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263389824:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065145.378212:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065145.378225:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390080 00000100:00100000:3.0:1746065145.378228:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390080 00000100:00100000:3.0:1746065145.378242:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12859 00000100:00100000:3.0:1746065145.378246:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263390080:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065145.378252:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065145.378259:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fe7 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065145.378268:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d6f9, atime: 0x6812d6f9, ctime: 0x6812d6f9, blocks: 0x1000 00000100:00100000:2.0:1746065145.378410:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12858 00010000:00010000:3.0:1746065145.378479:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.378481:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065145.378485:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.378495:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065145.378509:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5400, rc 0) 00000100:00100000:3.0:1746065145.378941:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263390080:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 693us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065145.378947:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12859 00010000:00010000:2.0:1746065145.897008:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065146.384686:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.384723:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.384748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.384762:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.384818:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.385010:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390336 00000100:00100000:2.0:1746065146.385012:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390592 00000100:00100000:0.0:1746065146.385017:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390336 00000100:00100000:2.0:1746065146.385023:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390592 00000100:00100000:0.0:1746065146.385054:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390848 00000100:00100000:0.0:1746065146.385056:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390848 00000100:00100000:2.0:1746065146.385065:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390208 00000100:00100000:2.0:1746065146.385067:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390208 00000100:00100000:0.0:1746065146.385067:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390464 00000100:00100000:0.0:1746065146.385069:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390464 00000100:00100000:2.0:1746065146.385092:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12860 00000100:00100000:2.0:1746065146.385101:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263390336:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065146.385101:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12861 00000100:00100000:0.0:1746065146.385109:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263390592:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065146.385191:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263390592:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 84us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.385198:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12861 00000100:00100000:2.0:1746065146.385202:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263390336:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 102us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.385208:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12860 00000100:00100000:0.0:1746065146.385214:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12862 00000100:00100000:0.0:1746065146.385218:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263390848:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065146.385223:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12863 00000100:00100000:2.0:1746065146.385226:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263390208:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065146.385256:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263390848:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 37us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.385259:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263390208:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 32us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.385265:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12862 00000100:00100000:2.0:1746065146.385269:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12863 00000100:00100000:0.0:1746065146.385277:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12864 00000100:00100000:0.0:1746065146.385282:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263390464:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065146.385304:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263390464:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 22us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.385309:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12864 00000100:00100000:0.0:1746065146.385404:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.385416:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390720 00000100:00100000:0.0:1746065146.385418:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390720 00000100:00100000:0.0:1746065146.385433:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12865 00000100:00100000:0.0:1746065146.385437:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263390720:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065146.385464:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263390720:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 27us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.385469:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12865 00000100:00100000:0.0:1746065146.390268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.390297:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.390535:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.390821:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390976 00000100:00100000:2.0:1746065146.390828:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390976 00000100:00100000:2.0:1746065146.390859:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391232 00000100:00100000:2.0:1746065146.390861:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391232 00000100:00100000:2.0:1746065146.390870:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391488 00000100:00100000:2.0:1746065146.390871:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391488 00000100:00100000:2.0:1746065146.390882:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12866 00000100:00100000:2.0:1746065146.390889:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263390976:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065146.390985:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263390976:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 96us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.390991:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12866 00000100:00100000:2.0:1746065146.391004:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12867 00000100:00100000:2.0:1746065146.391008:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263391232:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065146.391039:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263391232:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 31us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.391044:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12867 00000100:00100000:2.0:1746065146.391051:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12868 00000100:00100000:2.0:1746065146.391055:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263391488:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065146.391077:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263391488:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 21us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.391081:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12868 00000100:00100000:2.0:1746065146.391149:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.391161:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391104 00000100:00100000:2.0:1746065146.391164:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391104 00000100:00100000:2.0:1746065146.391175:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12869 00000100:00100000:2.0:1746065146.391179:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263391104:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065146.391207:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263391104:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 27us (57us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.391211:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12869 00000100:00100000:2.0:1746065146.391255:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.391265:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391360 00000100:00100000:2.0:1746065146.391267:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391360 00000100:00100000:2.0:1746065146.391278:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12870 00000100:00100000:2.0:1746065146.391282:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263391360:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065146.391310:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263391360:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 27us (54us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.391315:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12870 00000100:00100000:2.0:1746065146.391354:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.391364:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391616 00000100:00100000:2.0:1746065146.391367:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391616 00000100:00100000:2.0:1746065146.391378:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12871 00000100:00100000:2.0:1746065146.391382:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263391616:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065146.391408:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263391616:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 26us (55us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.391413:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12871 00000100:00100000:1.0:1746065146.396905:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.397132:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391744 00000100:00100000:2.0:1746065146.397141:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391744 00000100:00100000:2.0:1746065146.397187:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12872 00000100:00100000:2.0:1746065146.397195:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263391744:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:2.0:1746065146.397353:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065146.397356:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065146.397358:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.397359:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065146.397361:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:2.0:1746065146.397410:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263391744:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 215us (512us total) trans 17179873410 rc 0/0 00000100:00100000:2.0:1746065146.397416:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12872 00000100:00100000:0.0:1746065146.401485:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.402081:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391872 00000100:00100000:1.0:1746065146.402089:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391872 00000100:00100000:1.0:1746065146.402134:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12873 00000100:00100000:1.0:1746065146.402141:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263391872:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:1.0:1746065146.402275:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065146.402278:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065146.402280:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065146.402281:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065146.402283:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:1.0:1746065146.402330:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263391872:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 189us (853us total) trans 21474840855 rc 0/0 00000100:00100000:1.0:1746065146.402336:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12873 00000100:00100000:0.0:1746065146.413029:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.413063:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.413091:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.413121:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392256 00000100:00100000:0.0:1746065146.413128:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392256 00000100:00100000:0.0:1746065146.413169:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392512 00000100:00100000:0.0:1746065146.413171:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392512 00000100:00100000:0.0:1746065146.413192:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392384 00000100:00100000:0.0:1746065146.413193:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392384 00000100:00100000:0.0:1746065146.413206:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3567 00000100:00100000:0.0:1746065146.413213:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263392256:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065146.413241:0:29493:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.413255:0:29493:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.413256:0:29493:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.413261:0:29493:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.413274:0:29493:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065146.414353:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3568 00000100:00100000:0.0:1746065146.414359:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263392512:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065146.414378:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.414385:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.414386:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.414389:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.414398:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065146.415413:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3569 00000100:00100000:0.0:1746065146.415421:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263392384:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065146.415437:0:20324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.415444:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.415445:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.415448:0:20324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.415454:0:20324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065146.441007:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.442465:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393024 00000100:00100000:1.0:1746065146.442476:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393024 00000100:00100000:1.0:1746065146.442537:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3570 00000100:00100000:1.0:1746065146.442546:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263393024:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065146.442575:0:9554:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.442591:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.442593:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.442597:0:9554:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.442608:0:9554:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065146.453879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065146.454046:0:29493:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.454056:0:29493:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.454063:0:29493:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.454068:0:29493:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065146.454072:0:29493:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.454078:0:29493:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.454093:0:29493:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.454099:0:29493:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857a00/0xad6b7ddc146e8c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065146.454166:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263392256:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 40952us (41142us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746065146.454174:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3567 00000100:00100000:1.0:1746065146.454195:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393280 00000100:00100000:1.0:1746065146.454201:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393280 00000100:00100000:1.0:1746065146.454247:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3571 00000100:00100000:1.0:1746065146.454253:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263393280:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065146.454290:0:29493:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.454299:0:29493:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.454300:0:29493:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.454305:0:29493:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.454314:0:29493:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.468998:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.469013:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.469020:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.469025:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065146.469028:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.469035:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.469048:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.469057:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc146e8cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065146.469121:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263392512:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 54758us (56053us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065146.469129:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3568 00000100:00100000:0.0:1746065146.474478:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065146.475468:0:20324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.475481:0:20324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.475488:0:20324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.475498:0:20324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6dc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065146.475501:0:20324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.475509:0:20324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.475523:0:20324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.475528:0:20324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146e8d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065146.475593:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263392384:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 60171us (62498us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065146.475600:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3569 00000100:00100000:1.0:1746065146.475619:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393408 00000100:00100000:1.0:1746065146.475625:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393408 00000100:00100000:1.0:1746065146.477646:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3572 00000100:00100000:1.0:1746065146.477658:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263393408:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065146.477689:0:20324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.477700:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.477701:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.477705:0:20324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.477717:0:20324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.505845:0:9554:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.505859:0:9554:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.505866:0:9554:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.505871:0:9554:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065146.505875:0:9554:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.505881:0:9554:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.505896:0:9554:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.505901:0:9554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc146e8dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065146.506009:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263393024:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 63461us (65006us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065146.506021:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3570 00010000:00010000:1.0:1746065146.510699:0:29493:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.510714:0:29493:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.510722:0:29493:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.510727:0:29493:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84a800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065146.510730:0:29493:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.510737:0:29493:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.510751:0:29493:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.510756:0:29493:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc146e8e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065146.510955:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263393280:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 56697us (57078us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065146.510964:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3571 00010000:00010000:1.0:1746065146.526207:0:20324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.526221:0:20324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.526228:0:20324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.526233:0:20324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065146.526236:0:20324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.526242:0:20324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.526257:0:20324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.526263:0:20324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146e8eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065146.526350:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263393408:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 48691us (51873us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065146.526358:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3572 00000100:00100000:0.0:1746065146.538657:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.539339:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393664 00000100:00100000:3.0:1746065146.539347:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393664 00000100:00100000:3.0:1746065146.539403:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 717 00000100:00100000:3.0:1746065146.539411:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32061:x1830881263393664:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:3.0:1746065146.539423:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065146.539445:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146e843 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fa8 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.539472:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065146.539476:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065146.539515:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32061:x1830881263393664:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 106us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065146.539521:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 717 00000100:00100000:3.0:1746065146.540723:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.540744:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393920 00000100:00100000:3.0:1746065146.540747:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393920 00000100:00100000:3.0:1746065146.540792:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4879 00000100:00100000:3.0:1746065146.540797:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32061:x1830881263393920:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065146.540977:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32061:x1830881263393920:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 170us (247us total) trans 8589935885 rc 0/0 00000100:00100000:3.0:1746065146.540986:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4879 00000100:00100000:0.0:1746065146.541883:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.542007:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263394176 00000100:00100000:1.0:1746065146.542011:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263394176 00000100:00100000:1.0:1746065146.542089:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4880 00000100:00100000:1.0:1746065146.542096:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32061:x1830881263394176:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065146.542199:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32061:x1830881263394176:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 103us (318us total) trans 8589935886 rc 0/0 00000100:00100000:1.0:1746065146.542205:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4880 00000100:00100000:0.0:1746065146.573998:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.574328:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263394432 00000100:00100000:3.0:1746065146.574339:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263394432 00000100:00100000:3.0:1746065146.574395:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13566 00000100:00100000:3.0:1746065146.574402:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+26:32069:x1830881263394432:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065146.574424:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.574440:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146e8f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932fee expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.574507:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574518:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574526:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574538:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574543:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574548:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574678:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574686:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574692:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:3.0:1746065146.574700:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065146.574749:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574755:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574760:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574764:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574768:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130104000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065146.574796:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574802:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574810:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065146.574812:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065146.574816:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574820:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e8f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574847:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574855:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574859:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574863:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130104600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065146.574865:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574869:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574874:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a200) 00010000:00010000:3.0:1746065146.574876:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065146.574878:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574882:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc146e900 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.574916:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146e8f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.574924:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 28 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.574933:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065146.574935:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065146.574937:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130104a00, rc 0) 00000100:00100000:3.0:1746065146.574984:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:32069:x1830881263394432:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 581us (993us total) trans 8589935887 rc 0/0 00000100:00100000:3.0:1746065146.574990:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13566 00000100:00100000:0.0:1746065146.576404:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.576467:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263394688 00000100:00100000:2.0:1746065146.576472:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263394688 00000100:00100000:2.0:1746065146.576508:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13567 00000100:00100000:2.0:1746065146.576514:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+7:32070:x1830881263394688:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065146.576528:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.576539:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31200/0xad6b7ddc146e915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ff5 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.576577:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576586:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576592:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576600:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576605:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576609:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576670:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146e92a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576679:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146e92a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576684:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146e92a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065146.576689:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065146.576727:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576732:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576736:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576741:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576745:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065146.576747:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576752:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576760:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065146.576762:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065146.576765:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576797:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146e91c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576818:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576822:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576826:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576830:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065146.576831:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576835:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576841:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090dc5300) 00010000:00010000:2.0:1746065146.576843:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065146.576844:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576848:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146e923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.576871:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31200/0xad6b7ddc146e915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ff5 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.576881:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146e92a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ff5 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.576891:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065146.576893:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065146.576895:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30200, rc 0) 00000100:00100000:2.0:1746065146.576934:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+9:32070:x1830881263394688:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 420us (534us total) trans 8589935888 rc 0/0 00000100:00100000:2.0:1746065146.576939:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13567 00000100:00100000:0.0:1746065146.584764:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.584948:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263394944 00000100:00100000:3.0:1746065146.584957:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263394944 00000100:00100000:3.0:1746065146.585034:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13568 00000100:00100000:3.0:1746065146.585042:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32070:x1830881263394944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065146.585061:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.585064:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065146.585085:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146e92a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ff5 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.585109:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065146.585113:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065146.585124:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e938 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd932ffc expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.585163:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.585174:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.585179:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 27 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.585185:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.585190:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 6/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.585214:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.585224:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 9 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065146.585233:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263286272:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065146.585316:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 27 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.585324:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 27 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065146.585331:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263286400:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065146.585355:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.585361:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 9 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746065146.585367:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263286528:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065146.585380:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065146.587262:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.587313:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.587340:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.587369:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.587383:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.587401:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395584 00000100:00100000:0.0:1746065146.587405:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395584 00010000:00010000:0.0:1746065146.587429:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 10 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065146.587451:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396096 00000100:00100000:0.0:1746065146.587453:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396096 00010000:00010000:0.0:1746065146.587459:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 11 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065146.587469:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5759 00000100:00100000:0.0:1746065146.587473:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263395584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065146.587481:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065146.587484:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 11 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.587492:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 11 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.587507:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065146.587510:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.587516:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.587520:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065146.587548:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263395584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.587554:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5759 00000100:00100000:0.0:1746065146.587567:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5760 00000100:00100000:0.0:1746065146.587572:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263396096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065146.587581:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065146.587584:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 10 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.587590:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 10 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.587599:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065146.587602:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.587606:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.587610:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065146.587623:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263396096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.587628:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5760 00000100:00100000:0.0:1746065146.587654:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.587664:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395968 00000100:00100000:0.0:1746065146.587667:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395968 00010000:00010000:0.0:1746065146.587675:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 28 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065146.587687:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5761 00000100:00100000:0.0:1746065146.587690:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263395968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065146.587695:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065146.587698:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 28 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.587705:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 28 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.587713:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065146.587715:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.587720:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.587726:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.587737:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065146.587747:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263395968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 56us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.587751:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5761 00000100:00100000:0.0:1746065146.587839:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395456 00000100:00100000:0.0:1746065146.587842:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395456 00000100:00100000:0.0:1746065146.587854:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395200 00000100:00100000:0.0:1746065146.587856:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395200 00000100:00100000:0.0:1746065146.587861:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395840 00000100:00100000:0.0:1746065146.587863:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395840 00000100:00100000:0.0:1746065146.587869:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13569 00000100:00100000:0.0:1746065146.587873:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+10:32074:x1830881263395456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065146.587883:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065146.587891:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146e946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93300a expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.587940:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.587947:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.587952:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.587960:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.587964:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.587980:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.588049:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.588055:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.588060:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065146.588067:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:3.0:1746065146.588207:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13570 00000100:00100000:3.0:1746065146.588215:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32075:x1830881263395200:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065146.588224:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.588231:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc146e969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933003 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.588265:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc146e970 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065146.588271:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc146e970 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065146.588277:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc146e970 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065146.588284:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065146.588326:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc146e969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933003 expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.588337:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc146e970 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933003 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.588342:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065146.588345:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065146.588347:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66000, rc 0) 00000100:00100000:3.0:1746065146.588370:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+31:32075:x1830881263395200:12345-192.168.202.27@tcp:101:cat.0 Request processed in 157us (1056us total) trans 8589935890 rc 0/0 00000100:00100000:3.0:1746065146.588375:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13570 00000100:00100000:3.0:1746065146.588388:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13571 00000100:00100000:3.0:1746065146.588392:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+30:32069:x1830881263395840:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065146.588399:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.588404:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc146e97e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933011 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.588427:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065146.588433:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.588437:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065146.588446:0:7203:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065146.588452:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065146.588993:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589000:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589009:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589013:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065146.589015:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589020:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589027:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065146.589029:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746065146.589031:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589035:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146e95b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589265:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589271:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589274:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589279:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589282:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065146.589284:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589291:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589307:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065146.589309:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065146.589311:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589316:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc146e94d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589323:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589327:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589332:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589335:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065146.589337:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589341:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589345:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012edbd700) 00010000:00010000:0.0:1746065146.589346:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065146.589348:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589351:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146e954 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065146.589377:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146e946 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93300a expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.589383:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146e946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93300a expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.589389:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61c00, rc 0) 00000100:00100000:0.0:1746065146.589739:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+11:32074:x1830881263395456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1863us (2481us total) trans 8589935889 rc 301/301 00000100:00100000:0.0:1746065146.589745:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13569 00010000:00010000:0.0:1746065146.590032:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4000/0xad6b7ddc146e889 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fb6 expref: 9 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065146.590042:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263286272:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065146.590052:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130104a00/0xad6b7ddc146e907 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fee expref: 31 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065146.590060:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263286400:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065146.590068:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5000/0xad6b7ddc146e897 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fbd expref: 8 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065146.590075:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263286528:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065146.590412:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.590418:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.590423:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00000040:00080000:0.0:1746065146.590663:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].522, 88 off53992 00000004:00080000:0.0:1746065146.590671:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742608896878ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.591036:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].469, 88 off49328 00000004:00080000:0.0:1746065146.591042:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742609268195ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065146.591884:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].470, 88 off49416 00000004:00080000:0.0:1746065146.591888:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742610114581ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065146.591897:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].523, 88 off54080 00000004:00080000:0.0:1746065146.591899:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742610125523ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.591907:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].524, 88 off54168 00000004:00080000:0.0:1746065146.591909:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742610135322ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.591915:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].471, 88 off49504 00000004:00080000:0.0:1746065146.591917:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742610143205ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065146.591922:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].472, 88 off49592 00000004:00080000:0.0:1746065146.591924:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742610150805ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065146.591930:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].473, 88 off49680 00000004:00080000:0.0:1746065146.591932:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742610158457ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065146.591937:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].525, 88 off54256 00000004:00080000:0.0:1746065146.591939:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742610165501ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.591945:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].474, 88 off49768 00000004:00080000:0.0:1746065146.591946:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742610173021ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065146.591952:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].526, 88 off54344 00000004:00080000:0.0:1746065146.591954:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742610180113ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.591959:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].475, 88 off49856 00000004:00080000:0.0:1746065146.591961:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742610187358ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065146.591978:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].527, 88 off54432 00000004:00080000:0.0:1746065146.591980:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742610206963ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.591987:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].528, 88 off54520 00000004:00080000:0.0:1746065146.591989:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742610216032ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.591995:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].529, 88 off54608 00000004:00080000:0.0:1746065146.591997:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742610223776ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.592003:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].530, 88 off54696 00000004:00080000:0.0:1746065146.592005:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742610231556ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065146.592011:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].476, 88 off49944 00000004:00080000:0.0:1746065146.592014:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742610240473ns, next at 615601404258ns, rc = 0 00000100:00100000:2.0:1746065146.606818:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.606854:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.606885:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396224 00000100:00100000:2.0:1746065146.606893:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396224 00000100:00100000:2.0:1746065146.606931:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396352 00000100:00100000:2.0:1746065146.606933:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396352 00000100:00100000:2.0:1746065146.606948:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13572 00000100:00100000:2.0:1746065146.606955:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+31:32075:x1830881263396224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065146.606983:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.606999:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146e98c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933018 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.607069:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065146.607080:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.607085:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065146.607098:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.607106:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000001:00080000:2.0:1746065146.608280:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935891 is committed 00000004:00080000:2.0:1746065146.608287:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 470 committed 00000004:00080000:2.0:1746065146.608304:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 523 committed 00000004:00080000:2.0:1746065146.608310:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 522 committed 00000004:00080000:2.0:1746065146.608312:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 521 committed 00000004:00080000:2.0:1746065146.608314:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 520 committed 00000004:00080000:2.0:1746065146.608315:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 469 committed 00000004:00080000:2.0:1746065146.608316:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 519 committed 00000004:00080000:2.0:1746065146.608318:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 468 committed 00000004:00080000:2.0:1746065146.608319:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 518 committed 00000004:00080000:2.0:1746065146.608320:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 467 committed 00000004:00080000:2.0:1746065146.608322:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 466 committed 00000004:00080000:2.0:1746065146.608323:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 465 committed 00000004:00080000:2.0:1746065146.608325:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 517 committed 00000004:00080000:2.0:1746065146.608326:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 516 committed 00000004:00080000:2.0:1746065146.608327:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 464 committed 00000004:00080000:2.0:1746065146.608328:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 463 committed 00000004:00080000:2.0:1746065146.608330:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 515 committed 00000001:00080000:2.0:1746065146.608334:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935890 is committed 00000001:00080000:2.0:1746065146.608341:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935886 is committed 00000100:00100000:3.0:1746065146.608470:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263286912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.608513:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065146.608671:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.608681:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065146.608684:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065146.608687:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065146.608694:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.608699:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065146.608715:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.608725:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 10 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065146.608739:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263288704:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065146.608864:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263287040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065146.608881:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065146.608899:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286912 00000100:00100000:0.0:1746065146.608903:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286912 00000100:00100000:0.0:1746065146.608926:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287040 00000100:00100000:0.0:1746065146.608927:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287040 00000100:00100000:0.0:1746065146.608938:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12874 00000100:00100000:0.0:1746065146.608943:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881263286912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065146.609038:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065146.609041:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065145 -> 1746065145 00002000:00010000:0.0:1746065146.609043:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065145 -> 1746065145 00002000:00010000:0.0:1746065146.609045:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065145 -> 1746065145 00002000:00010000:0.0:1746065146.609047:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746065146.609067:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263286912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (553us total) trans 17179873411 rc 0/0 00000100:00100000:0.0:1746065146.609073:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12874 00000100:00100000:0.0:1746065146.609084:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12875 00000100:00100000:0.0:1746065146.609088:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263287040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065146.609120:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065146.609122:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065146.609123:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065146.609125:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065146.609127:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:0.0:1746065146.609144:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263287040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (263us total) trans 17179873412 rc 0/0 00000100:00100000:0.0:1746065146.609148:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12875 00000100:00100000:0.0:1746065146.609174:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263286784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065146.609190:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065146.609200:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286784 00000100:00100000:0.0:1746065146.609203:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286784 00000100:00100000:0.0:1746065146.609213:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12876 00000100:00100000:0.0:1746065146.609217:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3760:x1830881263286784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065146.609249:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065146.609252:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065144 -> 1746065144 00002000:00010000:0.0:1746065146.609253:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065142 -> 1746065142 00002000:00010000:0.0:1746065146.609255:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065144 -> 1746065144 00002000:00010000:0.0:1746065146.609257:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065146.609272:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3760:x1830881263286784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (82us total) trans 17179873413 rc 0/0 00000100:00100000:0.0:1746065146.609276:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12876 00000100:00100000:2.0:1746065146.609562:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263286656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.609585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065146.609913:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286656 00000100:00100000:0.0:1746065146.609916:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286656 00000100:00100000:0.0:1746065146.609937:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12877 00000100:00100000:0.0:1746065146.609942:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263286656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065146.609999:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065146.610001:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:0.0:1746065146.610004:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065143 -> 1746065143 00002000:00010000:0.0:1746065146.610005:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:0.0:1746065146.610007:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065146.611182:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3759:x1830881263286656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1237us (1593us total) trans 17179873414 rc 0/0 00000100:00100000:0.0:1746065146.611188:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12877 00000004:00080000:3.0:1746065146.613519:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528700/2, rc 0, transno 17179873411 00000100:00100000:3.0:1746065146.613529:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263286912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.613537:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263287424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.613570:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065146.613809:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287424 00000100:00100000:1.0:1746065146.613815:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287424 00000100:00100000:1.0:1746065146.613845:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12878 00000100:00100000:1.0:1746065146.613851:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3761:x1830881263287424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065146.613987:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3761:x1830881263287424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (416us total) trans 17179873415 rc 0/0 00000100:00100000:1.0:1746065146.613992:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12878 00000004:00080000:0.0:1746065146.614086:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52b800/2, rc 0, transno 17179873413 00000100:00100000:0.0:1746065146.614090:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263286784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065146.614096:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263287296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065146.614118:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065146.614130:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263287808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065146.614145:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065146.614158:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263288320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065146.614170:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065146.614192:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287296 00000100:00100000:0.0:1746065146.614196:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287296 00000100:00100000:0.0:1746065146.614210:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287808 00000100:00100000:0.0:1746065146.614212:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287808 00000100:00100000:0.0:1746065146.614220:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288320 00000100:00100000:0.0:1746065146.614222:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288320 00000100:00100000:0.0:1746065146.614233:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12879 00000100:00100000:0.0:1746065146.614237:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263287296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065146.614298:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3760:x1830881263287296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (179us total) trans 17179873416 rc 0/0 00000100:00100000:0.0:1746065146.614303:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12879 00000100:00100000:0.0:1746065146.614394:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12880 00000100:00100000:0.0:1746065146.614399:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881263287808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065146.614503:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065146.614505:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065145 -> 1746065145 00002000:00010000:0.0:1746065146.614508:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065141 -> 1746065141 00002000:00010000:0.0:1746065146.614509:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065145 -> 1746065145 00002000:00010000:0.0:1746065146.614511:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065146.614529:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263287808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (383us total) trans 21474840856 rc 0/0 00000100:00100000:0.0:1746065146.614534:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12880 00000100:00100000:0.0:1746065146.614545:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12881 00000100:00100000:0.0:1746065146.614549:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881263288320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065146.614601:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263288320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (430us total) trans 21474840857 rc 0/0 00000100:00100000:0.0:1746065146.614605:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12881 00000004:00080000:0.0:1746065146.614630:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954bdf80/2, rc 0, transno 17179873416 00000100:00100000:0.0:1746065146.614633:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263287296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065146.614641:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3480/2, rc 0, transno 21474840856 00000100:00100000:0.0:1746065146.614647:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263287808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065146.614652:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd6d80/2, rc 0, transno 21474840857 00000100:00100000:0.0:1746065146.614655:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263288320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065146.614694:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065146.614698:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263288832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065146.614713:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065146.614730:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288832 00000100:00100000:0.0:1746065146.614732:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288832 00000100:00100000:0.0:1746065146.614746:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12882 00000100:00100000:0.0:1746065146.614750:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263288832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065146.614830:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3760:x1830881263288832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (115us total) trans 21474840858 rc 0/0 00000100:00100000:0.0:1746065146.614836:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12882 00000004:00080000:0.0:1746065146.614855:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f42a00/2, rc 0, transno 21474840858 00000100:00100000:0.0:1746065146.614857:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263288832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065146.614876:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065146.614887:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263288704:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065146.614914:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130104000/0xad6b7ddc146e938 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 10 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065146.614929:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 9 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.614936:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 9 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.614956:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4a00, rc 0) 00000100:00100000:0.0:1746065146.614996:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32070:x1830881263394944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 29955us (30240us total) trans 8589935891 rc 0/0 00000100:00100000:0.0:1746065146.615002:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13568 00000100:00100000:0.0:1746065146.615017:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13573 00000100:00100000:0.0:1746065146.615023:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+8:32074:x1830881263396352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065146.615032:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065146.615041:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146e99a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93301f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.615089:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.615100:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065146.615106:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00080000:3.0:1746065146.615258:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954bed80/2, rc 0, transno 17179873415 00000100:00100000:3.0:1746065146.615262:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263287424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.615271:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263287936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065146.615289:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065146.615302:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263288448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065146.615314:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.615388:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287936 00000100:00100000:2.0:1746065146.615392:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287936 00000100:00100000:2.0:1746065146.615407:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288448 00000100:00100000:2.0:1746065146.615409:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288448 00000100:00100000:2.0:1746065146.615420:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12883 00000100:00100000:2.0:1746065146.615425:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3761:x1830881263287936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.615470:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:2.0:1746065146.615473:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065145 -> 1746065145 00002000:00010000:2.0:1746065146.615474:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065145 -> 1746065145 00002000:00010000:2.0:1746065146.615476:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065145 -> 1746065145 00002000:00010000:2.0:1746065146.615478:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:2.0:1746065146.615501:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3761:x1830881263287936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (211us total) trans 21474840859 rc 0/0 00000100:00100000:2.0:1746065146.615506:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12883 00000100:00100000:2.0:1746065146.615516:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12884 00000100:00100000:2.0:1746065146.615520:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3761:x1830881263288448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.615553:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065146.615555:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.615557:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.615558:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.615560:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:2.0:1746065146.615577:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3761:x1830881263288448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (262us total) trans 21474840860 rc 0/0 00000100:00100000:2.0:1746065146.615581:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12884 00000004:00080000:2.0:1746065146.615604:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954bfb80/2, rc 0, transno 17179873412 00000100:00100000:2.0:1746065146.615607:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263287040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.615611:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263287552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.615628:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.615659:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263288064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.615675:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.615688:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263288576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.615701:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.615721:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287552 00000100:00100000:2.0:1746065146.615724:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287552 00000100:00100000:2.0:1746065146.615736:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288064 00000100:00100000:2.0:1746065146.615738:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288064 00000100:00100000:2.0:1746065146.615743:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288576 00000100:00100000:2.0:1746065146.615744:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288576 00000100:00100000:2.0:1746065146.615751:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12885 00000100:00100000:2.0:1746065146.615755:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3762:x1830881263287552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.615835:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3762:x1830881263287552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (205us total) trans 17179873417 rc 0/0 00000100:00100000:2.0:1746065146.615840:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12885 00000100:00100000:2.0:1746065146.615849:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12886 00000100:00100000:2.0:1746065146.615853:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3762:x1830881263288064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.615889:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065146.615891:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.615893:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.615894:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.615896:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746065146.615913:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3762:x1830881263288064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (238us total) trans 21474840861 rc 0/0 00000100:00100000:2.0:1746065146.615918:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12886 00000100:00100000:2.0:1746065146.615926:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12887 00000100:00100000:2.0:1746065146.615930:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3762:x1830881263288576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.615966:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:2.0:1746065146.615979:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.615981:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.615982:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.615983:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:2.0:1746065146.616000:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3762:x1830881263288576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (298us total) trans 21474840862 rc 0/0 00000100:00100000:2.0:1746065146.616004:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12887 00000004:00080000:2.0:1746065146.616027:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954be680/2, rc 0, transno 17179873417 00000100:00100000:2.0:1746065146.616029:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263287552:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065146.616035:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd5c00/2, rc 0, transno 21474840861 00000100:00100000:2.0:1746065146.616037:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263288064:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065146.616043:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4a80/2, rc 0, transno 21474840862 00000100:00100000:2.0:1746065146.616044:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263288576:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065146.616062:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52a300/2, rc 0, transno 17179873414 00000100:00100000:2.0:1746065146.616065:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263286656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.616069:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800954bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263287168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.616085:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.616095:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263287680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.616107:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.616116:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263288192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.616127:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.616142:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287168 00000100:00100000:2.0:1746065146.616144:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287168 00000100:00100000:2.0:1746065146.616154:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287680 00000100:00100000:2.0:1746065146.616156:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287680 00000100:00100000:2.0:1746065146.616161:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288192 00000100:00100000:2.0:1746065146.616163:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288192 00000100:00100000:2.0:1746065146.616171:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12888 00000100:00100000:2.0:1746065146.616175:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263287168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.616230:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881263287168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (144us total) trans 17179873418 rc 0/0 00000100:00100000:2.0:1746065146.616235:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12888 00000100:00100000:2.0:1746065146.616244:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12889 00000100:00100000:2.0:1746065146.616247:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881263287680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.616286:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065146.616288:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065146.616290:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:2.0:1746065146.616292:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065146.616293:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:2.0:1746065146.616323:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263287680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (215us total) trans 21474840863 rc 0/0 00000100:00100000:2.0:1746065146.616327:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12889 00000100:00100000:2.0:1746065146.616337:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12890 00000100:00100000:2.0:1746065146.616341:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881263288192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.616375:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:2.0:1746065146.616377:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065146.616378:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.616380:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065146.616381:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:2.0:1746065146.616398:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263288192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (270us total) trans 21474840864 rc 0/0 00000100:00100000:2.0:1746065146.616402:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12890 00000004:00080000:2.0:1746065146.616423:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800954bd880/2, rc 0, transno 17179873418 00000100:00100000:2.0:1746065146.616427:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800954bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263287168:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065146.616434:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e12a00/2, rc 0, transno 21474840863 00000100:00100000:2.0:1746065146.616436:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263287680:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065146.616441:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd7100/2, rc 0, transno 21474840864 00000100:00100000:2.0:1746065146.616443:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263288192:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065146.616550:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd5f80/2, rc 0, transno 21474840859 00000100:00100000:3.0:1746065146.616554:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263287936:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065146.616561:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4000/2, rc 0, transno 21474840860 00000100:00100000:3.0:1746065146.616563:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263288448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065146.619549:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.620060:0:9571:0:(service.c:3346:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1746065146.621822:0:9571:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:3.0:1746065146.622028:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396480 00000100:00100000:3.0:1746065146.622036:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396480 00000100:00100000:2.0:1746065146.622579:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13574 00000100:00100000:2.0:1746065146.622588:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+10:32070:x1830881263396480:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065146.622609:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.622624:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933026 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.622667:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.622677:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.622687:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065146.622689:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065146.622691:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.622697:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3da00, rc 0) 00000100:00100000:2.0:1746065146.623389:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+11:32070:x1830881263396480:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 800us (3844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.623399:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13574 00000100:00100000:1.0:1746065146.623482:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.623606:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396608 00000100:00100000:0.0:1746065146.623610:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396608 00010000:00010000:0.0:1746065146.623629:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 11 pid: 7204 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746065146.623646:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5762 00000100:00100000:0.0:1746065146.623651:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263396608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065146.623659:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065146.623663:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 11 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.623672:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 11 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.623687:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e93f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932ffc expref: 11 pid: 7204 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.623699:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065146.623703:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065146.623708:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065146.623714:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065146.623720:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065146.623725:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065146.623730:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.623735:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065146.623749:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065146.623769:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263396608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 118us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.623794:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5762 00010000:00010000:2.0:1746065146.623920:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065146.623926:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00000040:00080000:2.0:1746065146.624492:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].531, 88 off54784 00000004:00080000:2.0:1746065146.624498:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642723722ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624520:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].477, 88 off50032 00000004:00080000:2.0:1746065146.624523:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742642748998ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065146.624534:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].478, 88 off50120 00000004:00080000:2.0:1746065146.624537:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742642763136ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065146.624545:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].532, 88 off54872 00000004:00080000:2.0:1746065146.624548:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642774596ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624555:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].533, 88 off54960 00000004:00080000:2.0:1746065146.624557:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642783512ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624564:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].479, 88 off50208 00000004:00080000:2.0:1746065146.624567:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742642793292ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065146.624573:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].480, 88 off50296 00000004:00080000:2.0:1746065146.624575:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742642801984ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065146.624582:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].481, 88 off50384 00000004:00080000:2.0:1746065146.624584:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742642810094ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065146.624590:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].534, 88 off55048 00000004:00080000:2.0:1746065146.624592:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642818756ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624598:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].482, 88 off50472 00000004:00080000:2.0:1746065146.624600:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742642826732ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065146.624607:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].535, 88 off55136 00000004:00080000:2.0:1746065146.624609:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642835882ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624615:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].483, 88 off50560 00000004:00080000:2.0:1746065146.624617:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742642843218ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065146.624622:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].536, 88 off55224 00000004:00080000:2.0:1746065146.624624:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642850479ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624629:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].537, 88 off55312 00000004:00080000:2.0:1746065146.624631:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642857999ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624637:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].538, 88 off55400 00000004:00080000:2.0:1746065146.624639:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642865297ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624644:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].539, 88 off55488 00000004:00080000:2.0:1746065146.624646:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742642872302ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065146.624651:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].484, 88 off50648 00000004:00080000:2.0:1746065146.624653:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742642879261ns, next at 615601404258ns, rc = 0 00000001:00080000:0.0:1746065146.635622:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935892 is committed 00000004:00080000:0.0:1746065146.635631:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 478 committed 00000004:00080000:0.0:1746065146.635655:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 532 committed 00000004:00080000:0.0:1746065146.635668:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 531 committed 00000004:00080000:0.0:1746065146.635670:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 530 committed 00000004:00080000:0.0:1746065146.635671:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 529 committed 00000004:00080000:0.0:1746065146.635672:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 477 committed 00000004:00080000:0.0:1746065146.635674:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 528 committed 00000004:00080000:0.0:1746065146.635675:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 476 committed 00000004:00080000:0.0:1746065146.635676:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 527 committed 00000004:00080000:0.0:1746065146.635678:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 475 committed 00000004:00080000:0.0:1746065146.635679:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 474 committed 00000004:00080000:0.0:1746065146.635681:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 473 committed 00000004:00080000:0.0:1746065146.635682:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 526 committed 00000004:00080000:0.0:1746065146.635683:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 525 committed 00000004:00080000:0.0:1746065146.635684:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 472 committed 00000004:00080000:0.0:1746065146.635686:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 471 committed 00000004:00080000:0.0:1746065146.635687:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 524 committed 00000100:00100000:1.0:1746065146.635853:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263289216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065146.635899:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065146.635939:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263289728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065146.635952:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065146.635976:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065146.635980:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263289088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065146.635994:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065146.636003:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263289600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065146.636014:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065146.636033:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289216 00000100:00100000:1.0:1746065146.636038:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289216 00000100:00100000:1.0:1746065146.636063:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289728 00000100:00100000:1.0:1746065146.636065:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289728 00000100:00100000:1.0:1746065146.636073:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289088 00000100:00100000:1.0:1746065146.636074:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289088 00000100:00100000:1.0:1746065146.636082:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289600 00000100:00100000:1.0:1746065146.636084:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289600 00000100:00100000:1.0:1746065146.636093:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12891 00000100:00100000:1.0:1746065146.636099:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3762:x1830881263289216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065146.636200:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:1.0:1746065146.636203:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065145 -> 1746065145 00002000:00010000:1.0:1746065146.636205:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065145 -> 1746065145 00002000:00010000:1.0:1746065146.636206:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065145 -> 1746065145 00002000:00010000:1.0:1746065146.636208:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:1.0:1746065146.636231:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263289216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (331us total) trans 21474840865 rc 0/0 00000100:00100000:1.0:1746065146.636236:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12891 00000100:00100000:1.0:1746065146.636249:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12892 00000100:00100000:1.0:1746065146.636254:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3762:x1830881263289728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065146.636284:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065146.636286:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065146.636288:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065146.636289:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065146.636291:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:1.0:1746065146.636304:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263289728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (351us total) trans 21474840866 rc 0/0 00000100:00100000:1.0:1746065146.636308:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12892 00000100:00100000:1.0:1746065146.636317:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12893 00000100:00100000:1.0:1746065146.636320:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3762:x1830881263289088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065146.636347:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065146.636350:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065145 -> 1746065145 00002000:00010000:1.0:1746065146.636352:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065141 -> 1746065141 00002000:00010000:1.0:1746065146.636353:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065145 -> 1746065145 00002000:00010000:1.0:1746065146.636355:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065146.636368:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263289088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (374us total) trans 21474840867 rc 0/0 00000100:00100000:1.0:1746065146.636372:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12893 00000100:00100000:1.0:1746065146.636380:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12894 00000100:00100000:1.0:1746065146.636384:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3762:x1830881263289600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065146.636420:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263289600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 36us (405us total) trans 21474840868 rc 0/0 00000100:00100000:1.0:1746065146.636424:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12894 00000100:00100000:2.0:1746065146.636471:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263289344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.636491:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065146.636574:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263290112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.641074:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263289856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.641123:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.641218:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263290368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.641237:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.641250:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263290880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.641263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.641274:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746065146.641279:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263288960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.641292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.641303:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263289472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.641316:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.641322:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263289984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.641333:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.641340:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263290496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.641350:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.641371:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289344 00000100:00100000:2.0:1746065146.641377:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289344 00000100:00100000:2.0:1746065146.641401:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289856 00000100:00100000:2.0:1746065146.641403:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289856 00000100:00100000:2.0:1746065146.641408:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290368 00000100:00100000:2.0:1746065146.641410:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290368 00000100:00100000:2.0:1746065146.641416:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290880 00000100:00100000:2.0:1746065146.641417:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290880 00000100:00100000:2.0:1746065146.641422:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288960 00000100:00100000:2.0:1746065146.641423:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288960 00000100:00100000:2.0:1746065146.641428:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289472 00000100:00100000:2.0:1746065146.641429:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289472 00000100:00100000:2.0:1746065146.641434:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289984 00000100:00100000:2.0:1746065146.641435:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289984 00000100:00100000:2.0:1746065146.641441:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290496 00000100:00100000:2.0:1746065146.641442:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290496 00000100:00100000:2.0:1746065146.641451:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12895 00000100:00100000:2.0:1746065146.641456:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263289344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.641563:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065146.641565:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.641567:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.641569:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.641571:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746065146.641599:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263289344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (5107us total) trans 21474840869 rc 0/0 00000100:00100000:2.0:1746065146.641604:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12895 00000100:00100000:2.0:1746065146.641617:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12896 00000100:00100000:2.0:1746065146.641621:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263289856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.641660:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:2.0:1746065146.641663:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.641664:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.641666:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065146.641667:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:2.0:1746065146.641684:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263289856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (562us total) trans 21474840870 rc 0/0 00000100:00100000:2.0:1746065146.641689:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12896 00000100:00100000:2.0:1746065146.641697:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12897 00000100:00100000:2.0:1746065146.641701:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881263290368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065146.641750:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065146.641752:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065146.641754:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.641756:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065146.641757:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:2.0:1746065146.641788:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263290368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (549us total) trans 17179873419 rc 0/0 00000100:00100000:2.0:1746065146.641793:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12897 00000100:00100000:2.0:1746065146.641801:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12898 00000100:00100000:2.0:1746065146.641805:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881263290880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.641858:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263290880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (594us total) trans 17179873420 rc 0/0 00000100:00100000:2.0:1746065146.641863:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12898 00000100:00100000:2.0:1746065146.641871:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12899 00000100:00100000:2.0:1746065146.641875:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263288960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.641912:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065146.641914:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065146.641915:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065140 -> 1746065140 00002000:00010000:2.0:1746065146.641917:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065146.641918:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:2.0:1746065146.641934:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263288960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (641us total) trans 21474840871 rc 0/0 00000100:00100000:2.0:1746065146.641938:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12899 00000100:00100000:2.0:1746065146.641947:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12900 00000100:00100000:2.0:1746065146.641951:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263289472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065146.641996:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:2.0:1746065146.641998:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065146.642000:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065146.642001:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065146.642003:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:2.0:1746065146.642020:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263289472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (704us total) trans 21474840872 rc 0/0 00000100:00100000:2.0:1746065146.642025:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12900 00000100:00100000:2.0:1746065146.642034:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12901 00000100:00100000:2.0:1746065146.642038:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881263289984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065146.642075:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065146.642077:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065146.642079:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065146.642081:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:2.0:1746065146.642082:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065146.642099:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263289984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (765us total) trans 17179873421 rc 0/0 00000100:00100000:2.0:1746065146.642104:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12901 00000100:00100000:2.0:1746065146.642113:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12902 00000100:00100000:2.0:1746065146.642116:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881263290496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065146.642162:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263290496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (811us total) trans 17179873422 rc 0/0 00000100:00100000:2.0:1746065146.642167:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12902 00000004:00080000:2.0:1746065146.642209:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b64700/2, rc 0, transno 21474840871 00000100:00100000:2.0:1746065146.642219:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263288960:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065146.642227:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b66300/2, rc 0, transno 21474840872 00000100:00100000:2.0:1746065146.642230:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263289472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065146.642236:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a6a00/2, rc 0, transno 17179873421 00000100:00100000:2.0:1746065146.642239:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263289984:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065146.642245:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097e54e00/2, rc 0, transno 17179873422 00000100:00100000:2.0:1746065146.642247:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263290496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065146.642252:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097e54380/2, rc 0, transno 17179873419 00000100:00100000:2.0:1746065146.642254:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263290368:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065146.642259:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097e56a00/2, rc 0, transno 17179873420 00000100:00100000:2.0:1746065146.642263:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263290880:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065146.642269:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b67b80/2, rc 0, transno 21474840869 00000100:00100000:2.0:1746065146.642271:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263289344:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065146.642277:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090ddb480/2, rc 0, transno 21474840870 00000100:00100000:2.0:1746065146.642280:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263289856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.642320:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065146.642325:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263291008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.642342:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065146.642358:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291008 00000100:00100000:2.0:1746065146.642361:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291008 00000100:00100000:2.0:1746065146.642376:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12903 00000100:00100000:2.0:1746065146.642380:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263291008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065146.642431:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3759:x1830881263291008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (88us total) trans 21474840873 rc 0/0 00000100:00100000:2.0:1746065146.642436:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12903 00000004:00080000:2.0:1746065146.642455:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc1500/2, rc 0, transno 21474840873 00000100:00100000:2.0:1746065146.642457:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263291008:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065146.642513:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.642523:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065146.642525:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065146.642528:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065146.642535:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065146.642543:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065146.642547:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.642552:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.642556:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.642561:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.642568:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.642573:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.642594:0:7203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065146.642602:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263291136:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065146.642652:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00010000:00010000:2.0:1746065146.642661:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065146.642667:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065146.642707:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065146.642711:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065146.642726:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065146.642749:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146e98c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.642766:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.642788:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065146.642790:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065146.642793:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00000100:00100000:2.0:1746065146.642819:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+31:32075:x1830881263396224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 35863us (36006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.642825:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13572 00000100:00100000:3.0:1746065146.643246:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065146.643265:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263290624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.643283:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065146.643303:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065146.643308:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263290240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.643321:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065146.643332:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263290752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.643345:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065146.643360:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290112 00000100:00100000:3.0:1746065146.643363:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290112 00000100:00100000:3.0:1746065146.643379:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290624 00000100:00100000:3.0:1746065146.643380:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290624 00000100:00100000:3.0:1746065146.643390:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290240 00000100:00100000:3.0:1746065146.643392:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290240 00000100:00100000:3.0:1746065146.643397:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290752 00000100:00100000:3.0:1746065146.643398:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290752 00000100:00100000:3.0:1746065146.643405:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12904 00000100:00100000:3.0:1746065146.643410:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3761:x1830881263290112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065146.643462:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065146.643464:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065144 -> 1746065144 00002000:00010000:3.0:1746065146.643467:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065142 -> 1746065142 00002000:00010000:3.0:1746065146.643468:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065144 -> 1746065144 00002000:00010000:3.0:1746065146.643470:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065146.643491:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3761:x1830881263290112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (246us total) trans 17179873423 rc 0/0 00000100:00100000:3.0:1746065146.643496:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12904 00000100:00100000:3.0:1746065146.643505:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12905 00000100:00100000:3.0:1746065146.643509:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3761:x1830881263290624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.643558:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3761:x1830881263290624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (274us total) trans 17179873424 rc 0/0 00000100:00100000:3.0:1746065146.643563:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12905 00000100:00100000:3.0:1746065146.643572:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12906 00000100:00100000:3.0:1746065146.643576:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3761:x1830881263290240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065146.643609:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065146.643611:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065145 -> 1746065145 00002000:00010000:3.0:1746065146.643613:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065145 -> 1746065145 00002000:00010000:3.0:1746065146.643614:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065145 -> 1746065145 00002000:00010000:3.0:1746065146.643616:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746065146.643632:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3761:x1830881263290240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (309us total) trans 17179873425 rc 0/0 00000100:00100000:3.0:1746065146.643636:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12906 00000100:00100000:3.0:1746065146.643645:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12907 00000100:00100000:3.0:1746065146.643649:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3761:x1830881263290752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065146.643696:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3761:x1830881263290752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (349us total) trans 17179873426 rc 0/0 00000100:00100000:3.0:1746065146.643703:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12907 00000004:00080000:3.0:1746065146.643728:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097e54000/2, rc 0, transno 17179873425 00000100:00100000:3.0:1746065146.643732:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263290240:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065146.643737:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097e57100/2, rc 0, transno 17179873426 00000100:00100000:3.0:1746065146.643739:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263290752:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065146.643745:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097e55880/2, rc 0, transno 17179873423 00000100:00100000:3.0:1746065146.643747:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263290112:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065146.643752:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097e54700/2, rc 0, transno 17179873424 00000100:00100000:3.0:1746065146.643754:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263290624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065146.643882:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b67100/2, rc 0, transno 21474840867 00000100:00100000:1.0:1746065146.643886:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263289088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065146.643893:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b66680/2, rc 0, transno 21474840868 00000100:00100000:1.0:1746065146.643895:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263289600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065146.643902:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b66d80/2, rc 0, transno 21474840865 00000100:00100000:1.0:1746065146.643904:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263289216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065146.643911:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090dd9180/2, rc 0, transno 21474840866 00000100:00100000:1.0:1746065146.643913:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263289728:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065146.644846:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.644856:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065146.644885:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065146.644889:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065146.644901:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.644928:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc146e99a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.644946:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.644952:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065146.644954:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065146.644956:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad800, rc 0) 00000100:00100000:2.0:1746065146.645512:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32074:x1830881263396352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 30486us (38654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.645518:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13573 00000100:00100000:0.0:1746065146.646484:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.646557:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396736 00000100:00100000:3.0:1746065146.646563:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396736 00000100:00100000:3.0:1746065146.646592:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4881 00000100:00100000:3.0:1746065146.646599:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32070:x1830881263396736:12345-192.168.202.27@tcp:49:multiop.0 00000100:00100000:3.0:1746065146.646662:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32070:x1830881263396736:12345-192.168.202.27@tcp:49:multiop.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065146.646667:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4881 00000100:00100000:2.0:1746065146.647517:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263291136:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065146.647544:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc146e97e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 30 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065146.647558:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.647575:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67600, rc 0) 00000100:00100000:2.0:1746065146.647595:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32069:x1830881263395840:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 59202us (60254us total) trans 8589935892 rc 0/0 00000100:00100000:2.0:1746065146.647601:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13571 00000100:00100000:0.0:1746065146.649317:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.649400:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396864 00000100:00100000:2.0:1746065146.649406:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396864 00000100:00100000:2.0:1746065146.649449:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13575 00000100:00100000:2.0:1746065146.649456:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32075:x1830881263396864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065146.649472:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.649491:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146e9af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93302d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.649532:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146e9af lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93302d expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.649543:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146e9af lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93302d expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.649554:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065146.649557:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065146.649560:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4c00, rc 0) 00000100:00100000:2.0:1746065146.649602:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+30:32075:x1830881263396864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 146us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.649607:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13575 00000100:00100000:0.0:1746065146.651263:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.651325:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396992 00000100:00100000:1.0:1746065146.651330:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396992 00000100:00100000:1.0:1746065146.651360:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12908 00000100:00100000:1.0:1746065146.651366:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+40:32069:x1830881263396992:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065146.651378:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065146.651392:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933034 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.651412:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065146.651419:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.651421:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.651424:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3272704->3358719] (req 3272704->3358719) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.651447:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065146.651457:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 12 pid: 9548 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746065146.651467:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263291264:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065146.651512:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065146.656396:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.656481:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397120 00000100:00100000:2.0:1746065146.656489:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397120 00000100:00100000:2.0:1746065146.656539:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12909 00000100:00100000:2.0:1746065146.656546:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:32070:x1830881263397120:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065146.656562:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.656577:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93303b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.656604:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.656610:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065146.656612:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065146.656615:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3768320->3833855] (req 3768320->3833855) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.656641:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.656651:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 9 pid: 3067 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746065146.656661:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263291392:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065146.657296:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065146.659078:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.659112:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.659127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.659140:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.659165:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.659176:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.659199:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.659227:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397504 00000100:00100000:0.0:1746065146.659232:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397504 00010000:00010000:0.0:1746065146.659260:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 13 pid: 9548 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746065146.659282:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5763 00000100:00100000:0.0:1746065146.659289:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263397504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065146.659300:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065146.659317:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 13 pid: 9548 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746065146.659331:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 13 pid: 9548 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746065146.659351:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659352:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659359:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.659365:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.659391:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065146.659401:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263291520:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065146.659461:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065146.659475:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397248 00000100:00100000:0.0:1746065146.659478:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397248 00000100:00100000:0.0:1746065146.659493:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397376 00000100:00100000:0.0:1746065146.659495:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397376 00000100:00100000:0.0:1746065146.659504:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397632 00000100:00100000:0.0:1746065146.659506:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397632 00000100:00100000:0.0:1746065146.659514:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397760 00000100:00100000:0.0:1746065146.659515:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397760 00000100:00100000:0.0:1746065146.659521:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397888 00000100:00100000:0.0:1746065146.659522:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397888 00000100:00100000:0.0:1746065146.659527:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398016 00000100:00100000:0.0:1746065146.659528:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398016 00000100:00100000:0.0:1746065146.659537:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12910 00000100:00100000:0.0:1746065146.659541:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263397248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065146.659551:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065146.659559:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933042 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.659570:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659571:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659575:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.659583:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.659590:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61800, rc 0) 00000100:00100000:0.0:1746065146.659608:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263397248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.659613:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12910 00000100:00100000:0.0:1746065146.659628:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12911 00000100:00100000:0.0:1746065146.659632:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263397376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065146.659638:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065146.659646:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933049 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.659655:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659656:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659659:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.659671:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.659677:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:0.0:1746065146.659691:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263397376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.659695:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12911 00000100:00100000:0.0:1746065146.659704:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12912 00000100:00100000:0.0:1746065146.659709:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263397632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065146.659714:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065146.659720:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933050 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.659728:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659729:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659733:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.659739:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.659745:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929fac00, rc 0) 00000100:00100000:0.0:1746065146.659758:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263397632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 50us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.659762:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12912 00000100:00100000:0.0:1746065146.659800:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12913 00000100:00100000:0.0:1746065146.659806:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263397760:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065146.659811:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065146.659817:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933057 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.659826:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659827:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.659830:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.659838:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.659843:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4a00, rc 0) 00000100:00100000:0.0:1746065146.659858:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881263397760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 52us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.659863:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12913 00000100:00100000:0.0:1746065146.659872:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12914 00000100:00100000:0.0:1746065146.659876:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263397888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065146.659881:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065146.659886:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc146e9e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93305e expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065146.659906:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263291648:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065146.659940:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065146.659958:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12915 00000100:00100000:0.0:1746065146.659964:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263398016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065146.659981:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065146.659987:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146e9e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933065 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.659997:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.660001:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146e9e7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933065 expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.660008:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146e9e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933065 expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.660021:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6800, rc 0) 00000100:00100000:0.0:1746065146.660035:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263398016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (836us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065146.660040:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12915 00010000:00010000:1.0:1746065146.660403:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146e8ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe0 expref: 13 pid: 9548 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746065146.660416:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263291264:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065146.660431:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.660437:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01a00, rc 0) 00000100:00100000:1.0:1746065146.660457:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+41:32069:x1830881263396992:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9091us (9199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065146.660462:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12908 00000100:00100000:1.0:1746065146.668503:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.668994:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.669018:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.669060:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398912 00000100:00100000:0.0:1746065146.669069:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398912 00000100:00100000:0.0:1746065146.669108:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 718 00000100:00100000:0.0:1746065146.669115:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263398912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065146.669128:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065146.669148:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4c00/0xad6b7ddc146e9af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93302d expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.669163:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065146.669166:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065146.669201:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263398912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.669207:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 718 00000100:00100000:1.0:1746065146.669518:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.671501:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.672079:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398272 00000100:00100000:3.0:1746065146.672086:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398272 00000100:00100000:3.0:1746065146.672100:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398528 00000100:00100000:3.0:1746065146.672102:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398528 00000100:00100000:3.0:1746065146.672128:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398784 00000100:00100000:3.0:1746065146.672130:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398784 00000100:00100000:3.0:1746065146.672143:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12916 00000100:00100000:3.0:1746065146.672149:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263398528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065146.672162:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.672176:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933081 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.672194:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.672196:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.672203:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 42 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.672215:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 42 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.672225:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be600, rc 0) 00000100:00100000:3.0:1746065146.672259:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263398528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 111us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065146.672265:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12916 00000100:00100000:3.0:1746065146.672278:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12917 00000100:00100000:3.0:1746065146.672282:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263398784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065146.672289:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.672296:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc146e9f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93308f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.672307:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.672313:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc146e9f5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93308f expref: 34 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.672320:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc146e9f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93308f expref: 34 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.672344:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf800, rc 0) 00000100:00100000:3.0:1746065146.672359:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263398784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 76us (2842us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065146.672363:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12917 00000100:00100000:3.0:1746065146.682852:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12918 00000100:00100000:3.0:1746065146.682859:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263398272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065146.682872:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.682886:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933073 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.682906:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.682908:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.682915:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.682926:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.682934:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:3.0:1746065146.682982:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263398272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 123us (14487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065146.682987:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12918 00000100:00100000:1.0:1746065146.693681:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.693706:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.693749:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.693794:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.693810:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399296 00000100:00100000:1.0:1746065146.693816:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399296 00002000:00100000:1.0:1746065146.693855:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3272704->3276799) req@ffff8800900f0000 x1830881263399296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.693865:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0000 with x1830881263399296 ext(3272704->3276799) 00002000:00010000:1.0:1746065146.693870:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0000 00000100:00100000:1.0:1746065146.693886:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3573 00000100:00100000:1.0:1746065146.693893:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263399296:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065146.694014:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263399296:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 119us (218us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065146.694020:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3573 00002000:00100000:1.0:1746065146.694026:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3272704->3276799) req@ffff8800900f0000 x1830881263399296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.694037:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0000 with x1830881263399296 ext(3272704->3276799) 00002000:00010000:1.0:1746065146.694039:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0000 00000100:00100000:2.0:1746065146.694276:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263291392:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065146.694300:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3768320->3833855] (req 3768320->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.694312:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5600, rc 0) 00000100:00100000:2.0:1746065146.694331:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+20:32070:x1830881263397120:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 37787us (37956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.694337:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12909 00000100:00100000:2.0:1746065146.694350:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398144 00000100:00100000:2.0:1746065146.694352:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398144 00000100:00100000:2.0:1746065146.694364:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398400 00000100:00100000:2.0:1746065146.694365:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398400 00000100:00100000:2.0:1746065146.694374:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398656 00000100:00100000:2.0:1746065146.694376:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398656 00000100:00100000:2.0:1746065146.694384:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12919 00000100:00100000:2.0:1746065146.694388:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263398144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065146.694395:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.694406:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93306c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.694420:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065146.694422:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065146.694429:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 44 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.694440:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 44 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.694446:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67000, rc 0) 00000100:00100000:2.0:1746065146.694460:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881263398144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (22963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.694464:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12919 00000100:00100000:2.0:1746065146.694473:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12920 00000100:00100000:2.0:1746065146.694477:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263398400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065146.694482:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.694490:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93307a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.694500:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065146.694501:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065146.694504:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.694512:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.694521:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4a00, rc 0) 00000100:00100000:2.0:1746065146.694534:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263398400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.694538:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12920 00000100:00100000:2.0:1746065146.694546:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12921 00000100:00100000:2.0:1746065146.694550:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263398656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065146.694556:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.694561:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5e00/0xad6b7ddc146ea11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933088 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065146.694589:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263291776:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065146.694791:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399040 00000100:00100000:0.0:1746065146.694795:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399040 00010000:00010000:0.0:1746065146.694811:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 10 pid: 3067 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746065146.694829:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5764 00000100:00100000:0.0:1746065146.694834:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263399040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065146.694841:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065146.694853:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 10 pid: 3067 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746065146.694863:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 10 pid: 3067 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746065146.694878:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5400/0xad6b7ddc146e8c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fe7 expref: 10 pid: 3067 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746065146.694887:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.694889:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.694893:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.694900:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.694923:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065146.694932:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263291904:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065146.694980:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263291520:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065146.694990:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065146.695009:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263397504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 35719us (35896us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.695015:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5763 00000100:00100000:0.0:1746065146.695074:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263291648:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065146.695091:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc146e9e0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93305e expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.695099:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc146e9e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93305e expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065146.695106:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60400, rc 0) 00000100:00100000:0.0:1746065146.695123:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263397888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 35246us (35945us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065146.695128:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12914 00000100:00100000:0.0:1746065146.703201:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.703354:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399552 00000100:00100000:1.0:1746065146.703362:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399552 00002000:00100000:1.0:1746065146.703396:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3354624->3358719) req@ffff88012f1a5880 x1830881263399552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.703405:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881263399552 ext(3354624->3358719) 00002000:00010000:1.0:1746065146.703409:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5880 00000100:00100000:1.0:1746065146.703425:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3574 00000100:00100000:1.0:1746065146.703432:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263399552:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065146.703542:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263399552:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 110us (348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065146.703548:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3574 00002000:00100000:1.0:1746065146.703552:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3354624->3358719) req@ffff88012f1a5880 x1830881263399552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.703558:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881263399552 ext(3354624->3358719) 00002000:00010000:1.0:1746065146.703561:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5880 00000100:00100000:0.0:1746065146.704898:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.704965:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399808 00000100:00100000:1.0:1746065146.704978:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399808 00002000:00100000:1.0:1746065146.705001:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3768320->3772415) req@ffff88012f1a7800 x1830881263399808/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.705009:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7800 with x1830881263399808 ext(3768320->3772415) 00002000:00010000:1.0:1746065146.705012:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7800 00000100:00100000:1.0:1746065146.705026:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3575 00000100:00100000:1.0:1746065146.705031:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263399808:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065146.705107:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263399808:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 76us (213us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065146.705113:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3575 00002000:00100000:1.0:1746065146.705117:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3768320->3772415) req@ffff88012f1a7800 x1830881263399808/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.705123:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7800 with x1830881263399808 ext(3768320->3772415) 00002000:00010000:1.0:1746065146.705126:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7800 00000100:00100000:2.0:1746065146.718116:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00002000:00010000:2.0:1746065146.718179:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065145 -> 1746065146 00002000:00010000:2.0:1746065146.718182:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065145 -> 1746065146 00000100:00100000:2.0:1746065146.718198:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263291776:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065146.718226:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5e00/0xad6b7ddc146ea11 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933088 expref: 44 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.718238:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5e00/0xad6b7ddc146ea11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933088 expref: 44 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.718252:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5e00, rc 0) 00000100:00100000:2.0:1746065146.718319:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263398656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 23766us (24611us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065146.718329:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12921 00000100:00100000:0.0:1746065146.718546:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065146.718563:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263291904:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065146.718574:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065146.718605:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263399040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 23771us (24855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065146.718613:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5764 00000100:00100000:0.0:1746065146.722343:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.722422:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400064 00000100:00100000:1.0:1746065146.722430:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400064 00002000:00100000:1.0:1746065146.722464:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097fa6680 x1830881263400064/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.722472:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa6680 with x1830881263400064 ext(0->1048575) 00002000:00010000:1.0:1746065146.722476:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa6680 00000100:00100000:1.0:1746065146.722492:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3576 00000100:00100000:1.0:1746065146.722498:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263400064:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065146.733318:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.733349:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.733372:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400704 00000100:00100000:1.0:1746065146.733379:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400704 00002000:00100000:1.0:1746065146.733413:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff8800900f2d80 x1830881263400704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.733422:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2d80 with x1830881263400704 ext(1048576->2097151) 00002000:00010000:1.0:1746065146.733428:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2d80 00000100:00100000:1.0:1746065146.733455:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400832 00000100:00100000:1.0:1746065146.733458:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400832 00002000:00100000:1.0:1746065146.733470:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800900f2a00 x1830881263400832/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.733476:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2a00 with x1830881263400832 ext(1048576->2097151) 00002000:00010000:1.0:1746065146.733479:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2a00 00000100:00100000:1.0:1746065146.733493:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3577 00000100:00100000:1.0:1746065146.733498:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263400704:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065146.734105:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.734640:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.734667:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.734698:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400320 00000100:00100000:1.0:1746065146.734702:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400320 00000100:00100000:1.0:1746065146.734727:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4882 00000100:00100000:1.0:1746065146.734732:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32069:x1830881263400320:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065146.734927:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+30:32069:x1830881263400320:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 193us (822us total) trans 8589935893 rc 0/0 00000100:00100000:1.0:1746065146.734932:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4882 00000100:00100000:1.0:1746065146.735029:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400960 00000100:00100000:1.0:1746065146.735032:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400960 00002000:00100000:1.0:1746065146.735049:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800900f1880 x1830881263400960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.735055:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1880 with x1830881263400960 ext(1048576->2097151) 00002000:00010000:1.0:1746065146.735059:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f1880 00000100:00100000:1.0:1746065146.735069:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401088 00000100:00100000:1.0:1746065146.735071:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401088 00002000:00100000:1.0:1746065146.735082:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (3829760->3833855) req@ffff8800900f0380 x1830881263401088/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.735088:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0380 with x1830881263401088 ext(3829760->3833855) 00002000:00010000:1.0:1746065146.735090:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f0380 00000100:00100000:1.0:1746065146.735101:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3578 00000100:00100000:1.0:1746065146.735106:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263400832:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065146.735642:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3579 00000100:00100000:1.0:1746065146.735648:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+25:2006:x1830881263400960:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065146.737045:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3580 00000100:00100000:0.0:1746065146.737056:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263401088:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065146.737168:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263401088:12345-192.168.202.27@tcp:3:cat.0 Request processed in 114us (2499us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065146.737175:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3580 00002000:00100000:0.0:1746065146.737182:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (3829760->3833855) req@ffff8800900f0380 x1830881263401088/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065146.737191:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0380 with x1830881263401088 ext(3829760->3833855) 00002000:00010000:0.0:1746065146.737197:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f0380 00000100:00100000:0.0:1746065146.740959:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.741005:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.741036:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.741057:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401728 00000100:00100000:0.0:1746065146.741064:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401728 00002000:00100000:0.0:1746065146.741101:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88012f09fb80 x1830881263401728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065146.741110:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09fb80 with x1830881263401728 ext(1048576->2097151) 00002000:00010000:0.0:1746065146.741114:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09fb80 00000100:00100000:0.0:1746065146.741127:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401600 00000100:00100000:0.0:1746065146.741130:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401600 00002000:00100000:0.0:1746065146.741142:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012f09ea00 x1830881263401600/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065146.741147:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ea00 with x1830881263401600 ext(1048576->2097151) 00002000:00010000:0.0:1746065146.741150:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ea00 00000100:00100000:0.0:1746065146.741158:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401984 00000100:00100000:0.0:1746065146.741160:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401984 00002000:00100000:0.0:1746065146.741171:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880099cf2d80 x1830881263401984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065146.741176:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2d80 with x1830881263401984 ext(0->1048575) 00002000:00010000:0.0:1746065146.741179:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf2d80 00000100:00100000:0.0:1746065146.741191:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3581 00000100:00100000:0.0:1746065146.741197:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263401728:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065146.741818:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3582 00000100:00100000:0.0:1746065146.741824:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263401600:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065146.742342:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3583 00000100:00100000:0.0:1746065146.742348:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263401984:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065146.742958:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.743004:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402112 00000100:00100000:0.0:1746065146.743009:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402112 00002000:00100000:0.0:1746065146.743033:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cf0a80 x1830881263402112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065146.743041:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0a80 with x1830881263402112 ext(1048576->2097151) 00002000:00010000:0.0:1746065146.743045:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0a80 00000100:00100000:0.0:1746065146.743058:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3584 00000100:00100000:0.0:1746065146.743063:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263402112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065146.752011:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263400064:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29503us (29666us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065146.752020:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3576 00002000:00100000:0.0:1746065146.752030:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097fa6680 x1830881263400064/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065146.752039:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa6680 with x1830881263400064 ext(0->1048575) 00002000:00010000:0.0:1746065146.752044:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa6680 00000100:00100000:1.0:1746065146.781071:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263400704:12345-192.168.202.27@tcp:3:cat.0 Request processed in 47564us (47751us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065146.781080:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3577 00002000:00100000:1.0:1746065146.781090:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff8800900f2d80 x1830881263400704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.781099:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2d80 with x1830881263400704 ext(1048576->2097151) 00002000:00010000:1.0:1746065146.781104:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2d80 00000100:00100000:1.0:1746065146.784709:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263400832:12345-192.168.202.27@tcp:3:cat.0 Request processed in 49595us (51352us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065146.784719:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3578 00002000:00100000:1.0:1746065146.784729:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800900f2a00 x1830881263400832/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.784738:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2a00 with x1830881263400832 ext(1048576->2097151) 00002000:00010000:1.0:1746065146.784744:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2a00 00000100:00100000:1.0:1746065146.803424:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263400960:12345-192.168.202.27@tcp:3:cat.0 Request processed in 67763us (68771us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065146.803436:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3579 00002000:00100000:1.0:1746065146.803448:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800900f1880 x1830881263400960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.803456:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1880 with x1830881263400960 ext(1048576->2097151) 00002000:00010000:1.0:1746065146.803462:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f1880 00000100:00100000:0.0:1746065146.806352:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.807585:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402496 00000100:00100000:1.0:1746065146.807595:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402496 00000100:00100000:1.0:1746065146.807667:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4883 00000100:00100000:1.0:1746065146.807677:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32070:x1830881263402496:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065146.808028:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+10:32070:x1830881263402496:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 350us (1682us total) trans 8589935894 rc 0/0 00000100:00100000:1.0:1746065146.808035:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4883 00000100:00100000:1.0:1746065146.816563:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263401728:12345-192.168.202.27@tcp:3:cat.0 Request processed in 75358us (75603us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065146.816573:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3581 00002000:00100000:1.0:1746065146.816582:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88012f09fb80 x1830881263401728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.816591:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09fb80 with x1830881263401728 ext(1048576->2097151) 00002000:00010000:1.0:1746065146.816596:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09fb80 00000100:00100000:0.0:1746065146.830302:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.833385:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402624 00000100:00100000:2.0:1746065146.833395:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402624 00000100:00100000:2.0:1746065146.833445:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12922 00000100:00100000:2.0:1746065146.833452:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+23:32074:x1830881263402624:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065146.833466:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.833479:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933096 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.833503:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.833509:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065146.833510:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065146.833514:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.833536:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.833545:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 46 pid: 9549 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065146.833553:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263292032:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065146.833622:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065146.835362:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263401600:12345-192.168.202.27@tcp:3:cat.0 Request processed in 93533us (94352us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065146.835370:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3582 00002000:00100000:2.0:1746065146.835378:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012f09ea00 x1830881263401600/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065146.835385:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ea00 with x1830881263401600 ext(1048576->2097151) 00002000:00010000:2.0:1746065146.835390:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ea00 00000100:00100000:2.0:1746065146.840729:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263401984:12345-192.168.202.27@tcp:3:cat.0 Request processed in 98373us (99684us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065146.840738:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3583 00002000:00100000:2.0:1746065146.840747:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880099cf2d80 x1830881263401984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065146.840756:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2d80 with x1830881263401984 ext(0->1048575) 00002000:00010000:2.0:1746065146.840761:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf2d80 00000100:00100000:2.0:1746065146.843807:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263292032:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065146.843834:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.843847:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:2.0:1746065146.844077:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+24:32074:x1830881263402624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10623us (13780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.844084:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12922 00000100:00100000:2.0:1746065146.849155:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263402112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 106084us (106190us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065146.849165:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3584 00002000:00100000:2.0:1746065146.849176:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cf0a80 x1830881263402112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065146.849184:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0a80 with x1830881263402112 ext(1048576->2097151) 00002000:00010000:2.0:1746065146.849189:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0a80 00000100:00100000:0.0:1746065146.849539:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.849575:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402752 00000100:00100000:2.0:1746065146.849581:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402752 00002000:00100000:2.0:1746065146.849606:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3272704->3358719) req@ffff880135222300 x1830881263402752/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065146.849613:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222300 with x1830881263402752 ext(3272704->3358719) 00010000:00010000:2.0:1746065146.849619:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 43 pid: 9549 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065146.849630:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 43 pid: 9549 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746065146.849635:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135222300 00000100:00100000:2.0:1746065146.849648:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1260 00000100:00100000:2.0:1746065146.849654:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263402752:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065146.857665:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881263402752:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8001us (8118us total) trans 21474840874 rc 0/0 00000100:00100000:0.0:1746065146.857675:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1260 00002000:00100000:0.0:1746065146.857684:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3272704->3358719) req@ffff880135222300 x1830881263402752/t21474840874(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/448 e 0 to 0 dl 1746065157 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065146.857693:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222300 with x1830881263402752 ext(3272704->3358719) 00010000:00010000:0.0:1746065146.857701:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 45 pid: 9549 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746065146.857713:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 45 pid: 9549 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746065146.857719:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135222300 00000001:00080000:0.0:1746065146.858437:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840874 is committed 00000001:00080000:0.0:1746065146.858445:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840873 is committed 00000001:00080000:0.0:1746065146.858472:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840855 is committed 00000001:00080000:0.0:1746065146.858488:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840843 is committed 00000100:00100000:0.0:1746065146.870044:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.870082:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.870176:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.870274:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403136 00000100:00100000:3.0:1746065146.870282:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403136 00000100:00100000:3.0:1746065146.870312:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403008 00000100:00100000:3.0:1746065146.870314:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403008 00000100:00100000:3.0:1746065146.870336:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12923 00000100:00100000:3.0:1746065146.870342:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263403136:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065146.870357:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.870371:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146ea1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330a4 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065146.870410:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263292160:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065146.870470:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065146.870488:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12924 00000100:00100000:3.0:1746065146.870492:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263403008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065146.870498:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.870506:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f70a600/0xad6b7ddc146ea26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93309d expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065146.870524:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263292288:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065146.870538:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065146.870799:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402880 00000100:00100000:2.0:1746065146.870802:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402880 00010000:00010000:2.0:1746065146.870817:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 23 pid: 9549 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746065146.871926:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5765 00000100:00100000:1.0:1746065146.871934:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263402880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065146.871944:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065146.871959:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 23 pid: 9549 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065146.871978:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 23 pid: 9549 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065146.871995:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.871996:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065146.872001:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 7 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.872008:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 7 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.872028:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 7 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065146.872035:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263292416:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065146.872079:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c03c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065146.873629:0:13375:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880097e57b80 x1830881263292288) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 23 pid: 9549 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746065146.873655:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01a00/0xad6b7ddc146e9b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3358719) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933034 expref: 23 pid: 9549 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065146.873669:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263292288:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065146.873690:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70a600/0xad6b7ddc146ea26 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93309d expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.873699:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70a600/0xad6b7ddc146ea26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93309d expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065146.873707:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70a600, rc 0) 00000100:00100000:2.0:1746065146.873734:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263403008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3240us (3556us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065146.873740:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12924 00002000:00010000:3.0:1746065146.873877:0:1880:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065145 -> 1746065147 00002000:00010000:3.0:1746065146.873880:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065145 -> 1746065147 00002000:00010000:3.0:1746065146.873882:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065145 -> 1746065147 00000100:00100000:3.0:1746065146.873891:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263292160:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065146.873904:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146ea1f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330a4 expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.873913:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146ea1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330a4 expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.873937:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfe00, rc 0) 00000100:00100000:3.0:1746065146.874315:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263403136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3972us (4231us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065146.874321:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12923 00000100:00100000:1.0:1746065146.886022:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263292416:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065146.886040:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065146.886090:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881263402880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 14156us (16052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065146.886102:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5765 00000100:00100000:0.0:1746065146.889113:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.890564:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403264 00000100:00100000:3.0:1746065146.890574:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403264 00000100:00100000:3.0:1746065146.890920:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12925 00000100:00100000:3.0:1746065146.890927:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+20:32075:x1830881263403264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065146.890942:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.890957:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330ab expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.891002:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.891003:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.891009:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.891021:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.891030:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31200, rc 0) 00000100:00100000:3.0:1746065146.891066:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+21:32075:x1830881263403264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 140us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065146.891071:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12925 00000100:00100000:2.0:1746065146.895252:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.895410:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.895468:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403648 00000100:00100000:3.0:1746065146.895476:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403648 00002000:00100000:3.0:1746065146.895514:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88008c45b800 x1830881263403648/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065146.895523:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45b800 with x1830881263403648 ext(2097152->4194303) 00002000:00010000:3.0:1746065146.895527:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c45b800 00000100:00100000:0.0:1746065146.895591:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403776 00000100:00100000:0.0:1746065146.895594:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403776 00002000:00100000:0.0:1746065146.895611:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008c458000 x1830881263403776/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 504/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065146.895617:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458000 with x1830881263403776 ext(2097152->4194303) 00002000:00010000:0.0:1746065146.895620:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458000 00000100:00100000:0.0:1746065146.895635:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3585 00000100:00100000:0.0:1746065146.895641:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263403776:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065146.895910:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3586 00000100:00100000:3.0:1746065146.895915:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263403648:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065146.896879:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.902616:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404032 00000100:00100000:1.0:1746065146.902625:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404032 00000100:00100000:1.0:1746065146.902672:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13576 00000100:00100000:1.0:1746065146.902678:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32080:x1830881263404032:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065146.902697:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065146.902712:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc146ea34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330b2 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.902786:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902796:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902803:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902813:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902818:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902822:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902888:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902895:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902899:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065146.902909:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065146.902958:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902964:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902979:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902984:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902988:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1a800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065146.902991:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.902996:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903004:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065146.903006:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065146.903009:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903013:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146ea3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903027:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903031:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903039:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903042:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065146.903044:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903048:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903053:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5d00) 00010000:00010000:1.0:1746065146.903054:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065146.903056:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903060:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a000/0xad6b7ddc146ea42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065146.903096:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc146ea34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 33 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.903110:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 32 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065146.903117:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065146.903118:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065146.903120:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a400, rc 0) 00000100:00100000:1.0:1746065146.903172:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+32:32080:x1830881263404032:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 492us (6292us total) trans 8589935895 rc 0/0 00000100:00100000:1.0:1746065146.903178:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13576 00010000:00010000:3.0:1746065146.907805:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065146.918835:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065146.924052:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263403648:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28124us (28795us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065146.924063:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3586 00002000:00100000:3.0:1746065146.924075:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88008c45b800 x1830881263403648/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065146.924084:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45b800 with x1830881263403648 ext(2097152->4194303) 00002000:00010000:3.0:1746065146.924089:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c45b800 00000100:00100000:2.0:1746065146.924186:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404288 00000100:00100000:2.0:1746065146.924195:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404288 00002000:00100000:2.0:1746065146.924231:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88008f7fe680 x1830881263404288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065146.924239:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe680 with x1830881263404288 ext(2097152->3145727) 00002000:00010000:2.0:1746065146.924242:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe680 00000100:00100000:2.0:1746065146.924286:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3587 00000100:00100000:2.0:1746065146.924297:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263404288:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065146.940453:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263403776:12345-192.168.202.27@tcp:3:cat.0 Request processed in 44803us (45034us total) trans 0 rc 2031616/2031616 00000100:00100000:2.0:1746065146.940461:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3585 00002000:00100000:2.0:1746065146.940471:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008c458000 x1830881263403776/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 504/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 2031616/2031616 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065146.940480:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458000 with x1830881263403776 ext(2097152->4194303) 00002000:00010000:2.0:1746065146.940484:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458000 00000100:00100000:2.0:1746065146.951639:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263404288:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27335us (32802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065146.951648:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3587 00002000:00100000:2.0:1746065146.951658:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88008f7fe680 x1830881263404288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065146.951666:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe680 with x1830881263404288 ext(2097152->3145727) 00002000:00010000:2.0:1746065146.951672:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe680 00000100:00100000:0.0:1746065146.964213:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.965021:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065146.965166:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404416 00000100:00100000:2.0:1746065146.965174:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404416 00000100:00100000:3.0:1746065146.965527:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404672 00000100:00100000:3.0:1746065146.965530:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404672 00002000:00100000:3.0:1746065146.965559:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880099ec6680 x1830881263404672/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065146.965567:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6680 with x1830881263404672 ext(4194304->5021695) 00002000:00010000:3.0:1746065146.965572:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec6680 00000100:00100000:3.0:1746065146.965597:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3588 00000100:00100000:3.0:1746065146.965603:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263404672:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065146.966803:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12926 00000100:00100000:2.0:1746065146.966812:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:32075:x1830881263404416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065146.966822:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.966837:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330b9 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.966856:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.966864:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065146.966865:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065146.966868:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.966891:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.966901:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 19 pid: 9550 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746065146.966910:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263292544:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065146.969529:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065146.974897:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.974994:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404800 00000100:00100000:1.0:1746065146.975002:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404800 00002000:00100000:1.0:1746065146.975039:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3768320->3833855) req@ffff880099ec7100 x1830881263404800/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/0 e 0 to 0 dl 1746065157 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.975048:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7100 with x1830881263404800 ext(3768320->3833855) 00010000:00010000:1.0:1746065146.975056:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 20 pid: 9550 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065146.975069:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 20 pid: 9550 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746065146.975075:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec7100 00000100:00100000:2.0:1746065146.975361:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263292544:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065146.975382:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.975394:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc800, rc 0) 00000100:00100000:2.0:1746065146.975443:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:32075:x1830881263404416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8632us (11237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065146.975450:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12926 00000100:00100000:1.0:1746065146.975592:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1261 00000100:00100000:1.0:1746065146.975600:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263404800:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065146.989931:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263404672:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24319us (24902us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065146.989942:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3588 00002000:00100000:2.0:1746065146.989952:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880099ec6680 x1830881263404672/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/440 e 0 to 0 dl 1746065157 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065146.989960:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6680 with x1830881263404672 ext(4194304->5021695) 00002000:00010000:2.0:1746065146.989972:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec6680 00000100:00100000:1.0:1746065146.990631:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263404800:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15031us (15741us total) trans 17179873427 rc 0/0 00000100:00100000:1.0:1746065146.990638:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1261 00002000:00100000:1.0:1746065146.990643:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3768320->3833855) req@ffff880099ec7100 x1830881263404800/t17179873427(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:62/0 lens 488/448 e 0 to 0 dl 1746065157 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065146.990650:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7100 with x1830881263404800 ext(3768320->3833855) 00010000:00010000:1.0:1746065146.990657:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 22 pid: 9550 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746065146.990670:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 22 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065146.990680:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec7100 00000100:00100000:0.0:1746065146.997296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.997418:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405056 00000100:00100000:1.0:1746065146.997427:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405056 00000100:00100000:2.0:1746065146.997571:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13577 00000100:00100000:2.0:1746065146.997580:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+10:32083:x1830881263405056:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065146.997599:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065146.997613:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146ea5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330c0 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.997673:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.997684:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.997693:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.997703:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.997708:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.997713:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.997890:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.997898:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.997904:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065146.997911:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065146.997995:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998000:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998004:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998009:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998014:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dda00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065146.998017:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998022:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998032:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065146.998034:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065146.998037:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998042:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc146ea65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998408:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998418:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998422:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998425:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dce00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065146.998427:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998431:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998437:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091b5d000) 00010000:00010000:2.0:1746065146.998439:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065146.998440:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998444:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065146.998474:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146ea5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 13 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.998484:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 12 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065146.998489:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065146.998491:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065146.998493:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd000, rc 0) 00000100:00100000:2.0:1746065146.998545:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+12:32083:x1830881263405056:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 965us (1255us total) trans 8589935896 rc 0/0 00000100:00100000:2.0:1746065146.998551:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13577 00000100:00100000:1.0:1746065146.998728:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065146.999382:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065146.999426:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405312 00000100:00100000:0.0:1746065146.999432:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405312 00010000:00010000:0.0:1746065146.999453:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 22 pid: 9550 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065146.999485:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5766 00000100:00100000:0.0:1746065146.999492:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263405312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065146.999501:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065146.999515:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 22 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065146.999524:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 22 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065146.999540:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc146e9bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3768320->3833855) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93303b expref: 22 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065146.999553:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.999555:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065146.999561:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065146.999567:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065146.999574:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405184 00000100:00100000:3.0:1746065146.999579:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405184 00010000:00010000:0.0:1746065146.999592:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065146.999601:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12927 00000100:00100000:0.0:1746065146.999604:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263292672:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065146.999607:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263405184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065146.999616:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065146.999626:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330c7 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065146.999637:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.999638:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065146.999643:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065146.999653:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065146.999659:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846840 going to sleep for 11 seconds 00010000:00010000:3.0:1746065146.999660:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6000, rc 0) 00000100:00100000:3.0:1746065146.999677:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263405184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 70us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065146.999681:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12927 00000100:00100000:2.0:1746065147.000658:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263292672:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065147.000673:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.000705:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263405312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1214us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.000711:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5766 00000100:00100000:0.0:1746065147.004854:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.005023:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405440 00000100:00100000:3.0:1746065147.005031:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405440 00000100:00100000:3.0:1746065147.005363:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12928 00000100:00100000:3.0:1746065147.005371:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+22:32083:x1830881263405440:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065147.005385:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.005400:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330ce expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.005423:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.005431:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.005436:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.005438:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.005441:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->2818047] (req 2637824->2818047) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.005466:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.005475:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 23 pid: 13375 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.005486:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263292800:192.168.202.27@tcp:104: 00000100:00080000:2.0:1746065147.005656:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065147.006042:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.006051:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 34 pid: 13375 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.006058:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263292928:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.006601:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.006936:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.007104:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263292800:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.007150:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405696 00000100:00100000:1.0:1746065147.007155:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405696 00002000:00100000:1.0:1746065147.007679:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009a6dc380 x1830881263405696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.007687:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc380 with x1830881263405696 ext(2097152->4194303) 00010000:00010000:1.0:1746065147.007693:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 35 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.007702:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 35 pid: 13375 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065147.007708:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6dc380 00000100:00100000:1.0:1746065147.007726:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1262 00000100:00100000:1.0:1746065147.007732:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263405696:12345-192.168.202.27@tcp:3:cat.0 00000100:00080000:2.0:1746065147.008090:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065147.010582:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.010620:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.010644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.010716:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405824 00000100:00100000:2.0:1746065147.010722:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405824 00010000:00010000:2.0:1746065147.010748:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.010788:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5767 00000100:00100000:2.0:1746065147.010795:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263405824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.010805:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.010819:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.010828:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.010845:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc146ea81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c7 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.010863:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.010897:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263405824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.010903:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5767 00000100:00100000:3.0:1746065147.011254:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406208 00000100:00100000:3.0:1746065147.011258:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406208 00002000:00100000:3.0:1746065147.011285:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa0700 x1830881263406208/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.011293:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0700 with x1830881263406208 ext(3145728->4194303) 00002000:00010000:3.0:1746065147.011306:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0700 00000100:00100000:3.0:1746065147.011320:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3589 00000100:00100000:3.0:1746065147.011325:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263406208:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065147.012393:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405952 00000100:00100000:3.0:1746065147.012398:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405952 00000100:00100000:3.0:1746065147.012421:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12929 00000100:00100000:3.0:1746065147.012426:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263405952:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.012436:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.012448:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146ea8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330d5 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.012462:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.012469:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146ea8f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330d5 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.012477:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146ea8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330d5 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.012488:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44600, rc 0) 00000100:00100000:3.0:1746065147.012510:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263405952:12345-192.168.202.27@tcp:101:cat.0 Request processed in 84us (1889us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065147.012519:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12929 00000100:00080000:2.0:1746065147.013432:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065147.014873:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263292928:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.014901:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2637824->2818047] (req 2637824->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.014913:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6c00, rc 0) 00000100:00100000:0.0:1746065147.019240:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+22:32083:x1830881263405440:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 13860us (14384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.019248:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12928 00000100:00100000:0.0:1746065147.022729:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.022798:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406464 00000100:00100000:2.0:1746065147.022807:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406464 00000100:00100000:2.0:1746065147.022862:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4884 00000100:00100000:2.0:1746065147.022871:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+12:32074:x1830881263406464:12345-192.168.202.27@tcp:35:cat.0 00000100:00080000:0.0:1746065147.023258:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065147.023949:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+13:32074:x1830881263406464:12345-192.168.202.27@tcp:35:cat.0 Request processed in 1077us (1225us total) trans 8589935897 rc 0/0 00000100:00100000:2.0:1746065147.023956:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4884 00000100:00100000:3.0:1746065147.027406:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263406208:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16072us (16753us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065147.027416:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3589 00002000:00100000:3.0:1746065147.027425:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa0700 x1830881263406208/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.027433:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0700 with x1830881263406208 ext(3145728->4194303) 00002000:00010000:3.0:1746065147.027439:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0700 00000100:00100000:1.0:1746065147.037445:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263405696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29705us (30501us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065147.037455:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1262 00002000:00100000:1.0:1746065147.037465:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009a6dc380 x1830881263405696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.037480:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc380 with x1830881263405696 ext(2097152->4194303) 00010000:00010000:1.0:1746065147.037490:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 35 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.037503:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 35 pid: 13375 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065147.037509:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6dc380 00000100:00100000:0.0:1746065147.054546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.054589:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.054798:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406592 00000100:00100000:2.0:1746065147.054806:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406592 00000100:00100000:2.0:1746065147.055142:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12930 00000100:00100000:3.0:1746065147.055149:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406720 00000100:00100000:2.0:1746065147.055152:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:32075:x1830881263406592:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065147.055154:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406720 00010000:00010000:2.0:1746065147.055170:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.055176:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.055183:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330dc expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.055203:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.055205:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.055212:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 37 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.055225:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 37 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.055238:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc400, rc 0) 00000100:00100000:3.0:1746065147.055403:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5768 00000100:00100000:3.0:1746065147.055408:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263406720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065147.055408:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+37:32075:x1830881263406592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 257us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.055415:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12930 00010000:00010000:3.0:1746065147.055417:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.055433:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.055444:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.055458:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ea57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b9 expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.056507:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.056510:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.056517:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.056526:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.056768:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.056791:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e55f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263293056:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065147.058864:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.081313:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.081427:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406976 00000100:00100000:1.0:1746065147.081434:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406976 00002000:00100000:1.0:1746065147.081470:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009577df80 x1830881263406976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.081478:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577df80 with x1830881263406976 ext(3145728->4194303) 00002000:00010000:1.0:1746065147.081484:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577df80 00000100:00100000:1.0:1746065147.081513:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3590 00000100:00100000:1.0:1746065147.081519:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263406976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.081717:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.081809:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e55f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263293056:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065147.081824:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.081855:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263406720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 26447us (27265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.081863:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5768 00000100:00100000:2.0:1746065147.082073:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407232 00000100:00100000:2.0:1746065147.082077:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407232 00002000:00100000:2.0:1746065147.082094:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2637824->2641919) req@ffff88009577e300 x1830881263407232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.082100:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577e300 with x1830881263407232 ext(2637824->2641919) 00002000:00010000:2.0:1746065147.082103:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577e300 00000100:00100000:2.0:1746065147.082114:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3591 00000100:00100000:2.0:1746065147.082118:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263407232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065147.082193:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263407232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 74us (477us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065147.082199:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3591 00002000:00100000:2.0:1746065147.082203:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2637824->2641919) req@ffff88009577e300 x1830881263407232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.082209:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577e300 with x1830881263407232 ext(2637824->2641919) 00002000:00010000:2.0:1746065147.082212:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577e300 00000100:00100000:0.0:1746065147.093463:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.093534:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.093592:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407616 00000100:00100000:3.0:1746065147.093600:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407616 00000100:00100000:3.0:1746065147.093653:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4885 00000100:00100000:3.0:1746065147.093660:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+13:32083:x1830881263407616:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065147.093894:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+14:32083:x1830881263407616:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 233us (358us total) trans 8589935898 rc 0/0 00000100:00100000:3.0:1746065147.093899:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4885 00000100:00100000:2.0:1746065147.094027:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407360 00000100:00100000:2.0:1746065147.094031:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407360 00000100:00080000:1.0:1746065147.094067:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065147.094070:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13578 00000100:00100000:2.0:1746065147.094076:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:32085:x1830881263407360:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065147.094089:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.094105:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330e3 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.094147:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094158:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094168:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094179:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094185:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094190:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094242:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094251:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094257:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065147.094279:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065147.094283:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065147.094296:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094304:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094311:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094315:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094320:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094325:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094330:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065147.094333:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094339:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094348:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065147.094350:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065147.094353:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094358:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eaa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094371:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094375:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094379:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094383:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065147.094385:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094389:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094394:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091b5db00) 00010000:00010000:2.0:1746065147.094396:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065147.094397:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094401:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146eaab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.094423:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc146ea9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.094433:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.094439:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.094440:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065147.094443:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e26200, rc 0) 00000100:00100000:2.0:1746065147.094484:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32085:x1830881263407360:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 407us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.094490:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13578 00000100:00100000:1.0:1746065147.099432:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263406976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17906us (18119us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065147.099441:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3590 00002000:00100000:1.0:1746065147.099452:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009577df80 x1830881263406976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.099460:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577df80 with x1830881263406976 ext(3145728->4194303) 00002000:00010000:1.0:1746065147.099465:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577df80 00000100:00100000:0.0:1746065147.106868:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.106903:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.106946:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.106992:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407744 00000100:00100000:0.0:1746065147.107001:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407744 00000100:00100000:0.0:1746065147.107047:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407872 00000100:00100000:0.0:1746065147.107050:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407872 00000100:00100000:0.0:1746065147.107061:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408000 00000100:00100000:0.0:1746065147.107062:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408000 00000100:00100000:0.0:1746065147.107074:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12931 00000100:00100000:0.0:1746065147.107081:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263407744:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065147.107082:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12932 00000100:00100000:1.0:1746065147.107091:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263407872:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065147.107098:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.107100:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.107112:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146eac0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330f1 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.107112:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330ea expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.107131:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.107133:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065147.107138:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146eac0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f1 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.107141:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.107148:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc146eac0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f1 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.107155:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.107160:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a600, rc 0) 00010000:00010000:0.0:1746065147.107162:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a175000, rc 0) 00000100:00100000:2.0:1746065147.107219:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12933 00000100:00100000:2.0:1746065147.107226:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+21:32080:x1830881263408000:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065147.107232:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.107238:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330f8 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.107250:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 7 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.107256:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.107262:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.107266:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.107267:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.107269:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.107289:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.107298:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 22 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.107306:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263293184:192.168.202.27@tcp:104: 00000100:00080000:3.0:1746065147.107384:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746065147.107387:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065147.107448:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263407872:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 359us (543us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065147.107454:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12932 00010000:00010000:2.0:1746065147.107511:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.107518:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.107525:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263293312:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.107544:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 7 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.107550:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 7 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.107556:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263293440:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.107570:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.108061:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263407744:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 979us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.108066:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12931 00000100:00100000:0.0:1746065147.116174:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.116861:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263293184:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.116878:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263293312:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.116887:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263293440:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.116920:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.116937:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc000, rc 0) 00000100:00100000:3.0:1746065147.117000:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+22:32080:x1830881263408000:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9772us (10050us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.117009:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12933 00000100:00100000:3.0:1746065147.117039:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408128 00000100:00100000:3.0:1746065147.117046:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408128 00000100:00100000:3.0:1746065147.117111:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12934 00000100:00100000:3.0:1746065147.117120:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263408128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.117135:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.117151:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc146eace lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9330ff expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.117181:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc146eace lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ff expref: 36 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.117190:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc146eace lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ff expref: 36 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.117210:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:3.0:1746065147.117236:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263408128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 116us (1071us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065147.117241:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12934 00000100:00100000:0.0:1746065147.118388:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.118430:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408256 00000100:00100000:3.0:1746065147.118434:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408256 00010000:00010000:3.0:1746065147.118449:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 22 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.118477:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5769 00000100:00100000:3.0:1746065147.118481:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263408256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.118491:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.118506:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 22 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.118514:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 22 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.118528:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc146ea2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ab expref: 22 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.118537:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.118555:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263408256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.118560:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5769 00000100:00100000:0.0:1746065147.125012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.125259:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408384 00000100:00100000:2.0:1746065147.125269:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408384 00010000:00010000:2.0:1746065147.125696:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 8 pid: 1880 timeout: 843 lvb_type: 0 00000100:00080000:3.0:1746065147.125756:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065147.126515:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5770 00000100:00100000:2.0:1746065147.126525:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263408384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.126539:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.126560:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 8 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.126575:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 8 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.126599:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146ea18 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933096 expref: 8 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.127355:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.127395:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408640 00000100:00100000:3.0:1746065147.127402:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408640 00010000:00010000:2.0:1746065147.127492:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.128540:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13579 00000100:00100000:3.0:1746065147.128549:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32085:x1830881263408640:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065147.128566:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.128580:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146ead5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933106 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.128664:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.128676:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.128682:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 13 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.128688:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 31 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.128693:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 13 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.128698:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.128704:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 8/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.128733:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.128742:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 8 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.128752:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e57480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263293568:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.128922:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263408384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2397us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.128930:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5770 00000100:00100000:0.0:1746065147.129052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.129140:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.129164:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408896 00000100:00100000:0.0:1746065147.129167:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408896 00000100:00100000:0.0:1746065147.129191:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12935 00000100:00100000:0.0:1746065147.129196:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+21:32075:x1830881263408896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065147.129204:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.129213:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93310d expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.129226:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.129228:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.129234:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.129245:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.129252:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130105000, rc 0) 00000100:00100000:0.0:1746065147.129274:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:32075:x1830881263408896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 78us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.129279:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12935 00000100:00100000:2.0:1746065147.129396:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408768 00000100:00100000:2.0:1746065147.129400:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408768 00010000:00010000:2.0:1746065147.129414:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.129429:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5771 00000100:00100000:2.0:1746065147.129434:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263408768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.129443:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.129456:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.129463:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.129477:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc146eab9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ea expref: 12 pid: 1880 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.129486:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.129487:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.129490:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.129496:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.129513:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.129520:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263293696:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065147.129558:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e480 going to sleep for 11 seconds 00010000:00010000:3.0:1746065147.129903:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 13 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.129912:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 13 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.129921:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263293824:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.129946:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 31 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.129953:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 31 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.129958:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097e57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263293952:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.129990:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 13 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.129997:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 13 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.130009:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263294080:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.130029:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.130035:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 31 pid: 7231 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.130041:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263294208:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.130054:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065147.134048:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.134186:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409152 00000100:00100000:0.0:1746065147.134193:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409152 00002000:00100000:0.0:1746065147.134225:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff8800957d9180 x1830881263409152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.134233:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9180 with x1830881263409152 ext(4194304->5021695) 00002000:00010000:0.0:1746065147.134237:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9180 00000100:00100000:2.0:1746065147.134368:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263293696:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065147.134382:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.134414:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263408768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4979us (5361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.134421:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5771 00000100:00100000:0.0:1746065147.135031:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3592 00000100:00100000:0.0:1746065147.135039:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263409152:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.143613:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.144680:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.144702:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.144739:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409536 00000100:00100000:0.0:1746065147.144746:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409536 00010000:00010000:0.0:1746065147.144790:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 9 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.144812:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409664 00000100:00100000:0.0:1746065147.144814:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409664 00010000:00010000:0.0:1746065147.144824:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 14 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.144837:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5772 00000100:00100000:0.0:1746065147.144843:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263409536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.144855:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.144859:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 9 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.144867:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 9 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.144885:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.144888:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.144896:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.144901:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.144936:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263409536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.144942:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5772 00000100:00100000:0.0:1746065147.144955:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5773 00000100:00100000:0.0:1746065147.144960:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263409664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.144976:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.144980:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 14 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.144986:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 14 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.144995:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.144998:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.145002:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.145006:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.145019:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263409664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 59us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.145024:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5773 00010000:00010000:2.0:1746065147.145332:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e26200/0xad6b7ddc146eab2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330e3 expref: 8 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.145349:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e57480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263293568:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.145360:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd000/0xad6b7ddc146ea73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330c0 expref: 13 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.145370:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263293824:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.145489:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409408 00000100:00100000:3.0:1746065147.145493:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409408 00002000:00100000:3.0:1746065147.145527:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (3768320->3772415) req@ffff880097240000 x1830881263409408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.145537:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097240000 with x1830881263409408 ext(3768320->3772415) 00002000:00010000:3.0:1746065147.145541:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097240000 00000100:00100000:3.0:1746065147.145554:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3593 00000100:00100000:3.0:1746065147.145559:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263409408:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065147.145674:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263409408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 114us (2068us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065147.145679:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3593 00002000:00100000:3.0:1746065147.145684:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (3768320->3772415) req@ffff880097240000 x1830881263409408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.145690:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097240000 with x1830881263409408 ext(3768320->3772415) 00002000:00010000:3.0:1746065147.145693:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097240000 00000100:00100000:2.0:1746065147.147072:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.147101:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.147119:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.147636:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263409152:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12597us (13594us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065147.147644:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3592 00002000:00100000:2.0:1746065147.147652:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff8800957d9180 x1830881263409152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.147659:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9180 with x1830881263409152 ext(4194304->5021695) 00002000:00010000:2.0:1746065147.147664:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9180 00000100:00100000:0.0:1746065147.147829:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409920 00000100:00100000:0.0:1746065147.147835:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409920 00010000:00010000:0.0:1746065147.147857:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 13 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.147880:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409792 00000100:00100000:0.0:1746065147.147882:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409792 00010000:00010000:0.0:1746065147.147900:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 32 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.147912:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410048 00000100:00100000:0.0:1746065147.147914:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410048 00010000:00010000:0.0:1746065147.147921:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 33 pid: 7231 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.147933:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5774 00000100:00100000:0.0:1746065147.147938:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263409920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.147950:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.147954:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 13 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.147961:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 13 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.147991:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.147995:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148003:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148007:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.148029:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263409920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.148034:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5774 00000100:00100000:0.0:1746065147.148045:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5775 00000100:00100000:0.0:1746065147.148049:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263409792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.148055:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.148059:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 33 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.148071:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 33 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.148081:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.148083:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148087:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148091:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.148104:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263409792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.148109:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5775 00000100:00100000:0.0:1746065147.148117:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5776 00000100:00100000:0.0:1746065147.148120:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263410048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.148127:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.148130:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 32 pid: 7231 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.148137:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 32 pid: 7231 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.148144:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.148146:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148152:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148158:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148172:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.148185:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263410048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.148189:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5776 00010000:00010000:0.0:1746065147.148242:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc146ea49 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330b2 expref: 31 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.148262:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097e57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263293952:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.148273:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146e9a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93301f expref: 12 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.148281:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263294080:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.148289:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc146e993 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933018 expref: 30 pid: 7231 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.148297:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263294208:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.148323:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148330:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.148334:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:0.0:1746065147.148357:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065147.148497:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146ead5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933106 expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.148509:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933106 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.148516:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.148518:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065147.148520:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45600, rc 0) 00000100:00100000:0.0:1746065147.148540:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32085:x1830881263408640:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 19993us (21190us total) trans 8589935899 rc 0/0 00000100:00100000:0.0:1746065147.148545:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13579 00000100:00080000:2.0:1746065147.148838:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065147.157048:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.157128:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.157192:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410432 00000100:00100000:0.0:1746065147.157200:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410432 00000100:00100000:0.0:1746065147.157242:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13580 00000100:00100000:0.0:1746065147.157249:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32085:x1830881263410432:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065147.157271:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.157274:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065147.157298:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45600/0xad6b7ddc146eadc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933106 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065147.157365:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410304 00000100:00100000:1.0:1746065147.157369:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410304 00000100:00100000:1.0:1746065147.157398:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12936 00000100:00100000:1.0:1746065147.157403:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+35:32080:x1830881263410304:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065147.157411:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.157422:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933114 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.157443:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.157455:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065147.157456:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065147.157459:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3604479] (req 3145728->3604479) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.157481:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.157490:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.157500:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263294336:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.157558:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065147.157671:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.157675:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065147.157688:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eaf8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93311b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.157764:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158030:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158039:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158049:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158055:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158060:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158064:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f45000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065147.158068:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158073:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158079:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.158081:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065147.158083:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158088:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45000/0xad6b7ddc146eaff lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.158109:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eaf8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93311b expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.158115:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eaf8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93311b expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.158120:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c000, rc 0) 00000100:00100000:1.0:1746065147.158195:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32085:x1830881263410432:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 945us (1066us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065147.158201:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13580 00000100:00100000:0.0:1746065147.159959:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.161105:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.162191:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410560 00000100:00100000:2.0:1746065147.162199:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410560 00000100:00100000:2.0:1746065147.162240:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410688 00000100:00100000:2.0:1746065147.162242:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410688 00000100:00100000:2.0:1746065147.162264:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12937 00000100:00100000:2.0:1746065147.162271:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263410560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.162286:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.162301:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc146eb06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933122 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.162327:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc146eb06 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933122 expref: 23 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.162339:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc146eb06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933122 expref: 23 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065147.162407:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12938 00000100:00100000:3.0:1746065147.162415:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263410688:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.162421:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.162428:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc146eb0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933129 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.162442:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc146eb0d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933129 expref: 38 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.162449:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc146eb0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933129 expref: 38 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.162459:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3800, rc 0) 00000100:00100000:3.0:1746065147.162493:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263410688:12345-192.168.202.27@tcp:101:cat.0 Request processed in 79us (1390us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065147.162499:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12938 00000100:00100000:1.0:1746065147.163023:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263294336:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065147.163046:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3604479] (req 3145728->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.163055:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9000, rc 0) 00000100:00100000:1.0:1746065147.163074:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:32080:x1830881263410304:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5670us (6035us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.163078:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12936 00010000:00010000:2.0:1746065147.163164:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577bc00, rc 0) 00000100:00100000:2.0:1746065147.163183:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263410560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 913us (3228us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065147.163188:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12937 00000100:00100000:0.0:1746065147.165584:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.165632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.165698:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410816 00000100:00100000:3.0:1746065147.165704:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410816 00010000:00010000:3.0:1746065147.165734:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.165769:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5777 00000100:00100000:3.0:1746065147.165801:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263410816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.165813:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.165830:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.165842:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.165862:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146ea96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330dc expref: 36 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.165874:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.165876:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.165882:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 35 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.165889:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 35 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.165918:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 35 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.165928:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263294464:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065147.165997:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411072 00000100:00100000:2.0:1746065147.166001:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411072 00000100:00100000:2.0:1746065147.166031:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4886 00000100:00100000:2.0:1746065147.166036:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32085:x1830881263411072:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065147.166180:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32085:x1830881263411072:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 143us (547us total) trans 8589935900 rc 0/0 00000100:00100000:2.0:1746065147.166185:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4886 00000100:00100000:3.0:1746065147.166471:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.171579:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.171664:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.171732:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411200 00000100:00100000:3.0:1746065147.171740:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411200 00000100:00100000:3.0:1746065147.171805:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411328 00000100:00100000:3.0:1746065147.171808:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411328 00000100:00100000:1.0:1746065147.171815:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12939 00000100:00100000:1.0:1746065147.171828:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881263411200:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065147.171839:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12940 00010000:00010000:1.0:1746065147.171843:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065147.171844:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881263411328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.171851:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.171857:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146eb14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933130 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.171861:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc146eb1b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933137 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.171882:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146eb14 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933130 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.171891:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e26200/0xad6b7ddc146eb14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933130 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065147.171899:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263294592:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065147.171904:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e26200, rc 0) 00000100:00100000:3.0:1746065147.171954:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065147.171987:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881263411200:12345-192.168.202.27@tcp:101:cat.0 Request processed in 164us (415us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065147.171994:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12939 00000100:00100000:3.0:1746065147.172427:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263294464:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065147.172440:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.172471:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263410816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6672us (6892us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.172478:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5777 00000100:00100000:3.0:1746065147.173533:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263294592:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065147.173549:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc146eb1b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933137 expref: 36 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.173558:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc146eb1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933137 expref: 36 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.173566:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2600, rc 0) 00000100:00100000:3.0:1746065147.173601:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263411328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1757us (1936us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065147.173608:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12940 00000100:00100000:0.0:1746065147.179378:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.180050:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411584 00000100:00100000:2.0:1746065147.180058:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411584 00002000:00100000:2.0:1746065147.180093:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3600384->3604479) req@ffff880097243100 x1830881263411584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.180102:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243100 with x1830881263411584 ext(3600384->3604479) 00002000:00010000:2.0:1746065147.180106:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097243100 00000100:00100000:2.0:1746065147.180130:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3594 00000100:00100000:2.0:1746065147.180136:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263411584:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065147.180261:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263411584:12345-192.168.202.27@tcp:3:cat.0 Request processed in 124us (889us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065147.180267:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3594 00002000:00100000:2.0:1746065147.180272:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3600384->3604479) req@ffff880097243100 x1830881263411584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.180278:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243100 with x1830881263411584 ext(3600384->3604479) 00002000:00010000:2.0:1746065147.180280:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097243100 00000100:00100000:0.0:1746065147.191869:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.192401:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411840 00000100:00100000:2.0:1746065147.192411:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411840 00000100:00100000:2.0:1746065147.192458:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4887 00000100:00100000:2.0:1746065147.192465:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32080:x1830881263411840:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065147.192659:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:32080:x1830881263411840:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 194us (796us total) trans 8589935901 rc 0/0 00000100:00100000:2.0:1746065147.192665:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4887 00000100:00100000:0.0:1746065147.262698:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.264029:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412096 00000100:00100000:1.0:1746065147.264038:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412096 00000100:00100000:1.0:1746065147.264659:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13581 00000100:00100000:1.0:1746065147.264668:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+12:32091:x1830881263412096:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065147.264689:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.264706:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9400/0xad6b7ddc146eb22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93313e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.264893:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.264905:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.264915:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.264928:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.264933:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.264938:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265047:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265055:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265061:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065147.265068:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065147.265125:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265131:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265135:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265140:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265145:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065147.265148:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265153:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265162:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065147.265164:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065147.265167:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.265172:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146eb29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.266972:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.266983:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.266988:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.266993:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065147.266995:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.267000:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.267009:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5f00) 00010000:00010000:1.0:1746065147.267011:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065147.267013:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.267022:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146eb30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.267067:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9400/0xad6b7ddc146eb22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 15 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.267077:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 14 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.267082:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.267084:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065147.267086:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c600, rc 0) 00000100:00100000:1.0:1746065147.268368:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+14:32091:x1830881263412096:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3695us (5671us total) trans 8589935902 rc 0/0 00000100:00100000:1.0:1746065147.268377:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13581 00000100:00100000:0.0:1746065147.274435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.274495:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412224 00000100:00100000:3.0:1746065147.274503:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412224 00000100:00100000:3.0:1746065147.274550:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12941 00000100:00100000:3.0:1746065147.274556:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+7:32091:x1830881263412224:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065147.274571:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.274586:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933145 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.274609:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.274617:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 21 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.274623:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 8 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.274629:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.274631:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.274634:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [696320->708607] (req 696320->708607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.274656:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 8 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.274666:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 8 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.274675:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263294720:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.276121:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 21 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.276133:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 21 pid: 9550 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.276143:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263294848:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.276689:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.276698:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 10 pid: 3068 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.276706:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263294976:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.276740:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065147.276761:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263294720:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.284080:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263294848:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.284094:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263294976:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.284127:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [696320->708607] (req 696320->708607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.284141:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:3.0:1746065147.284212:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+8:32091:x1830881263412224:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9655us (9783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.284220:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12941 00000100:00100000:0.0:1746065147.284688:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.284805:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.284835:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412352 00000100:00100000:0.0:1746065147.284841:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412352 00010000:00010000:0.0:1746065147.284864:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 22 pid: 9550 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.284886:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412608 00000100:00100000:0.0:1746065147.284888:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412608 00010000:00010000:0.0:1746065147.284897:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 8 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.284916:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5778 00000100:00100000:0.0:1746065147.284922:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263412352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.284932:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.284948:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 22 pid: 9550 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.284957:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 22 pid: 9550 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.284985:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67000/0xad6b7ddc146ea03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93306c expref: 22 pid: 9550 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.285009:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.285029:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263412352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.285034:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5778 00000100:00100000:0.0:1746065147.285045:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5779 00000100:00100000:0.0:1746065147.285050:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263412608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.285056:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.285062:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 8 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.285069:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 8 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.285083:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61800/0xad6b7ddc146e9c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933042 expref: 8 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.285091:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.285106:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263412608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.285111:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5779 00000100:00100000:0.0:1746065147.291218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.291284:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412864 00000100:00100000:1.0:1746065147.291292:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412864 00000100:00100000:1.0:1746065147.291341:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13582 00000100:00100000:2.0:1746065147.291342:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.291349:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+14:32094:x1830881263412864:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065147.291368:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412480 00010000:00010000:1.0:1746065147.291368:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065147.291370:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412480 00010000:00010000:1.0:1746065147.291384:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146eb4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93314c expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.291387:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 11 pid: 3068 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.291402:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5780 00000100:00100000:2.0:1746065147.291405:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263412480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.291414:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.291430:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 11 pid: 3068 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.291439:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 11 pid: 3068 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.291456:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146e89e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fc4 expref: 11 pid: 3068 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746065147.291460:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065147.291470:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.291471:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.291473:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.291478:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 6 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.291480:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.291485:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 6 pid: 12260 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1746065147.291489:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065147.291507:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 6 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.291516:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263295104:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065147.291563:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc146eb4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 17 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.291578:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 16 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.291581:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ec00 going to sleep for 11 seconds 00010000:00010000:1.0:1746065147.291584:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.291586:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065147.291589:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7f000, rc 0) 00000100:00100000:1.0:1746065147.291611:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+16:32094:x1830881263412864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 263us (400us total) trans 8589935903 rc 0/0 00000100:00100000:1.0:1746065147.291617:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13582 00000100:00100000:0.0:1746065147.296150:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.296204:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413120 00000100:00100000:1.0:1746065147.296211:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413120 00000100:00100000:2.0:1746065147.296231:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263295104:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065147.296245:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065147.296248:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (696320->700415) req@ffff880097e56d80 x1830881263413120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.296256:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56d80 with x1830881263413120 ext(696320->700415) 00002000:00010000:1.0:1746065147.296259:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e56d80 00000100:00100000:2.0:1746065147.296279:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263412480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4871us (4936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.296287:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5780 00000100:00100000:3.0:1746065147.297450:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3595 00000100:00100000:3.0:1746065147.297459:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263413120:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065147.297572:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263413120:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 115us (1428us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065147.297579:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3595 00002000:00100000:3.0:1746065147.297584:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (696320->700415) req@ffff880097e56d80 x1830881263413120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.297590:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56d80 with x1830881263413120 ext(696320->700415) 00002000:00010000:3.0:1746065147.297593:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e56d80 00000100:00100000:0.0:1746065147.300149:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.300201:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413376 00000100:00100000:1.0:1746065147.300208:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413376 00002000:00100000:1.0:1746065147.300239:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (704512->708607) req@ffff880097e57480 x1830881263413376/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.300246:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e57480 with x1830881263413376 ext(704512->708607) 00002000:00010000:1.0:1746065147.300250:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e57480 00000100:00100000:1.0:1746065147.304043:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3596 00000100:00100000:1.0:1746065147.304061:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263413376:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065147.304201:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263413376:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 146us (4057us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065147.304207:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3596 00002000:00100000:1.0:1746065147.304213:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (704512->708607) req@ffff880097e57480 x1830881263413376/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.304221:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e57480 with x1830881263413376 ext(704512->708607) 00002000:00010000:1.0:1746065147.304226:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e57480 00000100:00100000:0.0:1746065147.312114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.313173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.313216:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.313239:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413888 00000100:00100000:1.0:1746065147.313246:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413888 00000100:00100000:1.0:1746065147.313291:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4888 00000100:00100000:1.0:1746065147.313298:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+16:32091:x1830881263413888:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065147.313473:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+17:32091:x1830881263413888:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 175us (302us total) trans 8589935904 rc 0/0 00000100:00100000:1.0:1746065147.313479:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4888 00000100:00100000:2.0:1746065147.314562:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.315533:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413632 00000100:00100000:3.0:1746065147.315540:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413632 00000100:00100000:1.0:1746065147.316883:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414016 00000100:00100000:1.0:1746065147.316890:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414016 00000100:00100000:1.0:1746065147.316919:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414144 00000100:00100000:1.0:1746065147.316922:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414144 00000100:00100000:1.0:1746065147.316940:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12942 00000100:00100000:1.0:1746065147.316946:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263414016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065147.316970:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.316987:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eb61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93315a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.317015:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eb61 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93315a expref: 8 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.317024:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eb61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93315a expref: 8 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.317034:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fe00, rc 0) 00000100:00100000:1.0:1746065147.317073:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263414016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 128us (3857us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065147.317078:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12942 00000100:00100000:1.0:1746065147.317091:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12943 00000100:00100000:1.0:1746065147.317095:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263414144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065147.317101:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.317108:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146eb68 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933161 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065147.317140:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263295232:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065147.317184:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065147.317744:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13583 00000100:00100000:3.0:1746065147.317753:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+31:32097:x1830881263413632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.317767:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.317805:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146eb6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933153 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.317868:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.317879:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.317888:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.317899:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.317904:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.317909:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318001:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318009:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318014:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065147.318020:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065147.318073:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318079:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318084:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318089:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318093:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065147.318097:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318102:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318110:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065147.318113:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065147.318116:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.318124:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146eb76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.319118:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.319128:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.319132:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.319136:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065147.319138:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.319142:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.319150:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a100) 00010000:00010000:3.0:1746065147.319152:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065147.319154:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.319158:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146eb7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.319198:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146eb6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 34 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.319207:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 33 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.319218:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.319220:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065147.319222:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2400, rc 0) 00000100:00100000:3.0:1746065147.319259:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32097:x1830881263413632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1509us (7153us total) trans 8589935905 rc 0/0 00000100:00100000:3.0:1746065147.319265:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13583 00000100:00100000:1.0:1746065147.321513:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263295232:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065147.321546:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146eb68 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933161 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.321557:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146eb68 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933161 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.321572:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:1.0:1746065147.321604:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263414144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4507us (7043us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065147.321611:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12943 00000100:00100000:0.0:1746065147.324807:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.327045:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414400 00000100:00100000:1.0:1746065147.327056:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414400 00000100:00100000:1.0:1746065147.327120:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4889 00000100:00100000:1.0:1746065147.327128:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+33:32097:x1830881263414400:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065147.327304:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+34:32097:x1830881263414400:12345-192.168.202.27@tcp:35:cat.0 Request processed in 176us (2535us total) trans 8589935906 rc 0/0 00000100:00100000:1.0:1746065147.327311:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4889 00000100:00100000:0.0:1746065147.328174:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.328214:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414656 00000100:00100000:2.0:1746065147.328219:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414656 00002000:00100000:2.0:1746065147.328249:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880134b03800 x1830881263414656/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 504/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.328257:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03800 with x1830881263414656 ext(0->1048575) 00002000:00010000:2.0:1746065147.328262:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b03800 00000100:00100000:2.0:1746065147.328277:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3597 00000100:00100000:2.0:1746065147.328282:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263414656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065147.340031:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.340068:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.340096:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414784 00000100:00100000:1.0:1746065147.340105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.340107:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414784 00000100:00100000:1.0:1746065147.340125:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414912 00000100:00100000:1.0:1746065147.340128:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414912 00000100:00100000:2.0:1746065147.340186:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415040 00000100:00100000:2.0:1746065147.340189:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415040 00000100:00100000:1.0:1746065147.340325:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12944 00000100:00100000:1.0:1746065147.340338:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263414784:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065147.340364:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12945 00010000:00010000:1.0:1746065147.340364:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065147.340373:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263414912:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.340380:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.340384:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eb92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933168 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.340389:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146eb99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93316f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.340413:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146eb99 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93316f expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.340423:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146eb99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93316f expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065147.340431:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263295360:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065147.340435:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2c00, rc 0) 00000100:00100000:3.0:1746065147.340472:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263414912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 101us (403us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065147.340478:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12945 00000100:00100000:3.0:1746065147.340493:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12946 00000100:00100000:3.0:1746065147.340498:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263415040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.340507:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.340516:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc146eba0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933176 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.340539:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263295488:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065147.340972:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065147.340981:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065147.348954:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263414656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20662us (20771us total) trans 0 rc 1036288/1036288 00000100:00100000:2.0:1746065147.348974:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3597 00002000:00100000:2.0:1746065147.348983:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880134b03800 x1830881263414656/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 504/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.348992:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03800 with x1830881263414656 ext(0->1048575) 00002000:00010000:2.0:1746065147.348997:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b03800 00002000:00010000:1.0:1746065147.349555:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065143 -> 1746065147 00002000:00010000:1.0:1746065147.349558:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065140 -> 1746065147 00002000:00010000:1.0:1746065147.349560:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065143 -> 1746065147 00000100:00100000:1.0:1746065147.349571:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263295360:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065147.349594:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eb92 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933168 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.349606:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eb92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933168 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.349627:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fe00, rc 0) 00000100:00100000:1.0:1746065147.349647:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263414784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9311us (9625us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065147.349653:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12944 00000100:00100000:2.0:1746065147.355173:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263295488:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065147.355198:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc146eba0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933176 expref: 36 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.355209:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc146eba0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933176 expref: 36 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.355237:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2800, rc 0) 00000100:00100000:2.0:1746065147.355278:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263415040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14779us (15172us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065147.355286:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12946 00000100:00100000:0.0:1746065147.366446:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.366498:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.366879:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415168 00000100:00100000:2.0:1746065147.366887:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415168 00000100:00100000:1.0:1746065147.366943:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415296 00000100:00100000:1.0:1746065147.366946:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415296 00000100:00100000:1.0:1746065147.367006:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12947 00000100:00100000:1.0:1746065147.367013:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263415296:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065147.367029:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.367045:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993f800/0xad6b7ddc146eba7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933184 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065147.367090:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263295616:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065147.367161:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065147.367200:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12948 00000100:00100000:2.0:1746065147.367205:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263415168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.367212:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.367220:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146ebae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93317d expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.367235:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146ebae lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93317d expref: 8 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.367243:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146ebae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93317d expref: 8 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.367450:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488800, rc 0) 00000100:00100000:2.0:1746065147.367477:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263415168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 270us (1039us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065147.367481:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12948 00000100:00100000:0.0:1746065147.381896:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.381977:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415424 00000100:00100000:2.0:1746065147.381984:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415424 00000100:00100000:2.0:1746065147.382028:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12949 00000100:00100000:2.0:1746065147.382034:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:32097:x1830881263415424:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.382048:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.382062:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93318b expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.382087:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 6 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.382094:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065147.382096:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065147.382099:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 22 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.382123:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 6 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.382133:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 6 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.382143:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263295744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.384351:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263295616:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065147.384374:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993f800/0xad6b7ddc146eba7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933184 expref: 23 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.384386:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993f800/0xad6b7ddc146eba7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933184 expref: 23 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.384401:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:1.0:1746065147.384445:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263415296:12345-192.168.202.27@tcp:101:cat.0 Request processed in 17431us (17944us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065147.384452:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12947 00000100:00100000:2.0:1746065147.384502:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.385347:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263295744:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.385360:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 22 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.385370:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488e00, rc 0) 00000100:00100000:0.0:1746065147.385570:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:32097:x1830881263415424:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3535us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.385576:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12949 00000100:00100000:0.0:1746065147.390003:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.390510:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415552 00000100:00100000:2.0:1746065147.390517:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415552 00002000:00100000:2.0:1746065147.390554:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (696320->708607) req@ffff8800a50fc450 x1830881263415552/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 12776/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.390563:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50fc450 with x1830881263415552 ext(696320->708607) 00010000:00010000:2.0:1746065147.390571:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 7 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.390583:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 7 pid: 12260 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.390589:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a50fc450 00000100:00100000:2.0:1746065147.390614:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1263 00000100:00100000:2.0:1746065147.390621:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263415552:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065147.397643:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.397724:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415680 00000100:00100000:1.0:1746065147.397732:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415680 00000100:00100000:1.0:1746065147.397765:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12950 00000100:00100000:1.0:1746065147.397784:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+10:32094:x1830881263415680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065147.397799:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.397813:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933192 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.397835:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065147.397836:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065147.397842:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.397854:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.397862:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fc00, rc 0) 00000100:00100000:1.0:1746065147.398672:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+11:32094:x1830881263415680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 899us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.398682:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12950 00000100:00100000:2.0:1746065147.398842:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263415552:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8220us (8845us total) trans 21474840875 rc 0/0 00000100:00100000:2.0:1746065147.398848:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1263 00002000:00100000:2.0:1746065147.398857:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (696320->708607) req@ffff8800a50fc450 x1830881263415552/t21474840875(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 12776/448 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.398865:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50fc450 with x1830881263415552 ext(696320->708607) 00010000:00010000:2.0:1746065147.398872:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 10 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.398882:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 10 pid: 12260 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.398887:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a50fc450 00000100:00100000:0.0:1746065147.407648:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.407744:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415936 00000100:00100000:2.0:1746065147.407754:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415936 00002000:00100000:2.0:1746065147.407827:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800907bea00 x1830881263415936/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.407836:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bea00 with x1830881263415936 ext(2097152->3145727) 00002000:00010000:2.0:1746065147.407841:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bea00 00000100:00100000:2.0:1746065147.407860:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3598 00000100:00100000:2.0:1746065147.407867:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263415936:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.414860:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.415171:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416064 00000100:00100000:2.0:1746065147.415178:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416064 00010000:00010000:2.0:1746065147.415208:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 12 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.415236:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5781 00000100:00100000:2.0:1746065147.415242:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263416064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.415252:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.415267:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 12 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.415276:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 12 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.415293:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146eb45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 696320->708607) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933145 expref: 12 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.415318:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.415320:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.415325:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.415332:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.415360:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.415370:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263295872:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065147.415432:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065147.427846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.429313:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.429362:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263295872:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065147.429378:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065147.429408:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263416064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 14165us (14553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.429417:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5781 00000100:00100000:3.0:1746065147.429799:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263415936:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21931us (22158us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065147.429806:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3598 00002000:00100000:3.0:1746065147.429815:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800907bea00 x1830881263415936/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.429824:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bea00 with x1830881263415936 ext(2097152->3145727) 00002000:00010000:3.0:1746065147.429828:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bea00 00000100:00100000:3.0:1746065147.429838:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416320 00000100:00100000:3.0:1746065147.429842:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416320 00002000:00100000:3.0:1746065147.429863:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800983bb100 x1830881263416320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.429869:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bb100 with x1830881263416320 ext(0->1048575) 00002000:00010000:3.0:1746065147.429872:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bb100 00000100:00100000:3.0:1746065147.429887:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3599 00000100:00100000:3.0:1746065147.429892:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263416320:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065147.435368:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416576 00000100:00100000:3.0:1746065147.435377:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416576 00000100:00100000:3.0:1746065147.435432:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13584 00000100:00100000:3.0:1746065147.435439:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+34:32100:x1830881263416576:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065147.435459:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.435476:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146ebc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933199 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.435556:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.435568:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 16 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.435574:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 35 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.435581:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.435604:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 35 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.435612:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 35 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.435622:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263296000:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.435701:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 16 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.435708:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 16 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.435715:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263296128:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.435728:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.448550:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.453326:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416704 00000100:00100000:1.0:1746065147.453342:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416704 00000100:00100000:1.0:1746065147.453410:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12951 00000100:00100000:1.0:1746065147.453419:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+22:32094:x1830881263416704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065147.453436:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.453455:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331a0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.453484:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.453492:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065147.453494:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065147.453497:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.453526:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.453536:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 23 pid: 13375 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.453548:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263296256:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.455427:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065147.456586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.456609:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.456986:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263296000:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.456999:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263296128:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.457022:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065147.457246:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416832 00000100:00100000:1.0:1746065147.457252:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416832 00010000:00010000:1.0:1746065147.457279:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.457301:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416960 00000100:00100000:1.0:1746065147.457303:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416960 00010000:00010000:1.0:1746065147.457312:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 17 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.457339:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5782 00000100:00100000:1.0:1746065147.457346:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263416832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065147.457360:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065147.457365:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.457374:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.457394:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc146eb84 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933153 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.457409:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.457413:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.457422:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.457426:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065147.457462:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263416832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 116us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.457468:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5782 00000100:00100000:1.0:1746065147.457485:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5783 00000100:00100000:1.0:1746065147.457490:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263416960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065147.457497:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065147.457501:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 17 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.457508:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 17 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.457519:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146eb37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93313e expref: 17 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.457527:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.457529:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.457536:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.457543:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.457563:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065147.457578:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263416960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.457583:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5783 00010000:00010000:1.0:1746065147.457631:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.457638:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065147.457655:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065147.457805:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146ebc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.457816:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 35 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.457822:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.457824:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065147.457826:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:1.0:1746065147.457847:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+35:32100:x1830881263416576:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 22409us (30008us total) trans 8589935907 rc 0/0 00000100:00100000:1.0:1746065147.457853:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13584 00000100:00100000:3.0:1746065147.462444:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263416320:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32541us (33123us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065147.462455:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3599 00002000:00100000:3.0:1746065147.462465:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800983bb100 x1830881263416320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.462474:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bb100 with x1830881263416320 ext(0->1048575) 00002000:00010000:3.0:1746065147.462482:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bb100 00000100:00100000:2.0:1746065147.464867:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263296256:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.464895:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.464911:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d000, rc 0) 00000100:00100000:2.0:1746065147.464958:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+23:32094:x1830881263416704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11540us (16415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.464973:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12951 00000100:00100000:0.0:1746065147.465605:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.465936:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417088 00000100:00100000:3.0:1746065147.465943:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417088 00002000:00100000:3.0:1746065147.465982:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2637824->2818047) req@ffff8800907bed80 x1830881263417088/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.465992:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bed80 with x1830881263417088 ext(2637824->2818047) 00010000:00010000:3.0:1746065147.465998:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 23 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.466009:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 23 pid: 13375 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746065147.466015:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bed80 00000100:00100000:3.0:1746065147.466042:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1264 00000100:00100000:3.0:1746065147.466051:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263417088:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065147.470424:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.474150:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417344 00000100:00100000:1.0:1746065147.474163:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417344 00000100:00100000:1.0:1746065147.474224:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13585 00000100:00100000:1.0:1746065147.474232:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+16:32102:x1830881263417344:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065147.474253:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.474272:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146ebdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331a7 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.474353:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474365:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474377:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474391:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474397:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474404:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474495:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474504:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474512:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065147.474520:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065147.474585:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474591:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474597:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474602:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474609:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065147.474612:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474619:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474628:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065147.474631:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065147.474634:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474638:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c600/0xad6b7ddc146ebe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474661:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474665:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474669:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474676:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065147.474678:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474685:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474691:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5500) 00010000:00010000:1.0:1746065147.474693:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065147.474694:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474698:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc146ebed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.474728:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146ebdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.474737:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.474742:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.474743:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065147.474745:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d400, rc 0) 00000100:00100000:1.0:1746065147.476670:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+18:32102:x1830881263417344:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 575us (4389us total) trans 8589935908 rc 0/0 00000100:00100000:1.0:1746065147.476679:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13585 00000100:00100000:3.0:1746065147.478086:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263417088:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12006us (12452us total) trans 17179873428 rc 0/0 00000100:00100000:3.0:1746065147.478095:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1264 00002000:00100000:3.0:1746065147.478105:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2637824->2818047) req@ffff8800907bed80 x1830881263417088/t17179873428(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/448 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.478453:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bed80 with x1830881263417088 ext(2637824->2818047) 00010000:00010000:3.0:1746065147.478465:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 25 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.478769:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 25 pid: 13375 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746065147.478791:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bed80 00000100:00100000:0.0:1746065147.481827:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.482289:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.482499:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417472 00000100:00100000:2.0:1746065147.482506:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417472 00000100:00100000:2.0:1746065147.482539:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12952 00000100:00100000:2.0:1746065147.482545:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:32097:x1830881263417472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.482560:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.482574:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331ae expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.482599:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.482600:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.482606:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.482617:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.482626:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:2.0:1746065147.482671:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:32097:x1830881263417472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 126us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.482676:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12952 00000100:00100000:3.0:1746065147.482869:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417600 00000100:00100000:3.0:1746065147.482873:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417600 00010000:00010000:3.0:1746065147.482892:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 25 pid: 13375 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.482909:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5784 00000100:00100000:3.0:1746065147.482913:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263417600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.482921:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.482936:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 25 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.482945:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 25 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.483309:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146ea88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2637824->3145727] (req 2637824->2818047) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330ce expref: 25 pid: 13375 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.483592:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.483594:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.483600:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.483607:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.483887:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.484056:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263296384:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065147.484206:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.495066:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.499304:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.499336:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263296384:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065147.499352:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.499392:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263417600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 16477us (17103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.499402:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5784 00000100:00100000:3.0:1746065147.499454:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417856 00000100:00100000:3.0:1746065147.499461:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417856 00002000:00100000:3.0:1746065147.499495:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800907bdf80 x1830881263417856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.499505:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881263417856 ext(2097152->3145727) 00002000:00010000:3.0:1746065147.499509:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bdf80 00000100:00100000:3.0:1746065147.499528:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418112 00000100:00100000:3.0:1746065147.499530:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418112 00002000:00100000:3.0:1746065147.499541:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800907bd880 x1830881263418112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.499553:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd880 with x1830881263418112 ext(2097152->3145727) 00002000:00010000:3.0:1746065147.499555:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bd880 00000100:00100000:3.0:1746065147.499565:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3600 00000100:00100000:3.0:1746065147.499570:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263417856:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065147.500853:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3601 00000100:00100000:3.0:1746065147.500862:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263418112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.511733:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.513680:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418368 00000100:00100000:2.0:1746065147.513688:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418368 00002000:00100000:2.0:1746065147.513721:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (4096000->4100095) req@ffff8800907be680 x1830881263418368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.513728:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907be680 with x1830881263418368 ext(4096000->4100095) 00002000:00010000:2.0:1746065147.513733:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907be680 00000100:00100000:2.0:1746065147.513750:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3602 00000100:00100000:2.0:1746065147.513757:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263418368:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065147.513884:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263418368:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 126us (2158us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065147.513890:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3602 00002000:00100000:2.0:1746065147.513894:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (4096000->4100095) req@ffff8800907be680 x1830881263418368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.513899:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907be680 with x1830881263418368 ext(4096000->4100095) 00002000:00010000:2.0:1746065147.513902:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907be680 00000100:00100000:3.0:1746065147.520286:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263417856:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20706us (25219us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065147.520286:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263418112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19420us (20984us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065147.520295:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3600 00000100:00100000:2.0:1746065147.520301:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3601 00002000:00100000:3.0:1746065147.520307:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800907bdf80 x1830881263417856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.520308:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800907bd880 x1830881263418112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.520315:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881263417856 ext(2097152->3145727) 00002000:00100000:2.0:1746065147.520315:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd880 with x1830881263418112 ext(2097152->3145727) 00002000:00010000:3.0:1746065147.520319:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bdf80 00002000:00010000:2.0:1746065147.520320:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bd880 00000100:00100000:0.0:1746065147.522882:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.523065:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418496 00000100:00100000:2.0:1746065147.523072:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418496 00000100:00100000:2.0:1746065147.523119:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12953 00000100:00100000:2.0:1746065147.523126:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+23:32100:x1830881263418496:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065147.523141:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.523156:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331b5 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.523180:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.523191:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065147.523193:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065147.523196:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4194304->4497407] (req 4194304->4497407) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.523220:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.523230:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 24 pid: 11461 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.523240:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263296512:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.523328:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.527633:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.527671:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.527696:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418624 00000100:00100000:2.0:1746065147.527704:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418624 00000100:00100000:0.0:1746065147.527714:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.527741:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418752 00000100:00100000:2.0:1746065147.527743:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418752 00000100:00100000:2.0:1746065147.527760:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418880 00000100:00100000:2.0:1746065147.527762:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418880 00000100:00100000:0.0:1746065147.527768:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12954 00000100:00100000:2.0:1746065147.527797:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12955 00000100:00100000:2.0:1746065147.527802:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+9:32094:x1830881263418752:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065147.527807:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12956 00000100:00100000:3.0:1746065147.527813:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+24:32102:x1830881263418880:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065147.527816:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.527820:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.527829:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331ca expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.527829:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331c3 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.527850:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.527850:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.527857:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065147.527857:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065147.527859:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065147.527859:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065147.527862:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.527863:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->2457599] (req 2121728->2457599) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.527885:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.527886:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.527894:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 25 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.527894:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.527903:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263296768:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.527903:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263296640:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.527954:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065147.528003:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065147.528427:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+35:32097:x1830881263418624:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065147.528436:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.528442:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331bc expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.528458:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065147.528461:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->2457599] (req 2121728->2457599) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.528466:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065147.528468:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.528486:0:3068:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->2457599] (req 2121728->2457599) gid 0 flags: 0x60000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.528496:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.528503:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d800, rc 0) 00000100:00100000:1.0:1746065147.528540:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+36:32097:x1830881263418624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 766us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.528546:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12954 00000100:00100000:2.0:1746065147.531624:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263296512:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.531646:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->4497407] (req 4194304->4497407) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.531661:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538a00, rc 0) 00000100:00100000:2.0:1746065147.531693:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+24:32100:x1830881263418496:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8567us (8817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.531701:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12953 00000100:00100000:2.0:1746065147.535291:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263296768:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.535315:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->2457599] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.535334:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:2.0:1746065147.535369:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+25:32102:x1830881263418880:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7555us (7653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.535377:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12956 00000100:00100000:3.0:1746065147.536754:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263296640:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.536786:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.536799:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538000, rc 0) 00000100:00100000:3.0:1746065147.536828:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+10:32094:x1830881263418752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9025us (9156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.536835:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12955 00000100:00100000:0.0:1746065147.537659:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.538131:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.538443:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.538574:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419136 00000100:00100000:1.0:1746065147.538581:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419136 00010000:00010000:1.0:1746065147.538605:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 25 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.538696:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419008 00000100:00100000:2.0:1746065147.538700:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419008 00002000:00100000:2.0:1746065147.538724:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3768320->4194303) req@ffff8800907bca80 x1830881263419008/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.538731:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bca80 with x1830881263419008 ext(3768320->4194303) 00010000:00010000:2.0:1746065147.538737:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.538746:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.538752:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907bca80 00000100:00100000:2.0:1746065147.538767:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1265 00000100:00100000:1.0:1746065147.538854:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419264 00000100:00100000:1.0:1746065147.538857:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419264 00010000:00010000:1.0:1746065147.538868:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 25 pid: 11461 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.538927:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5785 00000100:00100000:3.0:1746065147.538934:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263419136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.538946:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.538970:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 25 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.538983:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 25 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.539002:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d000/0xad6b7ddc146ebd1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a0 expref: 25 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.539025:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.539027:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.539033:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.539040:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.539065:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.539073:0:7190:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.539083:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263297024:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065147.539135:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065147.539151:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5786 00000100:00100000:3.0:1746065147.539157:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263419264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.539164:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.539175:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 25 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.539182:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 25 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.539194:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130105000/0xad6b7ddc146eae3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93310d expref: 25 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.539202:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.539203:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.539207:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.539213:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.539229:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.539236:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263297152:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065147.539254:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065147.539493:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263419008:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065147.544127:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263297152:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065147.544146:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065147.544180:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263419264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5022us (5736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.544190:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5786 00000100:00100000:3.0:1746065147.544357:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263297024:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065147.544365:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.544384:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881263419136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5451us (6254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.544390:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5785 00000100:00100000:1.0:1746065147.548355:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.548382:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.548409:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419520 00000100:00100000:1.0:1746065147.548416:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419520 00002000:00100000:1.0:1746065147.548448:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2121728->2125823) req@ffff8800983b9880 x1830881263419520/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.548458:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9880 with x1830881263419520 ext(2121728->2125823) 00010000:00010000:1.0:1746065147.548466:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.548476:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065147.548483:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800983b9880 00000100:00100000:1.0:1746065147.548513:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419776 00000100:00100000:1.0:1746065147.548516:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419776 00002000:00100000:1.0:1746065147.548527:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4493312->4497407) req@ffff8800983b9180 x1830881263419776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.548533:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9180 with x1830881263419776 ext(4493312->4497407) 00002000:00010000:1.0:1746065147.548537:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b9180 00000100:00100000:1.0:1746065147.548554:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1266 00000100:00100000:1.0:1746065147.548560:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263419520:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065147.548667:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263419520:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 107us (320us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065147.548673:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1266 00002000:00100000:1.0:1746065147.548678:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2121728->2125823) req@ffff8800983b9880 x1830881263419520/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.548684:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9880 with x1830881263419520 ext(2121728->2125823) 00010000:00010000:1.0:1746065147.548689:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.548696:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065147.548701:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800983b9880 00000100:00100000:1.0:1746065147.548714:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3603 00000100:00100000:1.0:1746065147.548719:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263419776:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065147.548764:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263419776:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 44us (381us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065147.548768:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3603 00002000:00100000:1.0:1746065147.548800:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4493312->4497407) req@ffff8800983b9180 x1830881263419776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.548807:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9180 with x1830881263419776 ext(4493312->4497407) 00002000:00010000:1.0:1746065147.548809:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b9180 00000100:00100000:2.0:1746065147.560070:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263419008:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 21288us (22405us total) trans 21474840876 rc 0/0 00000100:00100000:2.0:1746065147.560082:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1265 00002000:00100000:2.0:1746065147.560093:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3768320->4194303) req@ffff8800907bca80 x1830881263419008/t21474840876(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/448 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.560108:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bca80 with x1830881263419008 ext(3768320->4194303) 00010000:00010000:2.0:1746065147.560117:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 25 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.560129:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 25 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.560135:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907bca80 00000100:00100000:0.0:1746065147.561845:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.561912:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420032 00000100:00100000:2.0:1746065147.561920:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420032 00002000:00100000:2.0:1746065147.561951:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2453504->2457599) req@ffff880099cc0700 x1830881263420032/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.561968:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0700 with x1830881263420032 ext(2453504->2457599) 00010000:00010000:2.0:1746065147.561977:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.561986:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.561992:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc0700 00000100:00100000:2.0:1746065147.562008:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1267 00000100:00100000:2.0:1746065147.562015:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263420032:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065147.562122:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263420032:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 107us (281us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065147.562127:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1267 00002000:00100000:2.0:1746065147.562132:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2453504->2457599) req@ffff880099cc0700 x1830881263420032/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.562139:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0700 with x1830881263420032 ext(2453504->2457599) 00010000:00010000:2.0:1746065147.562143:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.562150:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.562155:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc0700 00000100:00100000:0.0:1746065147.567405:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.567492:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420672 00000100:00100000:1.0:1746065147.567500:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420672 00000100:00100000:1.0:1746065147.567669:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4890 00000100:00100000:1.0:1746065147.567677:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+18:32102:x1830881263420672:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065147.569122:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+19:32102:x1830881263420672:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1442us (1721us total) trans 8589935909 rc 0/0 00000100:00100000:1.0:1746065147.569130:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4890 00000100:00100000:0.0:1746065147.569644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.572105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.573142:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420160 00000100:00100000:3.0:1746065147.573151:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420160 00010000:00010000:3.0:1746065147.573182:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 25 pid: 9550 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.573205:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5787 00000100:00100000:3.0:1746065147.573212:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263420160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.573230:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065147.573245:0:7190:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065146 -> 1746065147 00002000:00010000:3.0:1746065147.573247:0:7190:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065145 -> 1746065147 00010000:00010000:3.0:1746065147.573255:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 25 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.573265:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 25 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.573283:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc146eac7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3768320->4194303] (req 3768320->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9330f8 expref: 25 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.573299:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.573301:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.573306:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.573313:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.573389:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420416 00000100:00100000:2.0:1746065147.573393:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420416 00002000:00100000:2.0:1746065147.573420:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x70:0x0] (2121728->2457599) req@ffff880099cc3100 x1830881263420416/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746065147.573548:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.573560:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263297280:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065147.573643:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00002000:00100000:2.0:1746065147.573893:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc3100 with x1830881263420416 ext(2121728->2457599) 00010000:00010000:2.0:1746065147.573902:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.573913:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 24 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.573918:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc3100 00000100:00100000:0.0:1746065147.573949:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1268 00000100:00100000:0.0:1746065147.573956:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263420416:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065147.579597:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263297280:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065147.579614:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.579649:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263420160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6436us (7547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.579657:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5787 00000100:00100000:1.0:1746065147.581442:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+26:2007:x1830881263420416:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7481us (11792us total) trans 17179873429 rc 0/0 00000100:00100000:1.0:1746065147.581452:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1268 00002000:00100000:1.0:1746065147.581460:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2121728->2457599) req@ffff880099cc3100 x1830881263420416/t17179873429(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/448 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.581468:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc3100 with x1830881263420416 ext(2121728->2457599) 00010000:00010000:1.0:1746065147.581476:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 26 pid: 9550 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.581484:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065147.581488:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 26 pid: 9550 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746065147.581493:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc3100 00000100:00100000:1.0:1746065147.581508:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420928 00000100:00100000:1.0:1746065147.581512:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420928 00002000:00100000:1.0:1746065147.581538:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097d04700 x1830881263420928/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.581545:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04700 with x1830881263420928 ext(3145728->4194303) 00002000:00010000:1.0:1746065147.581548:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04700 00000100:00100000:0.0:1746065147.581582:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3604 00000100:00100000:0.0:1746065147.581590:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263420928:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065147.583419:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.583582:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421056 00000100:00100000:1.0:1746065147.583588:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421056 00000100:00100000:1.0:1746065147.583697:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13586 00000100:00100000:1.0:1746065147.583704:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32105:x1830881263421056:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065147.583720:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.583736:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d200/0xad6b7ddc146ec25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331d1 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.584077:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.584088:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.584097:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.584108:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.584113:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.584118:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.584170:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.584180:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 34 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.584190:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.584366:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 34 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.584378:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 34 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.584389:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263297408:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.584685:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.586537:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.586604:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421184 00000100:00100000:3.0:1746065147.586610:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421184 00010000:00010000:3.0:1746065147.586633:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 26 pid: 9550 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.586664:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5788 00000100:00100000:3.0:1746065147.586674:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+26:2007:x1830881263421184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.586685:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.586699:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 26 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.586709:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 26 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.586725:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc146ec17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2121728->3145727] (req 2121728->2457599) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ca expref: 26 pid: 9550 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.586740:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.586743:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.586749:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 35 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.586755:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 35 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.587596:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 35 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.587609:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263297536:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065147.587683:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065147.590349:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263297408:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065147.590367:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065147.590631:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263420928:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9040us (9144us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065147.590639:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3604 00002000:00100000:1.0:1746065147.590648:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097d04700 x1830881263420928/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.590655:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04700 with x1830881263420928 ext(3145728->4194303) 00002000:00010000:1.0:1746065147.590659:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04700 00000100:00100000:0.0:1746065147.591542:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.591592:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421440 00000100:00100000:1.0:1746065147.591598:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421440 00000100:00100000:1.0:1746065147.591675:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4891 00000100:00100000:1.0:1746065147.591682:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+35:8521:x1830881263421440:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065147.592273:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263297536:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065147.592287:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.592314:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263421184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5644us (5781us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.592321:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5788 00000100:00100000:1.0:1746065147.592525:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+36:8521:x1830881263421440:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 843us (983us total) trans 8589935910 rc 0/0 00000100:00100000:1.0:1746065147.592530:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4891 00000100:00100000:0.0:1746065147.594379:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.594439:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.594501:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421568 00000100:00100000:3.0:1746065147.594506:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421568 00000100:00100000:1.0:1746065147.594571:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421824 00000100:00100000:1.0:1746065147.594574:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421824 00002000:00100000:1.0:1746065147.594596:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880099cc2680 x1830881263421824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.594603:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2680 with x1830881263421824 ext(2097152->3145727) 00002000:00010000:1.0:1746065147.594607:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc2680 00000100:00100000:1.0:1746065147.594618:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3605 00000100:00100000:1.0:1746065147.594622:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263421824:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065147.595165:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12957 00000100:00100000:3.0:1746065147.595170:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+25:32094:x1830881263421568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.595178:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.595190:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331d8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.595209:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 37 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.595220:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065147.595222:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065147.595224:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.595246:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 37 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.595255:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 37 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.595264:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263297664:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.595305:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.596598:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.596985:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421952 00000100:00100000:3.0:1746065147.596990:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421952 00010000:00010000:3.0:1746065147.597012:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.597045:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5789 00000100:00100000:3.0:1746065147.597052:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263421952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.597060:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.597065:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.597074:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.597095:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146ebca lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933199 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.597119:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.597124:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.597131:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.597137:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.597216:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065147.597225:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597231:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065147.597365:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263421952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 197us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.597371:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5789 00000004:00200000:2.0:1746065147.597486:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065147.597491:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065147.597506:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597516:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597525:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597529:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597534:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597540:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597544:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065147.597548:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597553:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597561:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065147.597563:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065147.597566:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.597571:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc146ec2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.599075:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.599083:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.599087:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.599091:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065147.599093:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.599098:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.599105:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5900) 00010000:00010000:2.0:1746065147.599107:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065147.599109:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.599113:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc146ec33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.599142:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d200/0xad6b7ddc146ec25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.599150:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.599155:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.599157:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065147.599159:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538c00, rc 0) 00000100:00100000:2.0:1746065147.599199:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32105:x1830881263421056:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 15494us (15784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.599205:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13586 00000100:00100000:3.0:1746065147.600362:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263297664:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.600381:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.600391:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:3.0:1746065147.600411:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+26:32094:x1830881263421568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5242us (6038us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.600417:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12957 00000100:00100000:0.0:1746065147.601186:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.601347:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422080 00000100:00100000:2.0:1746065147.601353:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422080 00002000:00100000:2.0:1746065147.601382:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099cc2a00 x1830881263422080/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 504/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.601390:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2a00 with x1830881263422080 ext(3145728->4194303) 00010000:00010000:2.0:1746065147.601395:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 38 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.601406:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 38 pid: 1880 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.601412:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc2a00 00000100:00100000:2.0:1746065147.601588:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1269 00000100:00100000:2.0:1746065147.601594:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263422080:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065147.603362:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263421824:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8731us (8915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065147.603369:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3605 00002000:00100000:1.0:1746065147.603376:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880099cc2680 x1830881263421824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.603385:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2680 with x1830881263421824 ext(2097152->3145727) 00002000:00010000:1.0:1746065147.603389:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc2680 00000100:00100000:0.0:1746065147.604860:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.604891:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.604913:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422208 00000100:00100000:0.0:1746065147.604915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.604918:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422208 00000100:00100000:2.0:1746065147.604982:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422336 00000100:00100000:2.0:1746065147.604985:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422336 00000100:00100000:2.0:1746065147.605000:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422464 00000100:00100000:2.0:1746065147.605001:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422464 00000100:00100000:2.0:1746065147.605014:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12958 00000100:00100000:2.0:1746065147.605020:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263422208:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065147.605035:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.605048:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331df expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.605078:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12959 00000100:00100000:3.0:1746065147.605085:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263422336:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065147.605092:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.605099:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc146ec4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331e6 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.605133:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263297792:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065147.605195:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065147.605199:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.605200:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.605207:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 13 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065147.605209:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12960 00000100:00100000:3.0:1746065147.605214:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263422464:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065147.605219:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 13 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.605220:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.605226:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b200, rc 0) 00010000:00010000:3.0:1746065147.605227:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc146ec56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331ed expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.605242:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263422208:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 223us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.605245:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263297920:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065147.605247:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12958 00000100:00100000:3.0:1746065147.605261:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065147.608433:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263422080:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 6832us (7241us total) trans 17179873430 rc 0/0 00000100:00100000:2.0:1746065147.608442:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1269 00002000:00100000:2.0:1746065147.608452:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099cc2a00 x1830881263422080/t17179873430(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 504/448 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.608460:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2a00 with x1830881263422080 ext(3145728->4194303) 00010000:00010000:2.0:1746065147.608469:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 38 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.608482:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 38 pid: 1880 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.608490:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc2a00 00002000:00010000:3.0:1746065147.609142:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065146 -> 1746065147 00000100:00100000:3.0:1746065147.609157:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263297792:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065147.609179:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc146ec4f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331e6 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.609190:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc146ec4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331e6 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.609638:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00000100:00100000:3.0:1746065147.609676:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263422336:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4591us (4783us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065147.609684:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12959 00000100:00100000:3.0:1746065147.609720:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263297920:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065147.609733:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc146ec56 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ed expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.609742:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc146ec56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ed expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.609749:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6ca00, rc 0) 00000100:00100000:3.0:1746065147.609764:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263422464:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4550us (4849us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065147.609769:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12960 00000100:00100000:0.0:1746065147.612719:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.612862:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.612924:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.612999:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422720 00000100:00100000:3.0:1746065147.613006:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422720 00000100:00100000:1.0:1746065147.613031:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422592 00000100:00100000:1.0:1746065147.613035:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422592 00000100:00100000:3.0:1746065147.613043:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12961 00000100:00100000:3.0:1746065147.613048:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+24:32097:x1830881263422720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065147.613053:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 38 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.613060:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.613071:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331f4 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065147.613074:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5790 00000100:00100000:1.0:1746065147.613079:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263422592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065147.613085:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.613088:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.613089:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.613094:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.613099:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 38 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.613105:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.613107:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 38 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.613114:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6da00, rc 0) 00010000:00010000:1.0:1746065147.613120:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc146eaf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933114 expref: 38 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.613131:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065147.613132:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065147.613136:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.613143:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+25:32097:x1830881263422720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 94us (430us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065147.613143:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.613147:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12961 00010000:00010000:1.0:1746065147.613164:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065147.613175:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263298048:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065147.613227:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.613451:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422976 00000100:00100000:0.0:1746065147.613455:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422976 00000100:00100000:0.0:1746065147.613484:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13587 00000100:00100000:0.0:1746065147.613489:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32105:x1830881263422976:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065147.613497:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.613507:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146ec64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9331fb expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.613578:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.613588:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.613599:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.613615:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.613623:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 10 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.613630:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263298176:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.613654:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065147.616296:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263298048:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065147.616312:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065147.616355:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263422592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3273us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.616363:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5790 00000100:00100000:2.0:1746065147.616372:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263298176:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.616386:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065147.616998:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.617031:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423104 00000100:00100000:2.0:1746065147.617036:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423104 00010000:00010000:2.0:1746065147.617053:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 11 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.617080:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5791 00000100:00100000:2.0:1746065147.617087:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263423104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.617256:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.617263:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 11 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.617272:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 11 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.617288:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec3a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d1 expref: 11 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.617308:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.617312:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.617319:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.617325:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.617339:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065147.617346:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.617351:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065147.617366:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065147.617458:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046a00/0xad6b7ddc146ec64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331fb expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.617473:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331fb expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.617479:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.617481:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065147.617483:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:2.0:1746065147.617543:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263423104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 455us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.617549:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5791 00000100:00100000:0.0:1746065147.618190:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32105:x1830881263422976:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4699us (5264us total) trans 8589935911 rc 0/0 00000100:00100000:0.0:1746065147.618195:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13587 00000100:00100000:0.0:1746065147.618819:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.619115:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.619155:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423488 00000100:00100000:1.0:1746065147.619159:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423488 00000100:00100000:2.0:1746065147.619170:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423616 00000100:00100000:2.0:1746065147.619173:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423616 00002000:00100000:1.0:1746065147.619183:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880099cc1180 x1830881263423488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.619184:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099cc0000 x1830881263423616/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.619192:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0000 with x1830881263423616 ext(3145728->4194303) 00002000:00100000:1.0:1746065147.619192:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1180 with x1830881263423488 ext(3145728->4194303) 00002000:00010000:2.0:1746065147.619196:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc0000 00002000:00010000:1.0:1746065147.619196:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1180 00000100:00100000:1.0:1746065147.619216:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3606 00000100:00100000:1.0:1746065147.619222:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263423488:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065147.619223:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3607 00000100:00100000:2.0:1746065147.619227:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881263423616:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065147.626535:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.626927:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423872 00000100:00100000:1.0:1746065147.626944:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423872 00000100:00100000:1.0:1746065147.627620:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13588 00000100:00100000:1.0:1746065147.627641:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32105:x1830881263423872:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065147.627669:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.627678:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065147.627700:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146ec6b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331fb expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.627729:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.627733:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065147.627742:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146ec79 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933202 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.628187:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.628200:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.628209:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065147.628218:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065147.628296:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146ec79 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.628307:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.628313:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.628315:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065147.628317:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539a00, rc 0) 00000100:00100000:2.0:1746065147.628355:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881263423616:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9125us (9238us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065147.628363:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3607 00002000:00100000:2.0:1746065147.628371:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099cc0000 x1830881263423616/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.628378:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0000 with x1830881263423616 ext(3145728->4194303) 00002000:00010000:2.0:1746065147.628381:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc0000 00000100:00100000:1.0:1746065147.629216:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32105:x1830881263423872:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1576us (2689us total) trans 8589935912 rc 0/0 00000100:00100000:1.0:1746065147.629222:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13588 00000100:00100000:1.0:1746065147.631683:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263423488:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12454us (12858us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065147.631692:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3606 00002000:00100000:1.0:1746065147.631700:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880099cc1180 x1830881263423488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.631709:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1180 with x1830881263423488 ext(3145728->4194303) 00002000:00010000:1.0:1746065147.631713:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1180 00000100:00100000:3.0:1746065147.632385:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.632490:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424000 00000100:00100000:1.0:1746065147.632501:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424000 00000100:00100000:1.0:1746065147.632615:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13589 00000100:00100000:1.0:1746065147.632623:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32105:x1830881263424000:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065147.632641:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.632654:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec8e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933209 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.632695:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec8e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933209 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.632706:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec8e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933209 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.632721:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.632723:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065147.632726:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538c00, rc 0) 00000100:00100000:1.0:1746065147.632748:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32105:x1830881263424000:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 126us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.632753:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13589 00000100:00100000:0.0:1746065147.633196:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.633250:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.633292:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424128 00000100:00100000:2.0:1746065147.633296:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424128 00000100:00100000:3.0:1746065147.633302:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424256 00000100:00100000:3.0:1746065147.633305:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424256 00000100:00100000:2.0:1746065147.633329:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12962 00000100:00100000:3.0:1746065147.633333:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12963 00000100:00100000:2.0:1746065147.633334:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263424128:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065147.633337:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263424256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.633341:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.633341:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.633349:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146ec9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933217 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.633349:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933210 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.633362:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.633363:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.633370:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065147.633380:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263298304:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065147.633380:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.633387:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a200, rc 0) 00000100:00100000:2.0:1746065147.633405:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263424128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.633409:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12962 00000100:00100000:3.0:1746065147.633426:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.635065:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263298304:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065147.635087:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146ec9c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933217 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.635098:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc146ec9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933217 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.635110:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72400, rc 0) 00000100:00100000:0.0:1746065147.635379:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263424256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2039us (2127us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065147.635386:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12963 00000100:00100000:0.0:1746065147.637717:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.638032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.638071:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424384 00000100:00100000:2.0:1746065147.638079:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424384 00000100:00100000:2.0:1746065147.638125:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12964 00000100:00100000:2.0:1746065147.638132:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263424384:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065147.638167:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.638174:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065147.638181:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.638189:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065147.638193:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.638200:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065147.638200:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065147.638206:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.638207:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.638210:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.638213:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424512 00000100:00100000:0.0:1746065147.638215:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424512 00000100:00100000:0.0:1746065147.638231:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424640 00010000:00010000:2.0:1746065147.638233:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065147.638233:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424640 00000100:00100000:0.0:1746065147.638240:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424768 00000100:00100000:0.0:1746065147.638241:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424768 00010000:00010000:2.0:1746065147.638244:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 12 pid: 9550 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.638248:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425024 00000100:00100000:0.0:1746065147.638250:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425024 00000100:00100000:2.0:1746065147.638256:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263298432:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.638259:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12965 00000100:00100000:0.0:1746065147.638263:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263424512:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065147.638279:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.638287:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.638293:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 36 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.638299:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 25 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.638303:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.638305:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.638306:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.638319:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 25 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.638320:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.638327:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 10 pid: 10219 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.638327:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 25 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.638335:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263298560:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.638335:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263298688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.638383:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12966 00000100:00100000:1.0:1746065147.638391:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12967 00000100:00100000:3.0:1746065147.638393:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263424640:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:1.0:1746065147.638397:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263424768:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065147.638409:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.638409:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.638418:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.638418:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 13 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.638424:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 36 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.638425:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.638431:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 25 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.638431:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.638436:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065147.638436:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.638437:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065147.638437:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.638439:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.638439:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.638451:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 25 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.638451:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.638458:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 25 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.638464:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263298816:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065147.638617:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 10 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746065147.638624:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263298944:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.638740:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 36 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.638747:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 36 pid: 10219 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.638755:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263299072:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.638814:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.638822:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 24 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.638829:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263299200:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.638830:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 36 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.638836:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 36 pid: 9550 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.638843:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263299328:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.638845:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ed80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065147.638861:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065147.638861:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12968 00000100:00100000:2.0:1746065147.638867:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263425024:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065147.638872:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 10 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.638879:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263299456:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.638881:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.638888:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.638892:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065147.638895:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.638901:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.638907:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.638948:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.638948:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.638955:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.638956:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 10 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.638972:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263299584:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.638973:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263299712:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.638985:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988463c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065147.638992:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 13 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065147.639003:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 13 pid: 3068 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746065147.639010:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263299840:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.639010:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.639022:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424896 00000100:00100000:0.0:1746065147.639025:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424896 00000100:00100000:0.0:1746065147.639040:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12969 00000100:00100000:0.0:1746065147.639044:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+37:32097:x1830881263424896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065147.639052:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.639059:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93321e expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.639071:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.639072:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.639078:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.639092:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.639099:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:1.0:1746065147.639152:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065147.639166:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.639173:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 5 00010000:00010000:2.0:1746065147.639174:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 5 00010000:00010000:2.0:1746065147.639176:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 8/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.639180:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+38:32097:x1830881263424896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 134us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.639184:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12969 00010000:00010000:2.0:1746065147.639191:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.639197:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 24 pid: 10219 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.639203:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263299968:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.639222:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.639229:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 10 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.639233:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.639236:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263300096:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.639244:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425152 00000100:00100000:0.0:1746065147.639247:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425152 00010000:00010000:2.0:1746065147.639251:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.639258:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 24 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.639259:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12970 00000100:00100000:0.0:1746065147.639263:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263425152:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065147.639269:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263300224:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.639275:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.639283:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.639284:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.639289:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 37 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.639291:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 10 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.639295:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 37 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.639297:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263300352:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.639300:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065147.639302:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065147.639303:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.639309:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.639314:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 37 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.639315:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 24 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.639321:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 37 pid: 3068 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.639322:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263300480:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.639327:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263300608:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.639330:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ee40 going to sleep for 11 seconds 00010000:00010000:0.0:1746065147.639342:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 37 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.639348:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 37 pid: 3067 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.639354:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263300736:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.639364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065147.639370:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.639405:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425280 00000100:00100000:3.0:1746065147.639408:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425280 00000100:00100000:3.0:1746065147.639424:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12971 00000100:00100000:3.0:1746065147.639428:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+11:32094:x1830881263425280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.639434:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.639450:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 25 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.639460:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263300864:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.639478:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933225 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.639480:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00010000:00010000:3.0:1746065147.639492:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065147.639495:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.639500:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065147.639503:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->5021695] (req 4194304->5021695) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 12 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.639512:0:10219:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.639520:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->5021695] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 12 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.639532:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73800, rc 0) 00000100:00100000:3.0:1746065147.639544:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+12:32094:x1830881263425280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 116us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.639550:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12971 00000100:00100000:2.0:1746065147.646302:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263298432:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.646314:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263298560:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.646542:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263298688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.647224:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263298816:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.648015:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.648037:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.648056:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.648087:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263298944:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.648103:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.648119:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425408 00000100:00100000:1.0:1746065147.648124:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425408 00010000:00010000:1.0:1746065147.648151:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 14 pid: 9550 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746065147.648169:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425536 00000100:00100000:1.0:1746065147.648171:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425536 00010000:00010000:1.0:1746065147.648181:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 12 pid: 10219 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746065147.648192:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425664 00000100:00100000:1.0:1746065147.648193:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425664 00010000:00010000:1.0:1746065147.648201:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 26 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746065147.648211:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425920 00000100:00100000:1.0:1746065147.648212:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425920 00010000:00010000:1.0:1746065147.648219:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 25 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.648228:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5792 00000100:00100000:1.0:1746065147.648233:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263425408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065147.648242:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065147.648257:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 14 pid: 9550 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746065147.648266:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 14 pid: 9550 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746065147.648283:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc146ec48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331df expref: 14 pid: 9550 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.648444:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5793 00000100:00100000:0.0:1746065147.648451:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263425536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.648458:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065147.648500:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5794 00000100:00100000:2.0:1746065147.648505:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263425664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.648512:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.648523:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 26 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.648530:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 26 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.648541:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc146e9cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933049 expref: 26 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.648555:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.648585:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263425664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.648591:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5794 00000100:00100000:2.0:1746065147.648603:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5795 00000100:00100000:2.0:1746065147.648606:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263425920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.648612:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065147.648746:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263299328:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.648754:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263299456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.648789:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.649676:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.649814:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426176 00000100:00100000:3.0:1746065147.649818:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426176 00010000:00010000:3.0:1746065147.649835:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 12 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.649848:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5796 00000100:00100000:3.0:1746065147.649852:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263426176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.649858:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.649868:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 12 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746065147.649876:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 12 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746065147.649888:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc146e8a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd2 expref: 12 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746065147.649899:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065147.650046:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065147.650110:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 12 pid: 10219 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.650119:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 12 pid: 10219 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.650130:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ec95 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933210 expref: 12 pid: 10219 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.650141:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.650172:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263426176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 319us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.650178:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5796 00000100:00100000:1.0:1746065147.650216:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263425408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1982us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.650221:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5792 00010000:00010000:2.0:1746065147.650300:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 25 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.650432:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 25 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.650444:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.650445:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.650449:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650457:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650471:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.650489:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263425920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1882us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.650495:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5795 00010000:00010000:2.0:1746065147.650525:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488e00/0xad6b7ddc146ebb5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93318b expref: 24 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.650534:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263299200:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.650551:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650559:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650564:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650579:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650587:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650593:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650604:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065147.650607:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650615:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650623:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.650628:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc146eca3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.650660:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263424384:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 12529us (12948us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.650666:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12964 00000100:00100000:0.0:1746065147.650884:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263425536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2432us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.650889:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5793 00000100:00100000:0.0:1746065147.651423:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.651434:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425792 00000100:00100000:0.0:1746065147.651438:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425792 00010000:00010000:0.0:1746065147.651455:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 25 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.651470:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5797 00000100:00100000:0.0:1746065147.651475:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263425792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.651482:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.651491:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 25 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651503:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 25 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651514:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800929fac00/0xad6b7ddc146e9d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933050 expref: 25 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651522:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.651540:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263425792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.651545:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5797 00000100:00100000:0.0:1746065147.651587:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.651596:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426048 00000100:00100000:0.0:1746065147.651599:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426048 00010000:00010000:0.0:1746065147.651609:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 38 pid: 9550 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.651619:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5798 00000100:00100000:0.0:1746065147.651624:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263426048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.651629:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.651635:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 38 pid: 9550 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651642:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 38 pid: 9550 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651656:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4a00/0xad6b7ddc146ea0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93307a expref: 38 pid: 9550 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651663:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.651665:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.651667:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.651672:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.651698:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.651712:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263426048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 88us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.651717:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5798 00000100:00100000:0.0:1746065147.651755:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.651767:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426304 00000100:00100000:0.0:1746065147.651769:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426304 00010000:00010000:0.0:1746065147.651804:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 37 pid: 10219 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746065147.651809:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263299072:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.651816:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5799 00000100:00100000:0.0:1746065147.651821:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263426304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.651826:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.651833:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 37 pid: 10219 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651844:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 37 pid: 10219 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651853:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc146e9fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933073 expref: 37 pid: 10219 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.651860:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.651873:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263426304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.651878:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5799 00010000:00010000:3.0:1746065147.651965:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.651973:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.651984:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.651991:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.651996:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.652001:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065147.652003:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.652012:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.652021:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.652027:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ecb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.652061:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263424640:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 13668us (13885us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.652067:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12966 00000100:00100000:1.0:1746065147.652953:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263299584:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065147.652977:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065147.652999:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263299712:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.653007:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263299840:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065147.653022:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.656751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.657040:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426432 00000100:00100000:2.0:1746065147.657048:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426432 00010000:00010000:2.0:1746065147.657078:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 10 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.657100:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5800 00000100:00100000:2.0:1746065147.657106:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263426432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.657118:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.657134:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 10 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.657143:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 10 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.657161:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146e8b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fcb expref: 10 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.657171:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.657173:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.657176:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.657183:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.657207:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.657242:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263426432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 135us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.657247:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5800 00010000:00010000:1.0:1746065147.657314:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.657321:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.657336:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.657342:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.657348:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.657353:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065147.657356:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.657361:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.657371:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.657376:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146ecaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065147.657414:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263424512:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 19150us (19382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.657421:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12965 00000100:00100000:0.0:1746065147.660703:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.660740:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.661223:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.661249:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426688 00000100:00100000:2.0:1746065147.661256:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426688 00000100:00100000:2.0:1746065147.661289:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263299968:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.661296:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263300096:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.661303:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263300224:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.661331:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 12 pid: 3068 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.661357:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426560 00000100:00100000:2.0:1746065147.661360:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426560 00010000:00010000:2.0:1746065147.661367:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.661384:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5801 00000100:00100000:2.0:1746065147.661389:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263426688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.661401:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.661415:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 12 pid: 3068 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.661423:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 12 pid: 3068 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.661440:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146e8ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd932fd9 expref: 12 pid: 3068 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.661451:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.661480:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263426688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 91us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.661486:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5801 00000100:00100000:2.0:1746065147.661498:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5802 00000100:00100000:2.0:1746065147.661502:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881263426560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.661507:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.661512:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.661518:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.661527:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996be600/0xad6b7ddc146e9ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933081 expref: 24 pid: 13375 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.661533:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.661542:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263426560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.661546:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5802 00000100:00100000:1.0:1746065147.661671:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065147.661681:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263300992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065147.661710:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065147.661744:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300992 00000100:00100000:1.0:1746065147.661746:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300992 00000100:00100000:1.0:1746065147.661785:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1746065147.661789:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263300992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746065147.661802:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1138760000 pending 5419008 free 3910807552 avail 3679285248 00000100:00100000:1.0:1746065147.661823:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263300992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.661827:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1746065147.661851:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263300992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065147.661946:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.662021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.662030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.662062:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263300608:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.662090:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263300736:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065147.662112:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263300864:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.662128:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.662154:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.662169:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.662181:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.662205:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.662219:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427328 00000100:00100000:0.0:1746065147.662222:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427328 00002000:00100000:0.0:1746065147.662241:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4497407) req@ffff880092744700 x1830881263427328/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.662250:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744700 with x1830881263427328 ext(4194304->4497407) 00010000:00010000:0.0:1746065147.662256:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 23 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.662264:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 23 pid: 11461 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065147.662268:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092744700 00000100:00100000:0.0:1746065147.662277:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427840 00000100:00100000:0.0:1746065147.662279:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427840 00002000:00100000:0.0:1746065147.662289:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880092744000 x1830881263427840/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.662295:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744000 with x1830881263427840 ext(3145728->4194303) 00010000:00010000:0.0:1746065147.662298:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 36 pid: 3067 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.662303:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 36 pid: 3067 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065147.662308:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092744000 00000100:00100000:0.0:1746065147.662321:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1270 00000100:00100000:0.0:1746065147.662325:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263427328:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065147.662398:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1271 00000100:00100000:0.0:1746065147.662403:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263427840:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065147.663637:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426944 00000100:00100000:0.0:1746065147.663643:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426944 00010000:00010000:0.0:1746065147.663660:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 11 pid: 9548 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.663674:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426816 00000100:00100000:0.0:1746065147.663676:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426816 00010000:00010000:0.0:1746065147.663683:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 25 pid: 10219 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.663690:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427072 00000100:00100000:0.0:1746065147.663692:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427072 00010000:00010000:0.0:1746065147.663698:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 26 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.663704:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427200 00000100:00100000:0.0:1746065147.663706:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427200 00010000:00010000:0.0:1746065147.663712:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 12 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.663718:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427456 00000100:00100000:0.0:1746065147.663720:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427456 00010000:00010000:0.0:1746065147.663725:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 38 pid: 3068 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.663736:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427584 00000100:00100000:0.0:1746065147.663738:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427584 00010000:00010000:0.0:1746065147.663743:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 24 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.663752:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5803 00000100:00100000:0.0:1746065147.663758:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263426944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.663764:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.663805:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 12 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.663813:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 12 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.663828:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4a00/0xad6b7ddc146e9d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933057 expref: 12 pid: 9548 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.663838:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.663840:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.663843:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.663850:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.663866:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.663882:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263426944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.663887:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5803 00000100:00100000:0.0:1746065147.663897:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5804 00000100:00100000:0.0:1746065147.663900:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263426816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.663905:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.663910:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 26 pid: 10219 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.663917:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 26 pid: 10219 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.663926:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ec5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331f4 expref: 26 pid: 10219 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.663932:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.663941:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263426816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.663946:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5804 00000100:00100000:0.0:1746065147.663980:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5805 00000100:00100000:0.0:1746065147.663983:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263427072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.663988:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.663992:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 24 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.663999:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 24 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664007:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146ec02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331ae expref: 24 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664014:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.664023:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263427072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.664027:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5805 00000100:00100000:0.0:1746065147.664033:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5806 00000100:00100000:0.0:1746065147.664036:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263427200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.664040:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.664044:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 10 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664050:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 10 pid: 12260 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664057:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.664064:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263427200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 27us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.664068:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5806 00000100:00100000:0.0:1746065147.664073:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5807 00000100:00100000:0.0:1746065147.664077:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263427456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.664081:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.664087:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 38 pid: 3068 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664093:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 38 pid: 3068 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664103:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146ec1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331bc expref: 38 pid: 3068 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664109:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.664117:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263427456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.664120:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5807 00000100:00100000:0.0:1746065147.664126:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5808 00000100:00100000:0.0:1746065147.664129:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881263427584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.664132:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.664135:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 24 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664142:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 24 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664149:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146ec41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331d8 expref: 24 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.664154:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065147.664161:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263427584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 32us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.664168:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5808 00010000:00010000:0.0:1746065147.664218:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.664224:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.664236:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.664241:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.664247:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.664253:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065147.664256:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.664261:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.664269:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.664273:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc146ecb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.664306:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263424768:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 25909us (26116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.664312:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12967 00010000:00010000:2.0:1746065147.668639:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc146ebbc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933192 expref: 9 pid: 12260 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.668655:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263300352:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.668666:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263300480:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065147.668691:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746065147.669570:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065147.672802:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.672874:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427968 00000100:00100000:3.0:1746065147.672883:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427968 00010000:00010000:3.0:1746065147.672917:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 9 pid: 1880 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.672953:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5809 00000100:00100000:3.0:1746065147.672969:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263427968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.672980:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.672994:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 9 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.673004:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 9 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.673027:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc146ec10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331c3 expref: 9 pid: 1880 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.673039:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.673071:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263427968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.673077:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5809 00000100:00100000:0.0:1746065147.675513:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263427328:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13180us (13351us total) trans 21474840877 rc 0/0 00000100:00100000:0.0:1746065147.675523:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1270 00002000:00100000:0.0:1746065147.675531:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4497407) req@ffff880092744700 x1830881263427328/t21474840877(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/448 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.675539:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744700 with x1830881263427328 ext(4194304->4497407) 00010000:00010000:0.0:1746065147.675546:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 23 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.675556:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 23 pid: 11461 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065147.675562:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092744700 00000100:00100000:0.0:1746065147.678734:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263427840:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 16323us (16520us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065147.678745:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1271 00002000:00100000:0.0:1746065147.678755:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880092744000 x1830881263427840/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.678762:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744000 with x1830881263427840 ext(3145728->4194303) 00010000:00010000:0.0:1746065147.678781:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 35 pid: 3067 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.678792:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 35 pid: 3067 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065147.678798:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092744000 00000100:00100000:0.0:1746065147.682260:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.682319:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428096 00000100:00100000:2.0:1746065147.682325:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428096 00010000:00010000:2.0:1746065147.682351:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 23 pid: 11461 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.682384:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5810 00000100:00100000:2.0:1746065147.682390:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263428096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.682402:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.682416:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 23 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.682425:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 23 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.682442:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc146ec09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331b5 expref: 23 pid: 11461 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.682456:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.682457:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.682461:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682467:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682485:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.682522:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263428096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 131us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.682527:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5810 00010000:00010000:2.0:1746065147.682543:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682550:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682561:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682566:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682572:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682577:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065147.682580:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682585:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682591:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.682592:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.682596:0:11461:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682601:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.682625:0:11461:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.682635:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263301120:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065147.682686:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.687559:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.687610:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.687631:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428352 00000100:00100000:0.0:1746065147.687639:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428352 00000100:00100000:3.0:1746065147.687723:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428224 00000100:00100000:3.0:1746065147.687728:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428224 00010000:00010000:3.0:1746065147.687749:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 35 pid: 3067 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.687769:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5811 00000100:00100000:3.0:1746065147.687793:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263428224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.687804:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.687819:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 35 pid: 3067 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.687830:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 35 pid: 3067 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.687847:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146ecc6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93321e expref: 35 pid: 3067 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.688067:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12972 00000100:00100000:0.0:1746065147.688074:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+22:32097:x1830881263428352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065147.688087:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.688098:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93322c expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688113:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.688114:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.688120:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 23 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688131:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 23 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688139:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c800, rc 0) 00000100:00100000:0.0:1746065147.688173:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+23:32097:x1830881263428352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 99us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.688182:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12972 00010000:00010000:3.0:1746065147.688478:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.688480:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.688484:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.688491:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.688507:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.688647:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263428224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 853us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.688653:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5811 00010000:00010000:0.0:1746065147.688724:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688732:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688747:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688753:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688759:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688764:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abac800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065147.688768:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688796:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688806:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.688810:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc146eccd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.688846:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263425152:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 49582us (49612us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.688852:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12970 00000100:00100000:2.0:1746065147.699737:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.699985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.700211:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.700305:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.700319:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428480 00000100:00100000:0.0:1746065147.700327:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428480 00000100:00100000:0.0:1746065147.700371:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428736 00000100:00100000:0.0:1746065147.700374:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428736 00000100:00100000:0.0:1746065147.700391:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428608 00000100:00100000:0.0:1746065147.700393:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428608 00000100:00100000:0.0:1746065147.700406:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12973 00000100:00100000:0.0:1746065147.700413:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263428480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065147.700428:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.700443:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933233 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065147.700462:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6fb, atime: 0x6812d6fb, ctime: 0x6812d6fb, blocks: 0x7f8 00010000:00010000:0.0:1746065147.700476:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.700478:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.700486:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.700498:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.700506:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c000, rc 0) 00000100:00100000:0.0:1746065147.700541:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263428480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 129us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.700547:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12973 00000100:00100000:0.0:1746065147.700561:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12974 00000100:00100000:0.0:1746065147.700566:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263428736:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065147.700573:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.700582:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933241 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065147.700593:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6f8, atime: 0x6812d6f6, ctime: 0x6812d6f8, blocks: 0x800 00010000:00010000:0.0:1746065147.700600:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.700601:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.700605:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 36 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.700613:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 36 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.700618:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00000100:00100000:0.0:1746065147.700631:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263428736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.700635:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12974 00000100:00100000:0.0:1746065147.700643:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12975 00000100:00100000:0.0:1746065147.700647:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263428608:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065147.700652:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.700657:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93323a expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065147.700668:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6f7, atime: 0x6812d6f7, ctime: 0x6812d6f7, blocks: 0x808 00010000:00010000:0.0:1746065147.700673:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.700675:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.700678:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 36 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.700685:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 36 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.700691:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d200, rc 0) 00000100:00100000:0.0:1746065147.700702:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263428608:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.700707:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12975 00000100:00100000:3.0:1746065147.701661:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428864 00000100:00100000:3.0:1746065147.701667:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428864 00000100:00100000:3.0:1746065147.701697:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12976 00000100:00100000:3.0:1746065147.701702:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263428864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.701710:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.701719:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933248 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065147.701733:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6f9, atime: 0x6812d6f5, ctime: 0x6812d6f9, blocks: 0x808 00010000:00010000:3.0:1746065147.701741:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.701743:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.701747:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 25 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.701756:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 25 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.701762:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:3.0:1746065147.701798:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263428864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 96us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.701803:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12976 00000100:00100000:2.0:1746065147.702027:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.702310:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263301120:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065147.702330:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.702337:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2600/0xad6b7ddc146ecbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.702372:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263425024:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 63505us (64170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.702379:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12968 00000100:00100000:3.0:1746065147.702392:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428992 00000100:00100000:3.0:1746065147.702395:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428992 00000100:00100000:3.0:1746065147.702412:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12977 00000100:00100000:3.0:1746065147.702416:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263428992:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.702423:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.702432:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93324f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065147.702443:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d6fb, atime: 0x6812d6fb, ctime: 0x6812d6fb, blocks: 0x1000 00010000:00010000:3.0:1746065147.702451:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.702452:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.702456:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 37 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.702469:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 37 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.702476:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:3.0:1746065147.702489:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263428992:12345-192.168.202.27@tcp:101:cat.0 Request processed in 73us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.702494:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12977 00000100:00100000:2.0:1746065147.705871:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.706209:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263429248 00000100:00100000:0.0:1746065147.706217:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263429248 00002000:00100000:0.0:1746065147.706254:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097d05500 x1830881263429248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.706262:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05500 with x1830881263429248 ext(4194304->5021695) 00002000:00010000:0.0:1746065147.706267:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d05500 00000100:00100000:0.0:1746065147.706284:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3608 00000100:00100000:0.0:1746065147.706291:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263429248:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065147.710447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.711141:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.711223:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263429504 00000100:00100000:3.0:1746065147.711231:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263429504 00000100:00100000:3.0:1746065147.711268:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263429760 00000100:00100000:3.0:1746065147.711270:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263429760 00000100:00100000:3.0:1746065147.711286:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13590 00000100:00100000:3.0:1746065147.711293:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32105:x1830881263429504:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:3.0:1746065147.711332:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.711354:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146ec8e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933209 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.711368:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.711372:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065147.711394:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.711404:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.711646:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13591 00000100:00100000:0.0:1746065147.711653:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+35:32107:x1830881263429760:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065147.711666:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.711676:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146ed0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933256 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.711714:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.711723:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.711730:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.711740:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.711745:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.711750:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.711935:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.711943:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 18 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.711949:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 18 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.711954:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.711987:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 18 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.712000:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 18 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.712010:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301248:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.713402:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 18 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.713412:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 18 pid: 13395 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.713421:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301376:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.713450:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.713457:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 36 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.713464:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301504:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.713485:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.713491:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 18 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.713496:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301632:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.713508:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.719591:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.720106:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430016 00000100:00100000:2.0:1746065147.720115:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430016 00002000:00100000:2.0:1746065147.720150:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092745c00 x1830881263430016/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.720159:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745c00 with x1830881263430016 ext(4194304->5021695) 00002000:00010000:2.0:1746065147.720164:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092745c00 00000100:00100000:2.0:1746065147.720193:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3609 00000100:00100000:2.0:1746065147.720200:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263430016:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.723190:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263429248:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16892us (17321us total) trans 0 rc 827392/827392 00000100:00100000:0.0:1746065147.723198:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3608 00002000:00100000:0.0:1746065147.723207:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097d05500 x1830881263429248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.723216:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05500 with x1830881263429248 ext(4194304->5021695) 00002000:00010000:0.0:1746065147.723220:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d05500 00000100:00100000:3.0:1746065147.723353:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301248:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.723442:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301376:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.723467:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301504:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.723486:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301632:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.723505:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065147.723528:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.723542:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430144 00000100:00100000:3.0:1746065147.723546:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430144 00010000:00010000:3.0:1746065147.723566:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 19 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.723584:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5812 00000100:00100000:3.0:1746065147.723589:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263430144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.723601:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.723606:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 19 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723614:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 19 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723630:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7f000/0xad6b7ddc146eb53 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93314c expref: 19 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723644:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.723647:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.723653:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.723669:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263430144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.723674:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5812 00000100:00100000:3.0:1746065147.723695:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.723705:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430400 00000100:00100000:3.0:1746065147.723707:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430400 00010000:00010000:3.0:1746065147.723716:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 37 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.723728:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5813 00000100:00100000:3.0:1746065147.723733:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263430400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.723738:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.723741:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 37 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723747:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 37 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723757:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc146e985 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933011 expref: 37 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723764:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.723767:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.723794:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.723808:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263430400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.723813:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5813 00000100:00100000:3.0:1746065147.723844:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.723853:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430272 00000100:00100000:3.0:1746065147.723855:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430272 00010000:00010000:3.0:1746065147.723864:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 18 pid: 13395 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.723881:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5814 00000100:00100000:3.0:1746065147.723885:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263430272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.723891:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.723894:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 18 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723900:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 18 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723910:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc146e9a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933026 expref: 18 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.723918:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.723920:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.723925:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.723937:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263430272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.723941:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5814 00000100:00100000:3.0:1746065147.723991:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.724002:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430528 00000100:00100000:3.0:1746065147.724005:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430528 00010000:00010000:3.0:1746065147.724014:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 17 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.724028:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5815 00000100:00100000:3.0:1746065147.724032:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263430528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065147.724037:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065147.724041:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 17 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.724048:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 17 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.724058:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d400/0xad6b7ddc146ebf4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9331a7 expref: 17 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.724067:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.724069:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.724076:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.724082:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.724094:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065147.724107:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263430528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.724112:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5815 00010000:00010000:3.0:1746065147.724125:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065147.724130:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000040:00080000:3.0:1746065147.724386:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].540, 88 off55576 00000004:00080000:3.0:1746065147.724394:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742620177ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724418:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].485, 88 off50736 00000004:00080000:3.0:1746065147.724422:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743742648584ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065147.724433:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].486, 88 off50824 00000004:00080000:3.0:1746065147.724436:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743742662195ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065147.724444:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].541, 88 off55664 00000004:00080000:3.0:1746065147.724446:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742672407ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724453:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].542, 88 off55752 00000004:00080000:3.0:1746065147.724456:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742682179ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724463:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].487, 88 off50912 00000004:00080000:3.0:1746065147.724465:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743742691005ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065147.724472:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].488, 88 off51000 00000004:00080000:3.0:1746065147.724474:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743742700997ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065147.724481:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].489, 88 off51088 00000004:00080000:3.0:1746065147.724483:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743742710007ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065147.724491:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].543, 88 off55840 00000004:00080000:3.0:1746065147.724493:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742719414ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724499:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].490, 88 off51176 00000004:00080000:3.0:1746065147.724502:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743742728059ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065147.724508:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].544, 88 off55928 00000004:00080000:3.0:1746065147.724510:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742736555ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724517:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].491, 88 off51264 00000004:00080000:3.0:1746065147.724520:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743742746122ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065147.724526:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].545, 88 off56016 00000004:00080000:3.0:1746065147.724528:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742754650ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724534:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].546, 88 off56104 00000004:00080000:3.0:1746065147.724537:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742763064ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724542:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].547, 88 off56192 00000004:00080000:3.0:1746065147.724544:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742770969ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724550:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].548, 88 off56280 00000004:00080000:3.0:1746065147.724552:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743742778964ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065147.724559:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].492, 88 off51352 00000004:00080000:3.0:1746065147.724562:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743742787995ns, next at 615601404258ns, rc = 0 00000100:00100000:1.0:1746065147.732097:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.732147:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430656 00000100:00100000:2.0:1746065147.732155:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430656 00000100:00100000:2.0:1746065147.732203:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13592 00000100:00100000:2.0:1746065147.732210:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+16:32094:x1830881263430656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.732231:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.732245:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93325d expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.732288:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.732296:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.732461:0:13395:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065147.732474:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.732484:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.732486:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065147.732489:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.732495:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00000100:00100000:2.0:1746065147.732542:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+17:32094:x1830881263430656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 331us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.732547:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13592 00000001:00080000:0.0:1746065147.736725:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935913 is committed 00000004:00080000:0.0:1746065147.736740:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 486 committed 00000004:00080000:0.0:1746065147.736759:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 541 committed 00000004:00080000:0.0:1746065147.736805:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 540 committed 00000004:00080000:0.0:1746065147.736807:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 539 committed 00000004:00080000:0.0:1746065147.736809:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 538 committed 00000004:00080000:0.0:1746065147.736810:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 485 committed 00000004:00080000:0.0:1746065147.736812:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 537 committed 00000004:00080000:0.0:1746065147.736813:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 484 committed 00000004:00080000:0.0:1746065147.736814:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 536 committed 00000004:00080000:0.0:1746065147.736816:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 483 committed 00000004:00080000:0.0:1746065147.736817:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 482 committed 00000004:00080000:0.0:1746065147.736819:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 481 committed 00000004:00080000:0.0:1746065147.736820:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 535 committed 00000004:00080000:0.0:1746065147.736822:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 534 committed 00000004:00080000:0.0:1746065147.736823:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 480 committed 00000004:00080000:0.0:1746065147.736824:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 479 committed 00000004:00080000:0.0:1746065147.736825:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 533 committed 00000001:00080000:0.0:1746065147.736832:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935910 is committed 00000001:00080000:0.0:1746065147.736835:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935909 is committed 00000004:00010000:0.0:1746065147.736909:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880097d06a00 reply state ffff880136be1800 transno 8589935913 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.736926:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.736934:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.736936:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065147.736942:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.736950:0:7204:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.736972:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.737002:0:7204:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.737013:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301760:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065147.737085:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065147.737386:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263302016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.737419:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.737436:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263302528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.737449:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.737463:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065147.737467:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263302144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.737481:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.737490:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263302656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.737500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.737518:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302016 00000100:00100000:3.0:1746065147.737524:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302016 00000100:00100000:3.0:1746065147.737555:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302528 00000100:00100000:3.0:1746065147.737557:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302528 00000100:00100000:3.0:1746065147.737565:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302144 00000100:00100000:3.0:1746065147.737567:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302144 00000100:00100000:3.0:1746065147.737574:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302656 00000100:00100000:3.0:1746065147.737576:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302656 00000100:00100000:3.0:1746065147.737586:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12978 00000100:00100000:3.0:1746065147.737591:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263302016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065147.737735:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065147.737738:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065144 -> 1746065144 00002000:00010000:3.0:1746065147.737740:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065142 -> 1746065142 00002000:00010000:3.0:1746065147.737741:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065144 -> 1746065144 00002000:00010000:3.0:1746065147.737743:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065147.737770:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263302016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (351us total) trans 17179873431 rc 0/0 00000100:00100000:3.0:1746065147.737798:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12978 00000100:00100000:3.0:1746065147.737810:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12979 00000100:00100000:3.0:1746065147.737815:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263302528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.737888:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263302528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (437us total) trans 17179873432 rc 0/0 00000100:00100000:3.0:1746065147.737893:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12979 00000100:00100000:3.0:1746065147.737902:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12980 00000100:00100000:3.0:1746065147.737907:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263302144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065147.737940:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065147.737942:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.737944:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.737945:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.737947:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746065147.737976:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263302144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (494us total) trans 17179873433 rc 0/0 00000100:00100000:3.0:1746065147.737981:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12980 00000100:00100000:3.0:1746065147.737989:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12981 00000100:00100000:3.0:1746065147.737993:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263302656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.738035:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881263302656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (534us total) trans 17179873434 rc 0/0 00000100:00100000:3.0:1746065147.738039:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12981 00000100:00080000:3.0:1746065147.738053:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1746065147.738075:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577e680/2, rc 0, transno 17179873433 00000100:00100000:3.0:1746065147.738079:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263302144:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.738086:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577fb80/2, rc 0, transno 17179873434 00000100:00100000:3.0:1746065147.738089:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263302656:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.738095:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f800/2, rc 0, transno 17179873431 00000100:00100000:3.0:1746065147.738097:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263302016:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.738103:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f100/2, rc 0, transno 17179873432 00000100:00100000:3.0:1746065147.738105:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263302528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.738123:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263302272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.738139:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.738150:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263302784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.738160:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.738169:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065147.738173:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263301888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.738183:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.738191:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263302400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.738201:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.738214:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302272 00000100:00100000:3.0:1746065147.738217:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302272 00000100:00100000:3.0:1746065147.738230:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302784 00000100:00100000:3.0:1746065147.738232:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302784 00000100:00100000:3.0:1746065147.738239:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301888 00000100:00100000:3.0:1746065147.738240:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301888 00000100:00100000:3.0:1746065147.738246:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302400 00000100:00100000:3.0:1746065147.738248:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302400 00000100:00100000:3.0:1746065147.738254:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12982 00000100:00100000:3.0:1746065147.738258:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881263302272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065147.738299:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065147.738301:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065147.738302:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065147.738304:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065147.738305:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065147.738326:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881263302272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (186us total) trans 17179873435 rc 0/0 00000100:00100000:3.0:1746065147.738331:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12982 00000100:00100000:3.0:1746065147.738339:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12983 00000100:00100000:3.0:1746065147.738343:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881263302784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.738386:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881263302784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (224us total) trans 17179873436 rc 0/0 00000100:00100000:3.0:1746065147.738390:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12983 00000100:00100000:3.0:1746065147.738398:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12984 00000100:00100000:3.0:1746065147.738402:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881263301888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065147.738435:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065147.738438:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065147.738439:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065147.738441:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:3.0:1746065147.738442:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065147.738458:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881263301888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (274us total) trans 17179873437 rc 0/0 00000100:00100000:3.0:1746065147.738463:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12984 00000100:00100000:3.0:1746065147.738471:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12985 00000100:00100000:3.0:1746065147.738474:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881263302400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.738521:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881263302400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (319us total) trans 17179873438 rc 0/0 00000100:00100000:3.0:1746065147.738525:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12985 00000004:00080000:3.0:1746065147.738545:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577c700/2, rc 0, transno 17179873437 00000100:00100000:3.0:1746065147.738548:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263301888:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.738554:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577c000/2, rc 0, transno 17179873438 00000100:00100000:3.0:1746065147.738557:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263302400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.738562:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f480/2, rc 0, transno 17179873435 00000100:00100000:3.0:1746065147.738564:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263302272:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.738569:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577ea00/2, rc 0, transno 17179873436 00000100:00100000:3.0:1746065147.738571:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263302784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065147.738790:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263302912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065147.738812:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065147.739090:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302912 00000100:00100000:0.0:1746065147.739094:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302912 00000100:00080000:3.0:1746065147.743472:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065147.744074:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263303040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.744124:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.744145:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263303552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.744158:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.744173:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065147.744177:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263303168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.744187:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.744195:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263303680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.744206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.744227:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303040 00000100:00100000:2.0:1746065147.744232:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303040 00000100:00100000:2.0:1746065147.744257:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303552 00000100:00100000:2.0:1746065147.744259:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303552 00000100:00100000:2.0:1746065147.744267:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303168 00000100:00100000:2.0:1746065147.744269:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303168 00000100:00100000:2.0:1746065147.744276:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303680 00000100:00100000:2.0:1746065147.744277:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303680 00000100:00100000:2.0:1746065147.744285:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12986 00000100:00100000:2.0:1746065147.744291:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263303040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065147.744401:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065147.744403:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065145 -> 1746065145 00002000:00010000:2.0:1746065147.744405:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065141 -> 1746065141 00002000:00010000:2.0:1746065147.744407:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065145 -> 1746065145 00002000:00010000:2.0:1746065147.744408:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065147.744435:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263303040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (309us total) trans 21474840878 rc 0/0 00000100:00100000:2.0:1746065147.744441:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12986 00000100:00100000:2.0:1746065147.744457:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12987 00000100:00100000:2.0:1746065147.744460:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263303552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.744513:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263303552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (353us total) trans 21474840879 rc 0/0 00000100:00100000:2.0:1746065147.744517:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12987 00000100:00100000:2.0:1746065147.744526:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12988 00000100:00100000:2.0:1746065147.744530:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263303168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065147.744563:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:2.0:1746065147.744565:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065147 -> 1746065147 00002000:00010000:2.0:1746065147.744567:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065147 -> 1746065147 00002000:00010000:2.0:1746065147.744568:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065147 -> 1746065147 00002000:00010000:2.0:1746065147.744570:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:2.0:1746065147.744586:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263303168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (397us total) trans 21474840880 rc 0/0 00000100:00100000:2.0:1746065147.744590:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12988 00000100:00100000:2.0:1746065147.744598:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12989 00000100:00100000:2.0:1746065147.744602:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263303680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065147.744635:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065147.744637:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065147.744639:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065147.744640:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065147.744642:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:2.0:1746065147.744657:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263303680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (451us total) trans 21474840881 rc 0/0 00000100:00100000:2.0:1746065147.744662:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12989 00000100:00100000:2.0:1746065147.744691:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840873 gen 2 00000004:00080000:2.0:1746065147.744695:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50e00, transno 21474840819 00000004:00080000:2.0:1746065147.744699:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78380, transno 21474840820 00000004:00080000:2.0:1746065147.744701:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800983b9f80, transno 21474840821 00000004:00080000:2.0:1746065147.744704:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528000, transno 21474840822 00000004:00080000:2.0:1746065147.744706:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fca80, transno 21474840823 00000004:00080000:2.0:1746065147.744708:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6de680, transno 21474840824 00000100:00100000:0.0:1746065147.744709:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263301760:192.168.202.27@tcp:105: 00000004:00080000:2.0:1746065147.744710:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834f480, transno 21474840825 00000004:00080000:2.0:1746065147.744713:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077ce00, transno 21474840826 00000004:00080000:2.0:1746065147.744714:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4000, transno 21474840827 00000004:00080000:2.0:1746065147.744716:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ea00, transno 21474840828 00000004:00080000:2.0:1746065147.744718:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ce00, transno 21474840829 00000004:00080000:2.0:1746065147.744720:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d180, transno 21474840830 00000100:00100000:0.0:1746065147.744721:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1746065147.744722:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d880, transno 21474840831 00000004:00080000:2.0:1746065147.744723:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ed80, transno 21474840832 00000004:00080000:2.0:1746065147.744725:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d500, transno 21474840833 00000004:00080000:2.0:1746065147.744727:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ca80, transno 21474840834 00000004:00080000:2.0:1746065147.744728:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3dc00, transno 21474840835 00000004:00080000:2.0:1746065147.744730:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3c000, transno 21474840836 00000004:00080000:2.0:1746065147.744731:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa7b80, transno 21474840846 00000004:00080000:2.0:1746065147.744733:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa6d80, transno 21474840847 00000004:00080000:2.0:1746065147.744735:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa4380, transno 21474840848 00000004:00080000:2.0:1746065147.744736:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa4700, transno 21474840849 00000004:00080000:2.0:1746065147.744738:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa7100, transno 21474840850 00000004:00080000:2.0:1746065147.744740:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa7800, transno 21474840851 00000004:00080000:2.0:1746065147.744741:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa7480, transno 21474840852 00000004:00080000:2.0:1746065147.744743:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa6a00, transno 21474840853 00000004:00080000:2.0:1746065147.744744:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa4000, transno 21474840854 00000004:00080000:2.0:1746065147.744746:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3480, transno 21474840856 00000004:00080000:2.0:1746065147.744748:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd6d80, transno 21474840857 00000004:00080000:2.0:1746065147.744750:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f42a00, transno 21474840858 00000004:00080000:2.0:1746065147.744752:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd5f80, transno 21474840859 00000004:00080000:2.0:1746065147.744753:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4000, transno 21474840860 00000004:00080000:2.0:1746065147.744755:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd5c00, transno 21474840861 00000004:00080000:2.0:1746065147.744757:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4a80, transno 21474840862 00000004:00080000:2.0:1746065147.744759:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12a00, transno 21474840863 00000004:00080000:2.0:1746065147.744761:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd7100, transno 21474840864 00000004:00080000:2.0:1746065147.744762:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b66d80, transno 21474840865 00000004:00080000:2.0:1746065147.744764:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090dd9180, transno 21474840866 00000004:00080000:2.0:1746065147.744766:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b67100, transno 21474840867 00000004:00080000:2.0:1746065147.744768:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b66680, transno 21474840868 00000004:00080000:2.0:1746065147.744770:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b67b80, transno 21474840869 00000004:00080000:2.0:1746065147.744788:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090ddb480, transno 21474840870 00000004:00080000:2.0:1746065147.744790:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b64700, transno 21474840871 00000004:00080000:2.0:1746065147.744791:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b66300, transno 21474840872 00000004:00080000:2.0:1746065147.744793:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1500, transno 21474840873 00000100:00100000:2.0:1746065147.744798:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880099cc3b80 x1830881263303168/t21474840880(21474840880) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065163 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746065147.744806:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc3b80/2, rc 0, transno 21474840880 00000100:00100000:2.0:1746065147.744809:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263303168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065147.744819:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc1c00/2, rc 0, transno 21474840881 00000100:00100000:2.0:1746065147.744821:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263303680:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065147.744827:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d07b80/2, rc 0, transno 21474840878 00000100:00100000:2.0:1746065147.744829:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263303040:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065147.744835:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc1880/2, rc 0, transno 21474840879 00000100:00100000:2.0:1746065147.744837:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263303552:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065147.745063:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 45 done 00000100:00100000:1.0:1746065147.745142:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263303424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065147.745164:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065147.745176:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263303936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065147.745187:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065147.745198:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065147.745202:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263303296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065147.745213:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065147.745223:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263303808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065147.745234:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065147.745250:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303424 00000100:00100000:1.0:1746065147.745253:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303424 00000100:00100000:1.0:1746065147.745270:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303936 00000100:00100000:1.0:1746065147.745272:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303936 00000100:00100000:1.0:1746065147.745281:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303296 00000100:00100000:1.0:1746065147.745283:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303296 00000100:00100000:1.0:1746065147.745290:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303808 00000100:00100000:1.0:1746065147.745291:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303808 00000100:00100000:1.0:1746065147.745299:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12990 00000100:00100000:1.0:1746065147.745303:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263303424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065147.745348:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:1.0:1746065147.745350:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065147.745352:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065147.745353:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065147.745355:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:1.0:1746065147.745375:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263303424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (210us total) trans 21474840882 rc 0/0 00000100:00100000:1.0:1746065147.745379:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12990 00000100:00100000:1.0:1746065147.745390:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12991 00000100:00100000:1.0:1746065147.745394:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263303936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065147.745438:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263303936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (250us total) trans 21474840883 rc 0/0 00000100:00100000:1.0:1746065147.745443:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12991 00000100:00100000:1.0:1746065147.745452:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12992 00000100:00100000:1.0:1746065147.745456:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263303296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065147.745489:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065147.745492:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065147.745493:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065147.745495:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065147.745496:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746065147.745511:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263303296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (297us total) trans 21474840884 rc 0/0 00000100:00100000:1.0:1746065147.745515:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12992 00000100:00100000:1.0:1746065147.745523:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12993 00000100:00100000:1.0:1746065147.745527:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263303808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065147.745560:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:1.0:1746065147.745563:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065147.745564:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065147.745566:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065147.745567:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:1.0:1746065147.745583:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263303808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (348us total) trans 21474840885 rc 0/0 00000100:00100000:1.0:1746065147.745588:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12993 00000004:00080000:1.0:1746065147.745614:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc2300/2, rc 0, transno 21474840884 00000100:00100000:1.0:1746065147.745617:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263303296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065147.745623:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513b800/2, rc 0, transno 21474840885 00000100:00100000:1.0:1746065147.745625:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263303808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065147.745630:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc0380/2, rc 0, transno 21474840882 00000100:00100000:1.0:1746065147.745633:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263303424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065147.745638:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135139c00/2, rc 0, transno 21474840883 00000100:00100000:1.0:1746065147.745640:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263303936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065147.745731:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12994 00000100:00100000:3.0:1746065147.745737:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263302912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065147.745812:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065147.745815:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.745816:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.745818:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.745819:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746065147.745851:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263302912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (7037us total) trans 21474840886 rc 0/0 00000100:00100000:3.0:1746065147.745856:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12994 00000004:00080000:1.0:1746065147.746625:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d07480/2, rc 0, transno 21474840886 00000100:00100000:1.0:1746065147.746629:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263302912:0@lo:2:osp-syn-0-0.0 00010000:00080000:0.0:1746065147.746820:0:7204:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065147.746830:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32105:x1830881263429504:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 35536us (36390us total) trans 8589935913 rc 0/0 00000100:00100000:0.0:1746065147.746837:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13590 00010000:00010000:0.0:1746065147.746859:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.746867:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.746873:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.746878:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065147.746882:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.746891:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.746903:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.746905:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065147.746908:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065147.746913:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146ed05 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00000100:00100000:1.0:1746065147.747318:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.747334:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430784 00000100:00100000:1.0:1746065147.747338:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430784 00000100:00100000:1.0:1746065147.747359:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4892 00000100:00100000:1.0:1746065147.747364:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+8:32094:x1830881263430784:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:1.0:1746065147.747423:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+8:32094:x1830881263430784:12345-192.168.202.27@tcp:49:cat.0 Request processed in 58us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.747428:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4892 00000100:00100000:3.0:1746065147.747669:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263430016:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27469us (28084us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065147.747675:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3609 00002000:00100000:3.0:1746065147.747682:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092745c00 x1830881263430016/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.747689:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745c00 with x1830881263430016 ext(4194304->5021695) 00002000:00010000:3.0:1746065147.747692:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092745c00 00010000:00010000:2.0:1746065147.748540:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.748554:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.748561:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.748584:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.748593:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 7 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.748602:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263304064:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065147.749239:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.751897:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.751925:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.752014:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263304064:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.752032:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065147.752121:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430912 00000100:00100000:2.0:1746065147.752127:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430912 00000100:00100000:2.0:1746065147.752155:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431040 00000100:00100000:2.0:1746065147.752157:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431040 00000100:00100000:2.0:1746065147.752173:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13593 00000100:00100000:2.0:1746065147.752179:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32105:x1830881263430912:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065147.752198:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.752210:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933264 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.752249:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.752259:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.752273:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.752276:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065147.752278:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a400, rc 0) 00000100:00100000:2.0:1746065147.752322:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32105:x1830881263430912:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 143us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.752327:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13593 00000100:00100000:2.0:1746065147.752341:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13594 00000100:00100000:2.0:1746065147.752345:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32097:x1830881263431040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.752352:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.752357:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a800/0xad6b7ddc146ed36 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93326b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.752373:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a800/0xad6b7ddc146ed36 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93326b expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.752380:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a800/0xad6b7ddc146ed36 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93326b expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.752387:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.752389:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065147.752390:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a800, rc 0) 00000100:00100000:2.0:1746065147.752402:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32097:x1830881263431040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 57us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.752406:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13594 00000100:00100000:0.0:1746065147.753721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.753797:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431168 00000100:00100000:2.0:1746065147.753802:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431168 00010000:00010000:2.0:1746065147.753822:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 8 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.753850:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5816 00000100:00100000:2.0:1746065147.753856:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263431168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.753865:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.753870:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 8 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.753879:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 8 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.753894:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc146ec80 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933202 expref: 8 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.753906:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.753910:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.753917:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.753922:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.753934:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065147.753942:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.753948:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065147.753968:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:2.0:1746065147.753976:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263431168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.753981:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5816 00010000:00010000:0.0:1746065147.754094:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754101:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754106:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754111:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552e000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065147.754114:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754118:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754125:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.754127:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065147.754129:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754133:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146ed28 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754146:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754150:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754153:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754157:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754160:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065147.754162:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754165:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754173:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065147.754175:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065147.754177:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754180:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c400/0xad6b7ddc146ed13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754187:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754191:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754194:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754197:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065147.754199:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754203:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754207:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012f854600) 00010000:00010000:0.0:1746065147.754208:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065147.754210:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754213:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d400/0xad6b7ddc146ed1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.754244:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146ed0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933256 expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.754251:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d600/0xad6b7ddc146ed0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933256 expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.754256:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d600, rc 0) 00000100:00100000:0.0:1746065147.754277:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32107:x1830881263429760:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 42624us (43137us total) trans 8589935914 rc 301/301 00000100:00100000:0.0:1746065147.754282:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13591 00000100:00100000:0.0:1746065147.759522:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.759673:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431424 00000100:00100000:2.0:1746065147.759680:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431424 00000100:00100000:2.0:1746065147.759986:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4893 00000100:00100000:2.0:1746065147.759994:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32105:x1830881263431424:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065147.762169:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.762287:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32105:x1830881263431424:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 2291us (2770us total) trans 8589935915 rc 0/0 00000100:00100000:2.0:1746065147.762296:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4893 00000100:00100000:3.0:1746065147.762412:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431680 00000100:00100000:3.0:1746065147.762418:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431680 00002000:00100000:3.0:1746065147.762449:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880092747100 x1830881263431680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.762458:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747100 with x1830881263431680 ext(5017600->5021695) 00002000:00010000:3.0:1746065147.762463:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747100 00000100:00100000:3.0:1746065147.762479:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3610 00000100:00100000:3.0:1746065147.762485:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263431680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.762527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.762541:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.762565:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.762578:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432192 00000100:00100000:0.0:1746065147.762581:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432192 00000100:00100000:3.0:1746065147.762593:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263431680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 108us (430us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065147.762598:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3610 00002000:00100000:3.0:1746065147.762604:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880092747100 x1830881263431680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065147.762610:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13595 00002000:00100000:3.0:1746065147.762611:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747100 with x1830881263431680 ext(5017600->5021695) 00002000:00010000:3.0:1746065147.762614:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747100 00000100:00100000:0.0:1746065147.762615:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32107:x1830881263432192:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065147.762628:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.762630:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065147.762650:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a800/0xad6b7ddc146ed36 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93326b expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.762662:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065147.762665:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065147.762675:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d000/0xad6b7ddc146ed44 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933280 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.762683:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431808 00000100:00100000:3.0:1746065147.762685:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431808 00000100:00100000:3.0:1746065147.762700:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431936 00000100:00100000:3.0:1746065147.762702:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431936 00010000:00010000:0.0:1746065147.762710:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065147.762713:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12995 00000100:00100000:3.0:1746065147.762717:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263431808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065147.762720:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.762723:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.762726:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.762730:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933272 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.762731:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065147.762743:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.762745:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.762750:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.762753:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.762760:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065147.762761:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 7 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.762766:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a200, rc 0) 00000100:00100000:0.0:1746065147.762770:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263304192:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.762798:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263431808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.762803:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12995 00000100:00100000:3.0:1746065147.762812:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12996 00000100:00100000:3.0:1746065147.762816:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263431936:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.762822:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065147.762828:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.762830:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933279 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.762835:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 7 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746065147.762838:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.762840:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065147.762842:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263304320:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.762843:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 24 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.762851:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 24 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065147.762857:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065147.762858:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46000, rc 0) 00000100:00100000:3.0:1746065147.762869:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263431936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.762877:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12996 00000100:00100000:0.0:1746065147.767316:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.768117:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.769016:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.769478:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.769494:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.769564:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.769723:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432320 00000100:00100000:2.0:1746065147.769731:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432320 00000100:00100000:2.0:1746065147.769762:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432576 00000100:00100000:2.0:1746065147.769764:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432576 00000100:00100000:2.0:1746065147.769784:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432448 00000100:00100000:2.0:1746065147.769786:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432448 00000100:00100000:2.0:1746065147.769798:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12997 00000100:00100000:2.0:1746065147.769804:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263432320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.769819:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.769833:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933287 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.769851:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.769853:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.769860:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 26 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.769872:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 26 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.769881:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b600, rc 0) 00000100:00100000:2.0:1746065147.769919:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263432320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 115us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.769927:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12997 00000100:00100000:2.0:1746065147.769940:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12998 00000100:00100000:2.0:1746065147.769944:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263432576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.769950:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.769956:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933295 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.769979:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.769980:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.769984:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 26 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.769991:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 26 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.769998:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a200, rc 0) 00000100:00100000:2.0:1746065147.770012:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263432576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.770016:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12998 00000100:00100000:2.0:1746065147.770025:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 12999 00000100:00100000:2.0:1746065147.770029:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263432448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065147.770034:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065147.770041:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93328e expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.770050:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.770051:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.770054:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.770062:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065147.770067:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71ae00, rc 0) 00000100:00100000:2.0:1746065147.770078:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263432448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 49us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.770082:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 12999 00000100:00100000:2.0:1746065147.770097:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432704 00000100:00100000:2.0:1746065147.770099:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432704 00010000:00010000:2.0:1746065147.770110:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 8 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.770124:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432832 00000100:00100000:2.0:1746065147.770125:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432832 00010000:00010000:2.0:1746065147.770131:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 8 pid: 13395 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.770141:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5817 00000100:00100000:2.0:1746065147.770146:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263432704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.770154:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.770159:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 8 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.770167:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 8 pid: 7204 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.770184:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.770188:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.770194:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.770198:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.770210:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263432704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.770215:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5817 00000100:00100000:2.0:1746065147.770223:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5818 00000100:00100000:2.0:1746065147.770226:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263432832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.770231:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.770234:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 8 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.770240:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 8 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.770248:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065147.770250:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.770255:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.770260:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065147.770271:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.770281:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263432832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.770285:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5818 00000100:00100000:2.0:1746065147.770326:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433088 00000100:00100000:2.0:1746065147.770328:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433088 00000100:00100000:2.0:1746065147.770343:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4894 00000100:00100000:2.0:1746065147.770347:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32105:x1830881263433088:12345-192.168.202.27@tcp:35:mirror_io.0 00010000:00010000:0.0:1746065147.770748:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146ed2f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933264 expref: 8 pid: 7204 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.770759:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263304192:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.770768:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc146ed21 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93325d expref: 7 pid: 13395 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746065147.770793:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263304320:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065147.770808:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.770814:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065147.770819:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065147.772364:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32105:x1830881263433088:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 2011us (2794us total) trans 8589935916 rc 0/0 00000100:00100000:2.0:1746065147.772372:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4894 00000040:00080000:0.0:1746065147.772670:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].549, 88 off56368 00000004:00080000:0.0:1746065147.772675:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743790901485ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065147.772697:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].493, 88 off51440 00000004:00080000:0.0:1746065147.772700:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743790926630ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065147.774001:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].494, 88 off51528 00000004:00080000:1.0:1746065147.774009:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743792235235ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065147.774024:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].550, 88 off56456 00000004:00080000:1.0:1746065147.774027:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743792253060ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065147.774135:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].551, 88 off56544 00000004:00080000:1.0:1746065147.774138:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743792364868ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065147.774146:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].495, 88 off51616 00000004:00080000:1.0:1746065147.774148:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743792374871ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065147.774157:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].496, 88 off51704 00000004:00080000:1.0:1746065147.774159:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743792385693ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065147.774167:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].497, 88 off51792 00000004:00080000:1.0:1746065147.774169:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743792395261ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065147.774176:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].552, 88 off56632 00000004:00080000:1.0:1746065147.774179:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743792405787ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065147.774187:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].498, 88 off51880 00000004:00080000:1.0:1746065147.774189:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743792415506ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065147.774197:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].553, 88 off56720 00000004:00080000:1.0:1746065147.774199:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743792425895ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065147.774206:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].499, 88 off51968 00000004:00080000:1.0:1746065147.774208:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743792434596ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065147.774215:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].554, 88 off56808 00000004:00080000:1.0:1746065147.774217:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743792443937ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065147.774224:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].555, 88 off56896 00000004:00080000:1.0:1746065147.774226:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743792453026ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065147.774234:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].556, 88 off56984 00000004:00080000:1.0:1746065147.774236:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743792462486ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065147.774243:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].557, 88 off57072 00000004:00080000:1.0:1746065147.774245:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743792471825ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065147.774253:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].500, 88 off52056 00000004:00080000:1.0:1746065147.774255:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743792481941ns, next at 615601404258ns, rc = 0 00000001:00080000:0.0:1746065147.778942:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935917 is committed 00000004:00080000:0.0:1746065147.778952:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 494 committed 00000004:00080000:0.0:1746065147.778978:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 550 committed 00000004:00080000:0.0:1746065147.778992:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 549 committed 00000004:00080000:0.0:1746065147.778994:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 548 committed 00000004:00080000:0.0:1746065147.778995:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 547 committed 00000004:00080000:0.0:1746065147.778997:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 493 committed 00000004:00080000:0.0:1746065147.778999:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 546 committed 00000004:00080000:0.0:1746065147.779000:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 492 committed 00000004:00080000:0.0:1746065147.779002:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 545 committed 00000004:00080000:0.0:1746065147.779003:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 491 committed 00000004:00080000:0.0:1746065147.779005:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 490 committed 00000004:00080000:0.0:1746065147.779006:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 489 committed 00000004:00080000:0.0:1746065147.779007:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 544 committed 00000004:00080000:0.0:1746065147.779009:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 543 committed 00000004:00080000:0.0:1746065147.779011:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 488 committed 00000004:00080000:0.0:1746065147.779012:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 487 committed 00000004:00080000:0.0:1746065147.779014:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 542 committed 00000001:00080000:0.0:1746065147.779018:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935916 is committed 00000100:00100000:2.0:1746065147.779176:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263304448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.779229:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.779274:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263304960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.779290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.779305:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065147.779310:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263304576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.779323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.779333:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263305088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.779345:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.779362:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304448 00000100:00100000:2.0:1746065147.779368:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304448 00000100:00100000:2.0:1746065147.779395:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304960 00000100:00100000:2.0:1746065147.779397:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304960 00000100:00100000:2.0:1746065147.779405:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304576 00000100:00100000:2.0:1746065147.779407:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304576 00000100:00100000:2.0:1746065147.779414:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305088 00000100:00100000:2.0:1746065147.779416:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305088 00000100:00100000:2.0:1746065147.779427:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13000 00000100:00100000:2.0:1746065147.779433:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3759:x1830881263304448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065147.779532:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065147.779535:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065147 -> 1746065147 00002000:00010000:2.0:1746065147.779537:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065147 -> 1746065147 00002000:00010000:2.0:1746065147.779539:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065147 -> 1746065147 00002000:00010000:2.0:1746065147.779541:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:2.0:1746065147.779567:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263304448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (338us total) trans 21474840887 rc 0/0 00000100:00100000:2.0:1746065147.779573:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13000 00000100:00100000:2.0:1746065147.779588:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13001 00000100:00100000:2.0:1746065147.779592:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3759:x1830881263304960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065147.779630:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:2.0:1746065147.779632:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065147.779633:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065147.779635:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065147.779637:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:2.0:1746065147.779653:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263304960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (362us total) trans 21474840888 rc 0/0 00000100:00100000:2.0:1746065147.779657:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13001 00000100:00100000:2.0:1746065147.779666:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13002 00000100:00100000:2.0:1746065147.779670:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3759:x1830881263304576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065147.779704:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065147.779706:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065145 -> 1746065145 00002000:00010000:2.0:1746065147.779708:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065141 -> 1746065141 00002000:00010000:2.0:1746065147.779709:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065145 -> 1746065145 00002000:00010000:2.0:1746065147.779711:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065147.779726:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263304576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (402us total) trans 21474840889 rc 0/0 00000100:00100000:2.0:1746065147.779730:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13002 00000100:00100000:2.0:1746065147.779738:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13003 00000100:00100000:2.0:1746065147.779742:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3759:x1830881263305088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065147.779831:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263304704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065147.779854:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.779878:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263305216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065147.779890:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.779901:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065147.779905:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263304832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065147.779918:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.779927:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263305344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065147.779939:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.779955:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304704 00000100:00100000:3.0:1746065147.779971:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304704 00000100:00100000:3.0:1746065147.779983:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305216 00000100:00100000:3.0:1746065147.779985:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305216 00000100:00100000:3.0:1746065147.779990:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304832 00000100:00100000:3.0:1746065147.779992:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304832 00000100:00100000:3.0:1746065147.779997:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305344 00000100:00100000:3.0:1746065147.779999:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305344 00000100:00100000:3.0:1746065147.780005:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13004 00000100:00100000:3.0:1746065147.780009:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263304704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065147.780054:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:3.0:1746065147.780056:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.780058:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.780060:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.780061:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:3.0:1746065147.780081:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263304704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (225us total) trans 21474840891 rc 0/0 00000100:00100000:3.0:1746065147.780086:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13004 00000100:00100000:3.0:1746065147.780095:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13005 00000100:00100000:3.0:1746065147.780098:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263305216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065147.780130:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065147.780132:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065147.780134:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065147.780135:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065147.780137:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:3.0:1746065147.780151:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263305216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (260us total) trans 21474840892 rc 0/0 00000100:00100000:3.0:1746065147.780154:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13005 00000100:00100000:3.0:1746065147.780163:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13006 00000100:00100000:3.0:1746065147.780166:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263304832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065147.780196:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746065147.780198:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065147.780200:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065147.780201:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065147.780203:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746065147.780218:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263304832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (300us total) trans 21474840893 rc 0/0 00000100:00100000:3.0:1746065147.780223:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13006 00000100:00100000:3.0:1746065147.780231:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13007 00000100:00100000:3.0:1746065147.780236:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263305344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065147.780270:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:3.0:1746065147.780272:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065147.780273:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065147.780275:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065147.780276:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:3.0:1746065147.780293:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263305344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (352us total) trans 21474840894 rc 0/0 00000100:00100000:3.0:1746065147.780297:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13007 00000004:00080000:3.0:1746065147.780321:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577df80/2, rc 0, transno 21474840893 00000100:00100000:3.0:1746065147.780329:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263304832:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065147.780335:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06300/2, rc 0, transno 21474840894 00000100:00100000:3.0:1746065147.780338:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263305344:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065147.780343:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc1500/2, rc 0, transno 21474840891 00000100:00100000:3.0:1746065147.780345:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263304704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065147.780351:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577d500/2, rc 0, transno 21474840892 00000100:00100000:3.0:1746065147.780353:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263305216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065147.780422:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263305728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.780439:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.780451:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263306240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.780462:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.780471:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065147.780474:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263305856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.780485:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.780492:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263306368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.780502:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065147.780515:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305728 00000100:00100000:3.0:1746065147.780517:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305728 00000100:00100000:3.0:1746065147.780528:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306240 00000100:00100000:3.0:1746065147.780530:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306240 00000100:00100000:3.0:1746065147.780535:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305856 00000100:00100000:3.0:1746065147.780536:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305856 00000100:00100000:3.0:1746065147.780541:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306368 00000100:00100000:3.0:1746065147.780542:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306368 00000100:00100000:3.0:1746065147.780549:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13008 00000100:00100000:3.0:1746065147.780552:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3761:x1830881263305728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065147.780603:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065147.780605:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.780607:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.780608:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065147 -> 1746065147 00002000:00010000:3.0:1746065147.780610:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746065147.780630:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3761:x1830881263305728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (189us total) trans 17179873439 rc 0/0 00000100:00100000:3.0:1746065147.780635:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13008 00000100:00100000:3.0:1746065147.780644:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13009 00000100:00100000:3.0:1746065147.780648:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3761:x1830881263306240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.780696:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3761:x1830881263306240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (232us total) trans 17179873440 rc 0/0 00000100:00100000:3.0:1746065147.780701:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13009 00000100:00100000:3.0:1746065147.780709:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13010 00000100:00100000:3.0:1746065147.780714:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3761:x1830881263305856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065147.780746:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065147.780748:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065147.780750:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065147.780751:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065147.780753:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065147.780770:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3761:x1830881263305856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (283us total) trans 17179873441 rc 0/0 00000100:00100000:3.0:1746065147.780795:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13010 00000100:00100000:3.0:1746065147.780803:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13011 00000100:00100000:3.0:1746065147.780808:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3761:x1830881263306368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065147.780850:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3761:x1830881263306368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (347us total) trans 17179873442 rc 0/0 00000100:00100000:3.0:1746065147.780854:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13011 00000004:00080000:3.0:1746065147.780871:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135220380/2, rc 0, transno 17179873441 00000100:00100000:3.0:1746065147.780874:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263305856:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.780879:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6de680/2, rc 0, transno 17179873442 00000100:00100000:3.0:1746065147.780881:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263306368:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.780886:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221f80/2, rc 0, transno 17179873439 00000100:00100000:3.0:1746065147.780888:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263305728:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065147.780893:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135220000/2, rc 0, transno 17179873440 00000100:00100000:3.0:1746065147.780896:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263306240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065147.781030:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263305600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065147.781052:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065147.781074:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263306112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065147.781089:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065147.781100:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065147.781104:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263305472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065147.781115:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065147.781123:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263305984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065147.781134:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065147.781148:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305600 00000100:00100000:0.0:1746065147.781151:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305600 00000100:00100000:0.0:1746065147.781163:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306112 00000100:00100000:0.0:1746065147.781165:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306112 00000100:00100000:0.0:1746065147.781170:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305472 00000100:00100000:0.0:1746065147.781172:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305472 00000100:00100000:0.0:1746065147.781177:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305984 00000100:00100000:0.0:1746065147.781178:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305984 00000100:00100000:0.0:1746065147.781184:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13012 00000100:00100000:0.0:1746065147.781188:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3760:x1830881263305600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065147.781229:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065147.781231:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065144 -> 1746065144 00002000:00010000:0.0:1746065147.781233:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065142 -> 1746065142 00002000:00010000:0.0:1746065147.781235:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065144 -> 1746065144 00002000:00010000:0.0:1746065147.781236:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065147.781257:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3760:x1830881263305600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (204us total) trans 17179873443 rc 0/0 00000100:00100000:0.0:1746065147.781261:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13012 00000100:00100000:0.0:1746065147.781272:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13013 00000100:00100000:0.0:1746065147.781275:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3760:x1830881263306112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065147.781322:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3760:x1830881263306112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (232us total) trans 17179873444 rc 0/0 00000100:00100000:0.0:1746065147.781326:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13013 00000100:00100000:0.0:1746065147.781334:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13014 00000100:00100000:0.0:1746065147.781337:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3760:x1830881263305472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065147.781370:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065147.781372:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065143 -> 1746065143 00002000:00010000:0.0:1746065147.781374:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065143 -> 1746065143 00002000:00010000:0.0:1746065147.781376:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065143 -> 1746065143 00002000:00010000:0.0:1746065147.781377:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065147.781392:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3760:x1830881263305472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (275us total) trans 17179873445 rc 0/0 00000100:00100000:0.0:1746065147.781396:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13014 00000100:00100000:0.0:1746065147.781404:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13015 00000100:00100000:0.0:1746065147.781408:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3760:x1830881263305984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065147.781452:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3760:x1830881263305984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (316us total) trans 17179873446 rc 0/0 00000100:00100000:0.0:1746065147.781456:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13015 00000004:00080000:0.0:1746065147.781475:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221180/2, rc 0, transno 17179873445 00000100:00100000:0.0:1746065147.781478:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263305472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065147.781484:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221500/2, rc 0, transno 17179873446 00000100:00100000:0.0:1746065147.781486:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263305984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065147.781491:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135222d80/2, rc 0, transno 17179873443 00000100:00100000:0.0:1746065147.781493:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263305600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065147.781498:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135222300/2, rc 0, transno 17179873444 00000100:00100000:0.0:1746065147.781500:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263306112:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746065147.782582:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.782594:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.782596:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065147.782608:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d000/0xad6b7ddc146ed44 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 29 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065147.782641:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 28 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.782661:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.782663:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065147.782665:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6da00, rc 0) 00000100:00100000:1.0:1746065147.782702:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+28:32107:x1830881263432192:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 20085us (20135us total) trans 8589935917 rc 0/0 00000100:00100000:1.0:1746065147.782708:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13595 00000100:00100000:1.0:1746065147.782762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.782805:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433344 00000100:00100000:1.0:1746065147.782809:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433344 00002000:00100000:1.0:1746065147.782830:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff8800983b9f80 x1830881263433344/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.782838:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9f80 with x1830881263433344 ext(5017600->5021695) 00002000:00010000:1.0:1746065147.782842:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b9f80 00000100:00100000:1.0:1746065147.782855:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3611 00000100:00100000:1.0:1746065147.782860:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263433344:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065147.782934:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263433344:12345-192.168.202.27@tcp:3:cat.0 Request processed in 74us (172us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065147.782942:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3611 00002000:00100000:1.0:1746065147.782946:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff8800983b9f80 x1830881263433344/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.782952:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b9f80 with x1830881263433344 ext(5017600->5021695) 00002000:00010000:1.0:1746065147.782955:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b9f80 00000004:00080000:2.0:1746065147.783819:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc2d80/2, rc 0, transno 21474840889 00000100:00100000:2.0:1746065147.783825:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263304576:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065147.783834:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc3800/2, rc 0, transno 21474840887 00000100:00100000:2.0:1746065147.783836:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263304448:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065147.783842:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577e300/2, rc 0, transno 21474840888 00000100:00100000:2.0:1746065147.783845:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263304960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.783892:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263306496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.783915:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.783948:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306496 00000100:00100000:2.0:1746065147.783951:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306496 00000100:00100000:2.0:1746065147.783979:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13016 00000100:00100000:2.0:1746065147.783983:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263306496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065147.786189:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3759:x1830881263306496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2200us (2267us total) trans 21474840895 rc 0/0 00000100:00100000:2.0:1746065147.786199:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13016 00000100:00100000:2.0:1746065147.786825:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263305088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7081us (7477us total) trans 21474840890 rc 0/0 00000100:00100000:2.0:1746065147.786832:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13003 00000004:00080000:0.0:1746065147.787330:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e13100/2, rc 0, transno 21474840895 00000100:00100000:0.0:1746065147.787337:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263306496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065147.787346:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577d180/2, rc 0, transno 21474840890 00000100:00100000:0.0:1746065147.787349:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263305088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065147.787476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.787637:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433472 00000100:00100000:3.0:1746065147.787644:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433472 00000100:00100000:3.0:1746065147.787670:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13017 00000100:00100000:3.0:1746065147.787676:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+37:32107:x1830881263433472:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065147.787689:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.787704:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93329c expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.787727:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 38 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.787735:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 25 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.787740:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.787742:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065147.787745:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3620864->3735551] (req 3620864->3735551) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 38 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.787765:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 25 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.787793:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 25 pid: 1880 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.787802:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263306624:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.787862:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 38 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.787870:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 38 pid: 11461 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746065147.787877:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263306752:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.787893:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065147.791030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.791089:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.791328:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263306624:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.791337:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263306752:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.791361:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3620864->3735551] (req 3620864->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 38 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.791373:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:3.0:1746065147.791405:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+38:32107:x1830881263433472:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3729us (3931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.791412:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13017 00000100:00100000:2.0:1746065147.791474:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433728 00000100:00100000:2.0:1746065147.791479:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433728 00000100:00100000:2.0:1746065147.791511:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4895 00000100:00100000:2.0:1746065147.791517:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+7:32094:x1830881263433728:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065147.791653:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+8:32094:x1830881263433728:12345-192.168.202.27@tcp:35:cat.0 Request processed in 135us (632us total) trans 8589935918 rc 0/0 00000100:00100000:2.0:1746065147.791657:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4895 00000100:00100000:2.0:1746065147.791675:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433984 00000100:00100000:2.0:1746065147.791678:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433984 00010000:00010000:2.0:1746065147.791689:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 38 pid: 11461 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746065147.791705:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5819 00000100:00100000:2.0:1746065147.791710:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263433984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.791717:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065147.791731:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 38 pid: 11461 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.791740:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 38 pid: 11461 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.791756:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc146ecfe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93324f expref: 38 pid: 11461 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746065147.791764:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.791795:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263433984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.791800:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5819 00000100:00100000:1.0:1746065147.791855:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.792097:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433856 00000100:00100000:0.0:1746065147.792101:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433856 00010000:00010000:0.0:1746065147.792114:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 26 pid: 1880 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746065147.792144:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5820 00000100:00100000:0.0:1746065147.792149:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263433856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065147.792157:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065147.792164:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 26 pid: 1880 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.792173:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 26 pid: 1880 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.792183:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc146ed67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933295 expref: 26 pid: 1880 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746065147.792192:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.792194:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065147.792199:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.792206:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065147.792227:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065147.792236:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263306880:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065147.792283:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065147.794686:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263306880:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065147.794703:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065147.794734:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263433856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2584us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.794742:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5820 00000100:00100000:0.0:1746065147.795587:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.795874:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434240 00000100:00100000:2.0:1746065147.795879:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434240 00002000:00100000:2.0:1746065147.795907:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3620864->3624959) req@ffff880092747b80 x1830881263434240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.795915:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747b80 with x1830881263434240 ext(3620864->3624959) 00002000:00010000:2.0:1746065147.795919:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092747b80 00000100:00100000:2.0:1746065147.795933:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3612 00000100:00100000:2.0:1746065147.795950:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263434240:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065147.796058:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263434240:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 109us (472us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065147.796064:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3612 00002000:00100000:2.0:1746065147.796068:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3620864->3624959) req@ffff880092747b80 x1830881263434240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.796075:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747b80 with x1830881263434240 ext(3620864->3624959) 00002000:00010000:2.0:1746065147.796078:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092747b80 00000100:00100000:0.0:1746065147.799579:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.799841:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434624 00000100:00100000:1.0:1746065147.799848:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434624 00000100:00100000:1.0:1746065147.799897:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13596 00000100:00100000:1.0:1746065147.799904:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+8:32112:x1830881263434624:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065147.799922:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.799937:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc146ed7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332a3 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.800003:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800013:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800021:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800030:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800038:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800043:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800115:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800122:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800127:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065147.800135:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065147.800189:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800194:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800198:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800203:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800207:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065147.800210:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800216:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800226:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065147.800229:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065147.800232:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800236:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc146ed83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800248:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800253:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800256:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800260:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065147.800262:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800266:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800271:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5d00) 00010000:00010000:1.0:1746065147.800273:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065147.800274:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800278:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146ed8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.800318:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc146ed7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.800329:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.800334:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.800336:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065147.800338:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:1.0:1746065147.800373:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+10:32112:x1830881263434624:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 470us (801us total) trans 8589935919 rc 0/0 00000100:00100000:1.0:1746065147.800379:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13596 00000100:00100000:0.0:1746065147.800618:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.800712:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434752 00000100:00100000:1.0:1746065147.800717:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434752 00002000:00100000:1.0:1746065147.800737:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3731456->3735551) req@ffff880092745180 x1830881263434752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.800745:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745180 with x1830881263434752 ext(3731456->3735551) 00002000:00010000:1.0:1746065147.800749:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092745180 00000100:00100000:2.0:1746065147.802921:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3613 00000100:00100000:2.0:1746065147.802935:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263434752:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065147.803084:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263434752:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 151us (2466us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065147.803089:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3613 00002000:00100000:2.0:1746065147.803095:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3731456->3735551) req@ffff880092745180 x1830881263434752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.803103:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745180 with x1830881263434752 ext(3731456->3735551) 00002000:00010000:2.0:1746065147.803107:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092745180 00000100:00100000:0.0:1746065147.804896:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263307008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065147.804937:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065147.805002:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307008 00000100:00100000:2.0:1746065147.805007:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307008 00000100:00100000:2.0:1746065147.805046:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1746065147.805051:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263307008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746065147.805064:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1205151168 pending 815104 free 3903262720 avail 3671740416 00000100:00100000:2.0:1746065147.805104:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263307008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.805109:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00080000:3.0:1746065147.805147:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065147.805175:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263307008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065147.806650:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.806693:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435008 00000100:00100000:1.0:1746065147.806698:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435008 00000100:00100000:2.0:1746065147.807180:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4896 00000100:00100000:2.0:1746065147.807187:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+28:32107:x1830881263435008:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065147.807465:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32107:x1830881263435008:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 275us (813us total) trans 8589935920 rc 0/0 00000100:00100000:2.0:1746065147.807473:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4896 00000100:00100000:0.0:1746065147.807605:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.807660:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435136 00000100:00100000:3.0:1746065147.807663:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435136 00000100:00100000:3.0:1746065147.807686:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13018 00000100:00100000:3.0:1746065147.807691:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+25:32112:x1830881263435136:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065147.807700:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.807713:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332aa expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.807735:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.807741:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065147.807743:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065147.807746:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2510848->2686975] (req 2510848->2686975) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.807790:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.807800:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 36 pid: 3068 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746065147.807901:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263307136:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065147.808035:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065147.809824:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263307136:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065147.809845:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2510848->2686975] (req 2510848->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.809858:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:3.0:1746065147.809896:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+26:32112:x1830881263435136:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2203us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065147.809903:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13018 00000100:00100000:0.0:1746065147.810486:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.810570:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435264 00000100:00100000:2.0:1746065147.810576:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435264 00002000:00100000:2.0:1746065147.810604:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3620864->3735551) req@ffff88009adf5500 x1830881263435264/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.810621:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5500 with x1830881263435264 ext(3620864->3735551) 00010000:00010000:2.0:1746065147.810626:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 37 pid: 3068 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.810636:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 37 pid: 3068 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746065147.810641:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adf5500 00000100:00100000:2.0:1746065147.810666:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1272 00000100:00100000:2.0:1746065147.810673:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263435264:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065147.812478:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263435264:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 1801us (1988us total) trans 17179873447 rc 0/0 00000100:00100000:0.0:1746065147.812486:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1272 00002000:00100000:0.0:1746065147.812493:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3620864->3735551) req@ffff88009adf5500 x1830881263435264/t17179873447(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/448 e 0 to 0 dl 1746065158 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.812501:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5500 with x1830881263435264 ext(3620864->3735551) 00010000:00010000:0.0:1746065147.812507:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 39 pid: 3068 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746065147.812517:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 39 pid: 3068 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746065147.812523:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adf5500 00000100:00100000:0.0:1746065147.813492:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.813528:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435392 00000100:00100000:2.0:1746065147.813534:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435392 00010000:00010000:2.0:1746065147.813553:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 39 pid: 3068 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746065147.813578:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5821 00000100:00100000:2.0:1746065147.813585:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263435392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065147.813594:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065147.813603:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065147 -> 1746065148 00002000:00010000:2.0:1746065147.813606:0:8352:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065147 -> 1746065148 00010000:00010000:2.0:1746065147.813610:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 39 pid: 3068 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.813617:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 39 pid: 3068 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.813634:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc146ed75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->3735551) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93329c expref: 39 pid: 3068 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746065147.813656:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.813658:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065147.813671:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.813679:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065147.813705:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065147.813714:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263307264:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065147.813790:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.815328:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.815478:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263307264:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065147.815486:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435648 00000100:00100000:1.0:1746065147.815490:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435648 00010000:00010000:2.0:1746065147.815491:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065147.815516:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2510848->2514943) req@ffff88009adf7800 x1830881263435648/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.815525:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7800 with x1830881263435648 ext(2510848->2514943) 00000100:00100000:2.0:1746065147.815527:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881263435392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1942us (2036us total) trans 0 rc 0/0 00002000:00010000:1.0:1746065147.815528:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7800 00000100:00100000:2.0:1746065147.815534:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5821 00000100:00100000:1.0:1746065147.815541:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3614 00000100:00100000:1.0:1746065147.815546:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263435648:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065147.815630:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263435648:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 84us (305us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065147.815636:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3614 00002000:00100000:1.0:1746065147.815639:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2510848->2514943) req@ffff88009adf7800 x1830881263435648/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.815646:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7800 with x1830881263435648 ext(2510848->2514943) 00002000:00010000:1.0:1746065147.815649:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7800 00000100:00100000:0.0:1746065147.818335:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.818397:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435904 00000100:00100000:1.0:1746065147.818403:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435904 00002000:00100000:1.0:1746065147.818429:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2682880->2686975) req@ffff88009adf7100 x1830881263435904/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.818436:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7100 with x1830881263435904 ext(2682880->2686975) 00002000:00010000:1.0:1746065147.818440:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7100 00000100:00100000:1.0:1746065147.818467:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3615 00000100:00100000:1.0:1746065147.818473:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881263435904:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065147.818577:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881263435904:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 103us (247us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065147.818583:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3615 00002000:00100000:1.0:1746065147.818587:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2682880->2686975) req@ffff88009adf7100 x1830881263435904/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.818594:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7100 with x1830881263435904 ext(2682880->2686975) 00002000:00010000:1.0:1746065147.818597:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7100 00000100:00100000:0.0:1746065147.821024:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.821203:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436160 00000100:00100000:2.0:1746065147.821209:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436160 00000100:00100000:1.0:1746065147.821286:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4897 00000100:00100000:1.0:1746065147.821295:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+10:32112:x1830881263436160:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065147.821887:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+11:32112:x1830881263436160:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 591us (866us total) trans 8589935921 rc 0/0 00000100:00100000:1.0:1746065147.822091:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4897 00010000:00010000:2.0:1746065147.902294:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065147.906248:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.906336:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436416 00000100:00100000:3.0:1746065147.906345:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436416 00000100:00100000:3.0:1746065147.906427:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13597 00000100:00100000:3.0:1746065147.906435:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+29:32118:x1830881263436416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.906456:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.906472:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61a00/0xad6b7ddc146eda6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332b1 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.906537:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906547:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906555:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906565:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906570:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906574:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906652:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906659:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906664:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065147.906672:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065147.906725:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906730:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906738:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906742:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065147.906745:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906751:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.906760:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065147.906762:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065147.907114:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907120:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc146edad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907689:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907696:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907701:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907704:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065147.907707:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907711:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907722:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a200) 00010000:00010000:3.0:1746065147.907724:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065147.907726:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907730:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc146edb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.907763:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61a00/0xad6b7ddc146eda6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.907789:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 31 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.907795:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.907797:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065147.907799:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60c00, rc 0) 00000100:00100000:3.0:1746065147.908653:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+31:32118:x1830881263436416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2217us (2411us total) trans 8589935922 rc 0/0 00000100:00100000:3.0:1746065147.908660:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13597 00000100:00100000:0.0:1746065147.913347:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.913435:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436672 00000100:00100000:1.0:1746065147.913443:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436672 00000100:00100000:1.0:1746065147.913493:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4898 00000100:00100000:1.0:1746065147.913500:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:32118:x1830881263436672:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065147.913659:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+32:32118:x1830881263436672:12345-192.168.202.27@tcp:35:cat.0 Request processed in 159us (320us total) trans 8589935923 rc 0/0 00000100:00100000:1.0:1746065147.913667:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4898 00000100:00100000:0.0:1746065147.921344:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.921408:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436800 00000100:00100000:3.0:1746065147.921415:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436800 00000100:00100000:3.0:1746065147.921466:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13019 00000100:00100000:3.0:1746065147.921474:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263436800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.921491:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.921506:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc146edc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332b8 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065147.921555:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263307392:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065147.923337:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846000 going to sleep for 11 seconds 00002000:00010000:3.0:1746065147.929535:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065147 -> 1746065148 00000100:00100000:3.0:1746065147.929558:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263307392:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065147.929586:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc146edc9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b8 expref: 39 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.929601:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc146edc9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b8 expref: 39 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065147.934104:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60800, rc 0) 00000100:00100000:3.0:1746065147.934189:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263436800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12703us (12840us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065147.934198:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13019 00000100:00100000:1.0:1746065147.938144:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065147.938495:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437056 00000100:00100000:3.0:1746065147.938503:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437056 00000100:00100000:3.0:1746065147.938540:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13598 00000100:00100000:3.0:1746065147.938546:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+11:32121:x1830881263437056:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065147.938566:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065147.938585:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146edd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332bf expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.938667:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.938682:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065147.938691:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065147.938700:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065147.938792:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc146edd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.938805:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 13 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065147.938811:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065147.938813:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065147.938815:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60000, rc 0) 00000100:00100000:3.0:1746065147.938855:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+13:32121:x1830881263437056:12345-192.168.202.27@tcp:101:cat.0 Request processed in 309us (719us total) trans 8589935924 rc 0/0 00000100:00100000:3.0:1746065147.938861:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13598 00000100:00100000:0.0:1746065147.950272:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.951943:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437312 00000100:00100000:1.0:1746065147.951953:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437312 00000100:00100000:1.0:1746065147.952018:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13599 00000100:00100000:1.0:1746065147.952025:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+13:32123:x1830881263437312:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065147.952046:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065147.952066:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc146ede5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332c6 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.952144:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.952154:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.952161:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 31 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.952167:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.952190:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 31 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.952200:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 31 pid: 13395 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.952210:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263307520:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065147.953326:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.953334:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 14 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.953342:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263307648:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.957298:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065147.958856:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065147.960843:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437568 00000100:00100000:2.0:1746065147.960852:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437568 00002000:00100000:2.0:1746065147.960891:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009adf5880 x1830881263437568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065147.960900:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5880 with x1830881263437568 ext(0->1048575) 00002000:00010000:2.0:1746065147.960905:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf5880 00000100:00100000:2.0:1746065147.960933:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3616 00000100:00100000:2.0:1746065147.960940:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263437568:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.964222:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.965257:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.965273:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.965290:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437824 00000100:00100000:0.0:1746065147.965297:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437824 00002000:00100000:0.0:1746065147.965336:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009adf4000 x1830881263437824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.965346:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4000 with x1830881263437824 ext(1048576->2097151) 00002000:00010000:0.0:1746065147.965353:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4000 00000100:00100000:0.0:1746065147.966637:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438080 00000100:00100000:0.0:1746065147.966644:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438080 00002000:00100000:0.0:1746065147.966666:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009adf4a80 x1830881263438080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.966674:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4a80 with x1830881263438080 ext(1048576->2097151) 00002000:00010000:0.0:1746065147.966678:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4a80 00000100:00100000:1.0:1746065147.966710:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438336 00000100:00100000:1.0:1746065147.966714:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438336 00000100:00100000:1.0:1746065147.966727:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3617 00000100:00100000:1.0:1746065147.966735:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263437824:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:1.0:1746065147.967309:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009adf6300 x1830881263438336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.967317:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6300 with x1830881263438336 ext(1048576->2097151) 00002000:00010000:1.0:1746065147.967321:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf6300 00000100:00100000:1.0:1746065147.967337:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3618 00000100:00100000:1.0:1746065147.967343:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263438080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065147.967841:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3619 00000100:00100000:1.0:1746065147.967847:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263438336:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065147.968400:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263307520:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065147.969007:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.969573:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263307648:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065147.969591:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065147.970199:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065147.970232:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438464 00000100:00100000:1.0:1746065147.970237:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438464 00010000:00010000:1.0:1746065147.970258:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 32 pid: 13395 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.970278:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438592 00000100:00100000:1.0:1746065147.970280:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438592 00010000:00010000:1.0:1746065147.970288:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 15 pid: 7203 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746065147.970308:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5822 00000100:00100000:1.0:1746065147.970314:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263438464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065147.970324:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065147.970328:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 32 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.970337:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 32 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.970354:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc146edbb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332b1 expref: 32 pid: 13395 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.970376:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.970380:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.970386:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.970390:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065147.970415:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263438464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.970420:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5822 00000100:00100000:1.0:1746065147.970433:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5823 00000100:00100000:1.0:1746065147.970437:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263438592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065147.970443:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065147.970446:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 15 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.970453:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 15 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.970461:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc146ed91 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332a3 expref: 15 pid: 7203 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746065147.970467:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.970470:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.970475:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.970481:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.970495:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065147.970508:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263438592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065147.970512:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5823 00010000:00010000:1.0:1746065147.970526:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065147.970531:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065147.970544:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065147.970645:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc146ede5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 15 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.970656:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065147.970661:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065147.970663:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065147.970666:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:1.0:1746065147.970685:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+14:32123:x1830881263437312:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 18661us (20421us total) trans 8589935925 rc 0/0 00000100:00100000:1.0:1746065147.970691:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13599 00000100:00100000:0.0:1746065147.974737:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.974754:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438848 00000100:00100000:0.0:1746065147.974762:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438848 00002000:00100000:0.0:1746065147.974822:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009adf4380 x1830881263438848/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.974830:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4380 with x1830881263438848 ext(0->1048575) 00002000:00010000:0.0:1746065147.974835:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf4380 00000100:00100000:0.0:1746065147.974856:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3620 00000100:00100000:0.0:1746065147.974863:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263438848:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.975438:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.975449:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439104 00000100:00100000:0.0:1746065147.975452:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439104 00002000:00100000:0.0:1746065147.975466:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009adf4700 x1830881263439104/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065147.975473:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4700 with x1830881263439104 ext(1048576->2097151) 00002000:00010000:0.0:1746065147.975477:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4700 00000100:00100000:0.0:1746065147.975499:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3621 00000100:00100000:0.0:1746065147.975504:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263439104:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.976034:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.976064:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.976078:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439360 00000100:00100000:0.0:1746065147.976081:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439360 00000100:00100000:3.0:1746065147.976134:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439616 00000100:00100000:3.0:1746065147.976137:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439616 00002000:00100000:3.0:1746065147.976152:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009834ea00 x1830881263439616/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.976159:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ea00 with x1830881263439616 ext(1048576->2097151) 00002000:00010000:3.0:1746065147.976162:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834ea00 00000100:00100000:3.0:1746065147.976173:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3622 00000100:00100000:3.0:1746065147.976177:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263439616:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:1.0:1746065147.978990:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009834f480 x1830881263439360/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/0 e 0 to 0 dl 1746065158 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.979002:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f480 with x1830881263439360 ext(1048576->2097151) 00002000:00010000:1.0:1746065147.979007:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834f480 00000100:00100000:1.0:1746065147.979039:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3623 00000100:00100000:1.0:1746065147.979048:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263439360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065147.981045:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.984644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.984671:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.984699:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.984714:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.984725:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.984747:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065147.984764:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440384 00000100:00100000:0.0:1746065147.984770:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440384 00000100:00100000:0.0:1746065147.984817:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440512 00000100:00100000:0.0:1746065147.984819:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440512 00000100:00100000:0.0:1746065147.984834:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 625 00000100:00100000:0.0:1746065147.984840:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263440384:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065147.984894:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263440384:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.984901:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 625 00000100:00100000:0.0:1746065147.984915:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 626 00000100:00100000:0.0:1746065147.984919:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263440512:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065147.984936:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263440512:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 17us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.984940:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 626 00000100:00100000:0.0:1746065147.985041:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439872 00000100:00100000:0.0:1746065147.985043:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439872 00000100:00100000:0.0:1746065147.985066:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440128 00000100:00100000:0.0:1746065147.985068:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440128 00000100:00100000:0.0:1746065147.985078:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440000 00000100:00100000:0.0:1746065147.985080:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440000 00000100:00100000:0.0:1746065147.985088:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440256 00000100:00100000:0.0:1746065147.985090:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440256 00000100:00100000:0.0:1746065147.985100:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1004 00000100:00100000:0.0:1746065147.985105:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881263439872:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065147.985133:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:2004:x1830881263439872:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.985138:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1004 00000100:00100000:0.0:1746065147.985147:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1005 00000100:00100000:0.0:1746065147.985151:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2004:x1830881263440128:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065147.985172:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2004:x1830881263440128:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 20us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.985177:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1005 00000100:00100000:0.0:1746065147.985184:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1006 00000100:00100000:0.0:1746065147.985188:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263440000:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065147.985201:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263440000:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 13us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.985205:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1006 00000100:00100000:0.0:1746065147.985211:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1007 00000100:00100000:0.0:1746065147.985214:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881263440256:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065147.985223:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881263440256:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 9us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065147.985227:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1007 00000100:00080000:0.0:1746065147.985276:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065147.985491:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439744 00000100:00100000:2.0:1746065147.985496:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439744 00000100:00100000:2.0:1746065147.985518:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 186 00000100:00100000:2.0:1746065147.985523:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881263439744:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1746065147.985557:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881263439744:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 33us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065147.985562:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 186 00000100:00100000:3.0:1746065147.991181:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263437568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30233us (32321us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065147.991190:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3616 00002000:00100000:3.0:1746065147.991199:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009adf5880 x1830881263437568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065147.991208:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5880 with x1830881263437568 ext(0->1048575) 00002000:00010000:3.0:1746065147.991213:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf5880 00000100:00100000:1.0:1746065147.999170:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263437824:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32427us (34947us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065147.999181:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3617 00002000:00100000:1.0:1746065147.999191:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009adf4000 x1830881263437824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065147.999200:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4000 with x1830881263437824 ext(1048576->2097151) 00002000:00010000:1.0:1746065147.999205:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4000 00000100:00100000:1.0:1746065148.014953:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263438080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 47600us (49689us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065148.014975:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3618 00002000:00100000:1.0:1746065148.014985:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009adf4a80 x1830881263438080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.014993:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4a80 with x1830881263438080 ext(1048576->2097151) 00002000:00010000:1.0:1746065148.014999:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4a80 00000100:00100000:1.0:1746065148.029353:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263438336:12345-192.168.202.27@tcp:3:cat.0 Request processed in 61497us (64070us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065148.029362:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3619 00002000:00100000:1.0:1746065148.029371:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009adf6300 x1830881263438336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.029380:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6300 with x1830881263438336 ext(1048576->2097151) 00002000:00010000:1.0:1746065148.029385:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf6300 00000100:00100000:0.0:1746065148.043868:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.044123:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440768 00000100:00100000:1.0:1746065148.044131:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440768 00002000:00100000:1.0:1746065148.044166:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88009834f800 x1830881263440768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.044174:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f800 with x1830881263440768 ext(2097152->3145727) 00002000:00010000:1.0:1746065148.044179:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834f800 00000100:00100000:1.0:1746065148.044211:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3624 00000100:00100000:1.0:1746065148.044217:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263440768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065148.047418:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.047724:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263438848:12345-192.168.202.27@tcp:3:cat.0 Request processed in 72857us (72989us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065148.047733:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3620 00002000:00100000:1.0:1746065148.047745:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009adf4380 x1830881263438848/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.047753:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4380 with x1830881263438848 ext(0->1048575) 00002000:00010000:1.0:1746065148.047758:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf4380 00000100:00100000:1.0:1746065148.047867:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263439104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 72361us (72428us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065148.047876:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3621 00002000:00100000:1.0:1746065148.047883:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009adf4700 x1830881263439104/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.047889:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4700 with x1830881263439104 ext(1048576->2097151) 00002000:00010000:1.0:1746065148.047893:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4700 00000100:00100000:3.0:1746065148.050992:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441024 00000100:00100000:3.0:1746065148.051001:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441024 00000100:00100000:3.0:1746065148.051053:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13600 00000100:00100000:3.0:1746065148.051060:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+31:32125:x1830881263441024:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065148.051080:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.051095:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146edfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332cd expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.051155:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051166:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051175:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051187:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051192:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051200:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051267:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051273:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051278:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065148.051284:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065148.051331:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051337:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051342:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051346:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065148.051348:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051353:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051360:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065148.051362:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065148.051365:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051372:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146ee01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051396:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051400:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051404:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051408:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065148.051410:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051414:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051420:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a000) 00010000:00010000:3.0:1746065148.051422:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065148.051424:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051428:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc146ee08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.051457:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146edfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 34 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.051466:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 33 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.051476:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065148.051478:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065148.051480:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c285e00, rc 0) 00000100:00100000:3.0:1746065148.051519:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+33:32125:x1830881263441024:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 459us (4109us total) trans 8589935926 rc 0/0 00000100:00100000:3.0:1746065148.051524:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13600 00000100:00100000:3.0:1746065148.063218:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263439616:12345-192.168.202.27@tcp:3:cat.0 Request processed in 87030us (87144us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065148.063230:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3622 00002000:00100000:3.0:1746065148.063238:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009834ea00 x1830881263439616/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.063247:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ea00 with x1830881263439616 ext(1048576->2097151) 00002000:00010000:3.0:1746065148.063252:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834ea00 00000100:00100000:1.0:1746065148.073102:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263439360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 94048us (97060us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065148.073112:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3623 00002000:00100000:1.0:1746065148.073121:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009834f480 x1830881263439360/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:63/0 lens 488/440 e 0 to 0 dl 1746065158 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.073129:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f480 with x1830881263439360 ext(1048576->2097151) 00002000:00010000:1.0:1746065148.073134:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834f480 00000100:00100000:0.0:1746065148.080284:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.080343:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441152 00000100:00100000:1.0:1746065148.080352:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441152 00000100:00100000:1.0:1746065148.080401:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13020 00000100:00100000:1.0:1746065148.080408:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:32123:x1830881263441152:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065148.080424:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065148.080440:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332d4 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.080464:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.080471:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.080478:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.080479:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.080482:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3280896->3825663] (req 3280896->3825663) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.080505:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.080514:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 26 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.080524:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263307776:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065148.080606:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.080613:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.080620:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263307904:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065148.080636:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065148.086210:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263307776:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065148.086221:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263307904:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065148.086248:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3280896->3825663] (req 3280896->3825663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.086266:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97e00, rc 0) 00000100:00100000:2.0:1746065148.086290:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263440768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 42074us (42429us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065148.086290:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+11:32123:x1830881263441152:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5881us (6013us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.086298:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3624 00000100:00100000:1.0:1746065148.086298:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13020 00002000:00100000:2.0:1746065148.086307:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88009834f800 x1830881263440768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.086314:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f800 with x1830881263440768 ext(2097152->3145727) 00010000:00010000:2.0:1746065148.086320:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 25 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.086330:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 25 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746065148.086340:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009834f800 00000100:00100000:0.0:1746065148.089867:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.089903:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.089936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.089964:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441536 00000100:00100000:2.0:1746065148.089972:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441536 00000100:00100000:0.0:1746065148.089972:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441792 00000100:00100000:0.0:1746065148.089974:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441792 00002000:00100000:2.0:1746065148.090007:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff8800a4e53480 x1830881263441536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.090007:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff8800a4e53b80 x1830881263441792/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 504/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.090015:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53480 with x1830881263441536 ext(2097152->4194303) 00002000:00100000:0.0:1746065148.090015:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53b80 with x1830881263441792 ext(2097152->4194303) 00002000:00010000:0.0:1746065148.090020:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e53b80 00010000:00010000:2.0:1746065148.090024:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.090034:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746065148.090039:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e53480 00000100:00100000:0.0:1746065148.090047:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1273 00000100:00100000:2.0:1746065148.090050:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3625 00000100:00100000:0.0:1746065148.090053:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263441536:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065148.090054:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263441792:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065148.101475:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441280 00000100:00100000:3.0:1746065148.101486:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441280 00000100:00100000:3.0:1746065148.101527:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13021 00000100:00100000:3.0:1746065148.101536:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+38:32118:x1830881263441280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065148.101550:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.101566:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332db expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.101590:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.101600:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065148.101601:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065148.101604:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 39 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.101628:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.101638:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 27 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.101649:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263308032:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065148.104016:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.110578:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.110823:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442048 00000100:00100000:3.0:1746065148.110831:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442048 00000100:00100000:3.0:1746065148.110869:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13022 00000100:00100000:3.0:1746065148.110876:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:32125:x1830881263442048:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065148.110895:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.110910:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332e2 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.110932:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065148.110934:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065148.110938:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3993600->4005887] (req 3993600->4005887) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.110952:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3993600->4005887] (req 3993600->4005887) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.110978:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1000, rc 0) 00000100:00100000:3.0:1746065148.111021:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:32125:x1830881263442048:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 144us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.111027:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13022 00000100:00100000:2.0:1746065148.111894:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.111970:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441920 00000100:00100000:1.0:1746065148.111974:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441920 00010000:00010000:1.0:1746065148.111995:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 25 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.112013:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5824 00000100:00100000:1.0:1746065148.112018:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263441920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.112026:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.112042:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 25 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.112050:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 25 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.112070:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc146ecdb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93322c expref: 25 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.112084:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.112101:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881263441920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.112107:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5824 00000100:00100000:3.0:1746065148.113891:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263308032:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065148.113914:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 40 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.113927:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0600, rc 0) 00000100:00100000:3.0:1746065148.113966:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+40:32118:x1830881263441280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12421us (24096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.113973:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13021 00000100:00100000:0.0:1746065148.115586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.115652:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442176 00000100:00100000:3.0:1746065148.115658:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442176 00002000:00100000:3.0:1746065148.115693:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2510848->2686975) req@ffff8800a4e52300 x1830881263442176/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.115702:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52300 with x1830881263442176 ext(2510848->2686975) 00010000:00010000:3.0:1746065148.115709:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 28 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.115718:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 28 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.115725:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4e52300 00000100:00100000:3.0:1746065148.115747:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1274 00000100:00100000:3.0:1746065148.115752:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263442176:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065148.121435:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+30:2005:x1830881263441792:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 31370us (31489us total) trans 0 rc 1921024/1921024 00000100:00100000:3.0:1746065148.121446:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3625 00002000:00100000:3.0:1746065148.121457:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff8800a4e53b80 x1830881263441792/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 504/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1921024/1921024 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.121466:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53b80 with x1830881263441792 ext(2097152->4194303) 00010000:00010000:3.0:1746065148.121475:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 30 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.121487:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 30 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.121493:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4e53b80 00000100:00100000:2.0:1746065148.123226:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263442176:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7468us (7639us total) trans 17179873448 rc 0/0 00000100:00100000:2.0:1746065148.123236:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1274 00002000:00100000:2.0:1746065148.123242:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2510848->2686975) req@ffff8800a4e52300 x1830881263442176/t17179873448(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/448 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.123250:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52300 with x1830881263442176 ext(2510848->2686975) 00010000:00010000:2.0:1746065148.123258:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 28 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.123266:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 28 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746065148.123272:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4e52300 00000001:00080000:0.0:1746065148.128570:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873448 is committed 00000001:00080000:0.0:1746065148.128583:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873447 is committed 00000001:00080000:0.0:1746065148.128588:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873446 is committed 00000001:00080000:0.0:1746065148.128639:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873410 is committed 00000100:00100000:0.0:1746065148.136029:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.136170:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442304 00000100:00100000:1.0:1746065148.136179:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442304 00010000:00010000:1.0:1746065148.136208:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 8 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.136598:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5825 00000100:00100000:1.0:1746065148.136606:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263442304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.136619:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.136639:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 8 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.136650:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 8 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.136669:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146ed9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2510848->2686975) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332aa expref: 8 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.136685:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.136687:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.136693:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.136699:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.136706:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.136707:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.136710:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.136727:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.137639:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.137654:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263308160:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065148.137734:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.137742:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263308288:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065148.137758:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065148.138296:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263441536:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 48240us (48389us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065148.138304:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1273 00002000:00100000:0.0:1746065148.138311:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff8800a4e53480 x1830881263441536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.138318:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53480 with x1830881263441536 ext(2097152->4194303) 00010000:00010000:0.0:1746065148.138325:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746065148.138335:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746065148.138341:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e53480 00000100:00100000:1.0:1746065148.147181:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263308160:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065148.147193:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263308288:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065148.147211:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.147535:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263442304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10928us (11511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.147546:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5825 00000100:00100000:0.0:1746065148.147565:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.147586:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442688 00000100:00100000:0.0:1746065148.147591:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442688 00002000:00100000:0.0:1746065148.147624:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800a4e51f80 x1830881263442688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.147633:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51f80 with x1830881263442688 ext(2097152->3145727) 00002000:00010000:0.0:1746065148.147636:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e51f80 00000100:00100000:0.0:1746065148.147664:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3626 00000100:00100000:0.0:1746065148.147670:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263442688:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065148.147875:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.151048:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442560 00000100:00100000:2.0:1746065148.151058:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442560 00002000:00100000:2.0:1746065148.151095:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3993600->3997695) req@ffff88009a6dc000 x1830881263442560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.151104:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881263442560 ext(3993600->3997695) 00002000:00010000:2.0:1746065148.151109:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:2.0:1746065148.151128:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3627 00000100:00100000:2.0:1746065148.151134:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263442560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065148.151262:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263442560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 127us (3386us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065148.151268:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3627 00002000:00100000:2.0:1746065148.151273:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3993600->3997695) req@ffff88009a6dc000 x1830881263442560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.151279:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881263442560 ext(3993600->3997695) 00002000:00010000:2.0:1746065148.151282:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:0.0:1746065148.154585:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.156535:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442944 00000100:00100000:3.0:1746065148.156545:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442944 00000100:00100000:3.0:1746065148.156593:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13023 00000100:00100000:3.0:1746065148.156599:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:32121:x1830881263442944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065148.156614:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.156628:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332e9 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.156649:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.156650:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.156656:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.156667:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.156675:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:3.0:1746065148.156728:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:32121:x1830881263442944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 129us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.156734:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13023 00000100:00100000:2.0:1746065148.159051:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263442688:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11375us (11480us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065148.159061:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3626 00002000:00100000:2.0:1746065148.159071:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800a4e51f80 x1830881263442688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.159079:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51f80 with x1830881263442688 ext(2097152->3145727) 00002000:00010000:2.0:1746065148.159084:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e51f80 00000100:00100000:0.0:1746065148.165445:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.165506:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443072 00000100:00100000:1.0:1746065148.165515:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443072 00010000:00010000:1.0:1746065148.165543:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.165581:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5826 00000100:00100000:1.0:1746065148.165589:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263443072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.165600:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.165618:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.165628:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.165646:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc146ecd4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933225 expref: 11 pid: 10219 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.165672:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.165674:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.165680:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.165687:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.165714:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.165724:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263308416:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065148.166894:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.170441:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.170487:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.170546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.170832:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443328 00000100:00100000:0.0:1746065148.170851:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443328 00000100:00100000:1.0:1746065148.170951:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443712 00000100:00100000:1.0:1746065148.170963:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443712 00000100:00100000:1.0:1746065148.171018:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13024 00000100:00100000:1.0:1746065148.171026:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+24:32118:x1830881263443712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065148.171044:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065148.171064:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332f0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.171087:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.171093:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065148.171094:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065148.171097:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065148.171103:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880099e13800 x1830881263443328/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.171111:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13800 with x1830881263443328 ext(2097152->3145727) 00002000:00010000:0.0:1746065148.171115:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e13800 00000100:00100000:0.0:1746065148.171125:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443584 00000100:00100000:0.0:1746065148.171128:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443584 00000100:00100000:3.0:1746065148.171129:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3628 00000100:00100000:3.0:1746065148.171135:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263443328:12345-192.168.202.27@tcp:3:multiop.0 00002000:00100000:0.0:1746065148.171139:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (4001792->4005887) req@ffff880099e11180 x1830881263443584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.171145:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11180 with x1830881263443584 ext(4001792->4005887) 00002000:00010000:0.0:1746065148.171147:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e11180 00000100:00100000:0.0:1746065148.171156:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3629 00000100:00100000:0.0:1746065148.171160:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263443584:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.171256:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263443584:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 94us (769us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065148.171262:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3629 00002000:00100000:0.0:1746065148.171267:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (4001792->4005887) req@ffff880099e11180 x1830881263443584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.171272:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11180 with x1830881263443584 ext(4001792->4005887) 00002000:00010000:0.0:1746065148.171275:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e11180 00010000:00010000:1.0:1746065148.172630:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.172643:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.172655:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263308544:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065148.172713:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065148.176677:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.176814:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263308416:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065148.176833:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.176884:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263443072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11294us (11445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.176894:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5826 00000100:00100000:2.0:1746065148.176978:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443968 00000100:00100000:2.0:1746065148.176984:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443968 00002000:00100000:2.0:1746065148.177015:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3280896->3284991) req@ffff8800a4e50a80 x1830881263443968/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.177025:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50a80 with x1830881263443968 ext(3280896->3284991) 00010000:00010000:2.0:1746065148.177032:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.177043:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746065148.177048:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e50a80 00000100:00100000:2.0:1746065148.177068:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1275 00000100:00100000:2.0:1746065148.177074:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263443968:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065148.177171:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263443968:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 96us (501us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065148.177176:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1275 00002000:00100000:2.0:1746065148.177181:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3280896->3284991) req@ffff8800a4e50a80 x1830881263443968/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.177188:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50a80 with x1830881263443968 ext(3280896->3284991) 00010000:00010000:2.0:1746065148.177192:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.177200:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746065148.177205:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e50a80 00000100:00100000:0.0:1746065148.181823:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.181882:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444224 00000100:00100000:2.0:1746065148.181889:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444224 00000100:00100000:2.0:1746065148.181936:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4899 00000100:00100000:2.0:1746065148.181943:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32125:x1830881263444224:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065148.182397:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+34:32125:x1830881263444224:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 452us (579us total) trans 8589935927 rc 0/0 00000100:00100000:2.0:1746065148.182403:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4899 00000100:00100000:1.0:1746065148.182582:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263308544:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065148.182604:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.182617:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00000100:00100000:1.0:1746065148.182639:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+25:32118:x1830881263443712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11615us (12093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.182645:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13024 00000100:00100000:3.0:1746065148.185198:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263443328:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 14055us (14757us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065148.185206:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3628 00002000:00100000:3.0:1746065148.185215:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880099e13800 x1830881263443328/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.185224:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13800 with x1830881263443328 ext(2097152->3145727) 00002000:00010000:3.0:1746065148.185229:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e13800 00000100:00100000:0.0:1746065148.191080:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.191142:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444480 00000100:00100000:3.0:1746065148.191151:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444480 00002000:00100000:3.0:1746065148.191193:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3821568->3825663) req@ffff8800a4e52680 x1830881263444480/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.191207:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52680 with x1830881263444480 ext(3821568->3825663) 00010000:00010000:3.0:1746065148.191215:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.191227:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.191233:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e52680 00000100:00100000:3.0:1746065148.191263:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1276 00000100:00100000:3.0:1746065148.191270:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263444480:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065148.191390:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263444480:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 120us (317us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065148.191395:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1276 00002000:00100000:3.0:1746065148.191401:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3821568->3825663) req@ffff8800a4e52680 x1830881263444480/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.191407:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52680 with x1830881263444480 ext(3821568->3825663) 00010000:00010000:3.0:1746065148.191411:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.191419:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.191423:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e52680 00000100:00100000:0.0:1746065148.199271:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.199882:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444736 00000100:00100000:2.0:1746065148.199890:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444736 00002000:00100000:2.0:1746065148.199929:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->3280895) req@ffff8800a4e51500 x1830881263444736/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.199938:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51500 with x1830881263444736 ext(3145728->3280895) 00010000:00010000:2.0:1746065148.199946:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.199968:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746065148.199979:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e51500 00000100:00100000:2.0:1746065148.200751:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1277 00000100:00100000:2.0:1746065148.200760:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263444736:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.201793:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.201824:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445120 00000100:00100000:0.0:1746065148.201828:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445120 00002000:00100000:0.0:1746065148.201852:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3280896->3825663) req@ffff8800a4e53800 x1830881263445120/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.201861:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53800 with x1830881263445120 ext(3280896->3825663) 00010000:00010000:0.0:1746065148.201868:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 12 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746065148.201879:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 12 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746065148.201886:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e53800 00000100:00100000:0.0:1746065148.202108:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1278 00000100:00100000:0.0:1746065148.202114:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263445120:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065148.205641:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.205698:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445248 00000100:00100000:3.0:1746065148.205706:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445248 00002000:00100000:3.0:1746065148.205741:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3825664->4194303) req@ffff8800a4e52a00 x1830881263445248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.205749:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52a00 with x1830881263445248 ext(3825664->4194303) 00010000:00010000:3.0:1746065148.205756:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 14 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.205767:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 14 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.205804:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e52a00 00000100:00100000:3.0:1746065148.205829:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1279 00000100:00100000:3.0:1746065148.205836:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263445248:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065148.208497:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.209600:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445376 00000100:00100000:1.0:1746065148.209609:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445376 00000100:00100000:1.0:1746065148.209648:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13025 00000100:00100000:1.0:1746065148.209656:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+16:32121:x1830881263445376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065148.209671:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065148.209686:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332f7 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.209708:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065148.209713:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.209723:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.209731:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72600, rc 0) 00000100:00100000:1.0:1746065148.209769:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+17:32121:x1830881263445376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 113us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.209795:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13025 00000100:00100000:2.0:1746065148.210000:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263444736:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9241us (10736us total) trans 0 rc 135168/135168 00000100:00100000:2.0:1746065148.210007:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1277 00002000:00100000:2.0:1746065148.210014:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->3280895) req@ffff8800a4e51500 x1830881263444736/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 135168/135168 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.210022:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51500 with x1830881263444736 ext(3145728->3280895) 00010000:00010000:2.0:1746065148.210028:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 15 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.210038:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 15 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746065148.210043:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e51500 00000100:00100000:3.0:1746065148.211836:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263445248:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 5994us (6194us total) trans 0 rc 368640/368640 00000100:00100000:3.0:1746065148.211845:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1279 00002000:00100000:3.0:1746065148.211852:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3825664->4194303) req@ffff8800a4e52a00 x1830881263445248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 368640/368640 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.211860:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52a00 with x1830881263445248 ext(3825664->4194303) 00010000:00010000:3.0:1746065148.211868:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 13 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.211879:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 13 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.211888:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e52a00 00000100:00100000:1.0:1746065148.213802:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881263445120:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11682us (12005us total) trans 21474840896 rc 0/0 00000100:00100000:1.0:1746065148.213811:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1278 00002000:00100000:1.0:1746065148.213818:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3280896->3825663) req@ffff8800a4e53800 x1830881263445120/t21474840896(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/448 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.213826:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53800 with x1830881263445120 ext(3280896->3825663) 00010000:00010000:1.0:1746065148.213833:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 13 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.213843:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 13 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746065148.213848:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e53800 00000100:00100000:0.0:1746065148.216475:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.216543:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445504 00000100:00100000:1.0:1746065148.216551:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445504 00010000:00010000:1.0:1746065148.216582:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 13 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.217189:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5827 00000100:00100000:1.0:1746065148.217197:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263445504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.217208:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065148.217222:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065147 -> 1746065148 00002000:00010000:1.0:1746065148.217224:0:8352:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065147 -> 1746065148 00010000:00010000:1.0:1746065148.217229:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 13 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.217239:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 13 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.217258:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146ee1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3280896->3825663) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332d4 expref: 13 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.217276:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.217278:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.217284:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.217291:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.217297:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.217298:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.217301:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 12 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.217307:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 12 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.217329:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 12 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.217338:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263308672:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065148.217646:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.217658:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263308800:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065148.217677:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065148.222622:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263308672:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065148.222632:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263308800:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065148.222647:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.223409:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263445504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6211us (6938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.223418:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5827 00000100:00100000:0.0:1746065148.224036:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.224086:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446016 00000100:00100000:1.0:1746065148.224091:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446016 00002000:00100000:1.0:1746065148.224117:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800a4e50000 x1830881263446016/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.224126:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50000 with x1830881263446016 ext(3145728->4194303) 00002000:00010000:1.0:1746065148.224130:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e50000 00000100:00100000:1.0:1746065148.224648:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3630 00000100:00100000:1.0:1746065148.224657:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263446016:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.225803:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.226448:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445760 00000100:00100000:3.0:1746065148.226454:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445760 00002000:00100000:3.0:1746065148.226483:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800a4e51c00 x1830881263445760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.226491:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51c00 with x1830881263445760 ext(3145728->4194303) 00002000:00010000:3.0:1746065148.226494:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e51c00 00000100:00100000:3.0:1746065148.226520:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3631 00000100:00100000:3.0:1746065148.226528:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263445760:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065148.235265:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263446016:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10600us (11220us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065148.235275:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3630 00002000:00100000:1.0:1746065148.235285:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800a4e50000 x1830881263446016/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.235294:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50000 with x1830881263446016 ext(3145728->4194303) 00002000:00010000:1.0:1746065148.235311:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e50000 00000100:00100000:3.0:1746065148.239790:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263445760:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13241us (13966us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065148.239800:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3631 00002000:00100000:3.0:1746065148.239809:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800a4e51c00 x1830881263445760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065148.240342:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.240423:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446144 00000100:00100000:2.0:1746065148.240429:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446144 00002000:00100000:3.0:1746065148.240431:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51c00 with x1830881263445760 ext(3145728->4194303) 00002000:00010000:3.0:1746065148.240435:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e51c00 00000100:00100000:2.0:1746065148.240458:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13026 00000100:00100000:2.0:1746065148.240465:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:32121:x1830881263446144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065148.240478:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.240492:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9332fe expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.240519:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.240525:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065148.240527:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065148.240530:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.240553:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.240562:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 27 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.240573:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263308928:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.240635:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065148.247093:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.248085:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.248107:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446400 00000100:00100000:1.0:1746065148.248113:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446400 00000100:00100000:1.0:1746065148.248152:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13027 00000100:00100000:1.0:1746065148.248159:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+28:32118:x1830881263446400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065148.248175:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065148.248189:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933305 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.248210:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065148.248215:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.248226:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.248236:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73400, rc 0) 00000100:00100000:1.0:1746065148.248270:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+29:32118:x1830881263446400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 112us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.248275:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13027 00000100:00100000:2.0:1746065148.248578:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263308928:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.248597:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.248606:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45400, rc 0) 00000100:00100000:2.0:1746065148.248626:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+9:32121:x1830881263446144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8161us (8285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.248631:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13026 00000100:00100000:3.0:1746065148.248825:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446272 00000100:00100000:3.0:1746065148.248830:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446272 00002000:00100000:3.0:1746065148.248853:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3993600->4005887) req@ffff880097fab100 x1830881263446272/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 12776/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.248862:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab100 with x1830881263446272 ext(3993600->4005887) 00010000:00010000:3.0:1746065148.248867:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 29 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.248880:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 29 pid: 1880 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.248885:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fab100 00000100:00100000:3.0:1746065148.248898:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1280 00000100:00100000:3.0:1746065148.248903:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263446272:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065148.249549:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263446272:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 644us (2461us total) trans 17179873449 rc 0/0 00000100:00100000:0.0:1746065148.249556:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1280 00002000:00100000:0.0:1746065148.249561:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3993600->4005887) req@ffff880097fab100 x1830881263446272/t17179873449(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 12776/448 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.249568:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab100 with x1830881263446272 ext(3993600->4005887) 00010000:00010000:0.0:1746065148.249572:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 31 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746065148.249581:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 31 pid: 1880 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746065148.249586:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fab100 00000100:00100000:3.0:1746065148.257652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.257765:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446528 00000100:00100000:1.0:1746065148.257790:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446528 00010000:00010000:1.0:1746065148.257818:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 31 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.257946:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5828 00000100:00100000:1.0:1746065148.257961:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263446528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.257973:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.257987:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 31 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.257996:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 31 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.258013:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1000/0xad6b7ddc146ee2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [3993600->18446744073709551615] (req 3993600->4005887) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e2 expref: 31 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.258033:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.258035:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.258040:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.258048:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.258054:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.258055:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.258057:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.258062:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.258084:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.258098:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263309056:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065148.258162:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.258169:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263309184:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065148.258183:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.262353:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.262834:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263309056:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065148.262844:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263309184:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065148.262859:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.262905:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263446528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4951us (5559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.262914:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5828 00000100:00100000:0.0:1746065148.262984:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446784 00000100:00100000:0.0:1746065148.262989:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446784 00002000:00100000:0.0:1746065148.263019:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099e13b80 x1830881263446784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.263028:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13b80 with x1830881263446784 ext(3145728->4194303) 00002000:00010000:0.0:1746065148.263032:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e13b80 00000100:00100000:0.0:1746065148.263046:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3632 00000100:00100000:0.0:1746065148.263052:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263446784:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065148.267326:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.267409:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447040 00000100:00100000:1.0:1746065148.267417:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447040 00002000:00100000:1.0:1746065148.267453:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009a6ddf80 x1830881263447040/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.267462:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddf80 with x1830881263447040 ext(3145728->4194303) 00002000:00010000:1.0:1746065148.267467:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddf80 00000100:00100000:1.0:1746065148.267499:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3633 00000100:00100000:1.0:1746065148.267506:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263447040:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065148.275195:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263446784:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12133us (12839us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065148.275204:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3632 00002000:00100000:2.0:1746065148.275214:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099e13b80 x1830881263446784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.275222:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13b80 with x1830881263446784 ext(3145728->4194303) 00002000:00010000:2.0:1746065148.275228:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e13b80 00000100:00100000:0.0:1746065148.283304:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.283357:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447296 00000100:00100000:2.0:1746065148.283365:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447296 00002000:00100000:2.0:1746065148.283401:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097fa8380 x1830881263447296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.283409:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881263447296 ext(4194304->5021695) 00002000:00010000:2.0:1746065148.283413:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:2.0:1746065148.283803:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3634 00000100:00100000:2.0:1746065148.283811:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263447296:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065148.286020:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263447040:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 18508us (18695us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065148.286032:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3633 00002000:00100000:1.0:1746065148.286040:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009a6ddf80 x1830881263447040/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.286048:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddf80 with x1830881263447040 ext(3145728->4194303) 00002000:00010000:1.0:1746065148.286053:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddf80 00000100:00100000:2.0:1746065148.289158:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263447296:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5339us (5856us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065148.289168:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3634 00002000:00100000:2.0:1746065148.289176:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097fa8380 x1830881263447296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.289185:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881263447296 ext(4194304->5021695) 00002000:00010000:2.0:1746065148.289190:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:0.0:1746065148.296442:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.296500:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447552 00000100:00100000:2.0:1746065148.296509:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447552 00002000:00100000:2.0:1746065148.296547:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097faa680 x1830881263447552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.296556:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa680 with x1830881263447552 ext(4194304->5021695) 00002000:00010000:2.0:1746065148.296561:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097faa680 00000100:00100000:2.0:1746065148.296588:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3635 00000100:00100000:2.0:1746065148.296594:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263447552:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065148.311435:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263447552:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14832us (14992us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065148.311446:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3635 00002000:00100000:2.0:1746065148.311455:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097faa680 x1830881263447552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.311464:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa680 with x1830881263447552 ext(4194304->5021695) 00002000:00010000:2.0:1746065148.311470:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097faa680 00000100:00100000:0.0:1746065148.431120:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.431210:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447808 00000100:00100000:2.0:1746065148.431219:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447808 00000100:00100000:2.0:1746065148.431270:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13601 00000100:00100000:2.0:1746065148.431277:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+34:32132:x1830881263447808:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065148.431297:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.431312:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc146ee55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93330c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.431371:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431381:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431393:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431402:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431407:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431411:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431487:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc146ee6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431496:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc146ee6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431501:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc146ee6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065148.431508:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065148.431564:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431569:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431574:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431578:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431582:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065148.431586:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431591:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431599:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065148.431601:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065148.431605:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.431609:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ee5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.433216:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.433225:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.433229:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.433233:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065148.433235:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.433239:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.433249:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091b5d800) 00010000:00010000:2.0:1746065148.433251:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065148.433254:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.433263:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ee63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065148.433444:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc146ee55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93330c expref: 37 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.433456:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc146ee6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93330c expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.433462:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065148.433464:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065148.433466:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167e00, rc 0) 00000100:00100000:2.0:1746065148.435569:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+36:32132:x1830881263447808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4280us (4443us total) trans 8589935928 rc 0/0 00000100:00100000:2.0:1746065148.435578:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13601 00000100:00100000:0.0:1746065148.453175:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.453226:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.454753:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447936 00000100:00100000:1.0:1746065148.454763:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447936 00000100:00100000:1.0:1746065148.454860:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 719 00000100:00100000:1.0:1746065148.454868:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881263447936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.454880:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.454901:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc146ee6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93330c expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.454926:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065148.454929:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.454979:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263447936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.454985:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 719 00000100:00100000:2.0:1746065148.457247:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448064 00000100:00100000:2.0:1746065148.457255:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448064 00000100:00100000:2.0:1746065148.457296:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13028 00000100:00100000:2.0:1746065148.457303:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+25:32132:x1830881263448064:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065148.457318:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.457332:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933313 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.457354:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 26 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.457362:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.457369:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.457372:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.457375:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [1003520->1048575] (req 1003520->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.457398:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.457409:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 11 pid: 9549 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.457419:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263309312:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.461057:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 26 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.461071:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 26 pid: 9548 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.461082:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263309440:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.461904:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065148.464637:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.464728:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.464848:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263309312:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065148.464859:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263309440:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065148.464881:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [1003520->1048575] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065148.464899:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448320 00010000:00010000:1.0:1746065148.464900:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166000, rc 0) 00000100:00100000:2.0:1746065148.464905:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448320 00000100:00100000:2.0:1746065148.464943:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448576 00000100:00100000:2.0:1746065148.464945:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448576 00000100:00100000:1.0:1746065148.464946:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+26:32132:x1830881263448064:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7643us (11719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.464975:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13602 00000100:00100000:2.0:1746065148.464981:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+14:32138:x1830881263448320:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:1.0:1746065148.464995:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13028 00010000:00010000:2.0:1746065148.464998:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.465011:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166800/0xad6b7ddc146ee7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93331a expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.465066:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465075:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065148.465079:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13603 00010000:00010000:2.0:1746065148.465083:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065148.465085:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+35:32139:x1830881263448576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065148.465092:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.465095:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.465098:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465102:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.465102:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146ee94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933321 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.465130:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465138:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465143:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465150:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465155:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465159:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065148.465168:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465176:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465181:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065148.465188:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065148.465198:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc146eeb0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465205:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc146eeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465211:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc146eeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065148.465217:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065148.465233:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465242:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465247:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.465248:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065148.465252:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065148.465253:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465257:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465261:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065148.465368:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.465388:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.465409:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448704 00000100:00100000:0.0:1746065148.465412:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448704 00010000:00010000:0.0:1746065148.465426:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 12 pid: 9549 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746065148.465440:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448832 00000100:00100000:0.0:1746065148.465442:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448832 00010000:00010000:0.0:1746065148.465448:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 26 pid: 9548 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746065148.465459:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5829 00000100:00100000:0.0:1746065148.465463:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263448704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065148.465471:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065148.465483:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 12 pid: 9549 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746065148.465491:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 12 pid: 9549 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746065148.465504:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc146ed52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933272 expref: 12 pid: 9549 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746065148.465516:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065148.465531:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263448704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065148.465536:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5829 00000100:00100000:0.0:1746065148.465546:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5830 00000100:00100000:0.0:1746065148.465550:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263448832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065148.465555:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065148.465560:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 26 pid: 9548 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746065148.465568:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 26 pid: 9548 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746065148.465577:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc146ece2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933233 expref: 26 pid: 9548 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746065148.465584:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065148.465586:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065148.465593:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.465600:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.465627:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065148.465637:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263309568:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065148.465667:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe780 going to sleep for 11 seconds 00010000:00010000:2.0:1746065148.465848:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465855:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465865:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065148.465867:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065148.465870:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465875:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc146ee86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.465876:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065148.465879:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465885:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065148.465887:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465892:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.465892:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065148.465895:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065148.465896:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.465897:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065148.465900:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065148.465901:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146ee9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065148.465902:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465910:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.465916:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091b5df00) 00010000:00010000:2.0:1746065148.465918:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065148.465920:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.465920:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065148.465924:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc146ee8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.465924:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465928:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465932:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065148.465934:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465938:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465943:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091b5df00) 00010000:00010000:2.0:1746065148.465945:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166800/0xad6b7ddc146ee7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.465945:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065148.465947:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465962:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146eea2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.465989:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73a00/0xad6b7ddc146ee94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933321 expref: 38 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.465997:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc146eeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933321 expref: 37 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.466003:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065148.466005:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065148.466007:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72a00, rc 0) 00000100:00100000:1.0:1746065148.466028:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+37:32139:x1830881263448576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 943us (1299us total) trans 8589935930 rc 0/0 00000100:00100000:1.0:1746065148.466033:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13603 00010000:00010000:2.0:1746065148.466383:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 16 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.466388:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065148.466389:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065148.466391:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167600, rc 0) 00000100:00100000:2.0:1746065148.466411:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+16:32138:x1830881263448320:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1430us (1782us total) trans 8589935929 rc 0/0 00000100:00100000:2.0:1746065148.466416:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13602 00000100:00100000:2.0:1746065148.467762:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263309568:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065148.467803:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065148.467882:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263448832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2329us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.467890:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5830 00000100:00100000:0.0:1746065148.468689:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.468720:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.468755:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.468792:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449600 00000100:00100000:0.0:1746065148.468797:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449600 00002000:00100000:0.0:1746065148.468828:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (1003520->1007615) req@ffff880097fab480 x1830881263449600/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.468880:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab480 with x1830881263449600 ext(1003520->1007615) 00002000:00010000:0.0:1746065148.468884:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab480 00000100:00100000:0.0:1746065148.468912:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3636 00000100:00100000:3.0:1746065148.469129:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449216 00000100:00100000:3.0:1746065148.469133:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449216 00000100:00100000:3.0:1746065148.469153:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449472 00000100:00100000:3.0:1746065148.469155:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449472 00000100:00100000:3.0:1746065148.469166:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4900 00000100:00100000:3.0:1746065148.469171:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+16:32138:x1830881263449216:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065148.469201:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4901 00000100:00100000:2.0:1746065148.469206:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:32139:x1830881263449472:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065148.469880:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263449600:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.470010:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263449600:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1091us (1253us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065148.470015:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3636 00002000:00100000:0.0:1746065148.470021:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (1003520->1007615) req@ffff880097fab480 x1830881263449600/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.470027:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab480 with x1830881263449600 ext(1003520->1007615) 00002000:00010000:0.0:1746065148.470031:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab480 00000100:00100000:0.0:1746065148.470077:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.470146:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449728 00000100:00100000:0.0:1746065148.470150:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449728 00000100:00100000:0.0:1746065148.470174:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 720 00000100:00100000:0.0:1746065148.470178:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263449728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065148.470186:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065148.470203:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc146eeb0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933321 expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.470214:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065148.470217:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065148.470232:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263449728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065148.470239:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 720 00000100:00100000:3.0:1746065148.470401:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+17:32138:x1830881263449216:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1229us (1713us total) trans 8589935932 rc 0/0 00000100:00100000:3.0:1746065148.470406:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4900 00000100:00100000:2.0:1746065148.470533:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:32139:x1830881263449472:12345-192.168.202.27@tcp:35:cat.0 Request processed in 1326us (1811us total) trans 8589935931 rc 0/0 00000100:00100000:2.0:1746065148.470538:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4901 00000100:00100000:1.0:1746065148.483525:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.483706:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449856 00000100:00100000:2.0:1746065148.483714:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449856 00000100:00100000:0.0:1746065148.484248:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.484401:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13029 00000100:00100000:2.0:1746065148.484410:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:32132:x1830881263449856:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065148.484425:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.484441:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933328 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065148.484574:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450112 00000100:00100000:3.0:1746065148.484579:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450112 00000100:00100000:3.0:1746065148.484608:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13604 00000100:00100000:3.0:1746065148.484613:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+17:32140:x1830881263450112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065148.484623:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.484635:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146eecc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93332f expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.484700:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484710:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484719:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484729:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484735:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484739:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484827:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146eee1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484836:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146eee1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484841:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146eee1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065148.484848:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065148.484911:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484916:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484925:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484930:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4a24c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065148.484933:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484939:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484949:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065148.484964:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065148.484968:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484973:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146eed3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484987:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484991:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484995:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.484998:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065148.485000:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.485004:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.485011:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2aa00) 00010000:00010000:3.0:1746065148.485012:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065148.485014:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.485018:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc146eeda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.485104:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 31 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.485111:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 8 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.485116:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.485118:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.485121:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->1196031] (req 1048576->1196031) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.485144:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 8 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.485159:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 8 pid: 9549 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.485169:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263309696:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.485243:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 31 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.485251:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 31 pid: 9548 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.485259:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263309824:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.485276:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065148.485802:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.485856:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450368 00000100:00100000:0.0:1746065148.485860:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450368 00010000:00010000:3.0:1746065148.485873:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc146eecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93332f expref: 20 pid: 13395 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065148.485886:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1003519) req@ffff8800983bb480 x1830881263450368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065148.485887:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146eee1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93332f expref: 19 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.485894:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00002000:00100000:0.0:1746065148.485894:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bb480 with x1830881263450368 ext(0->1003519) 00010000:00010000:3.0:1746065148.485896:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00002000:00010000:0.0:1746065148.485897:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bb480 00010000:00010000:3.0:1746065148.485898:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fc00, rc 0) 00000100:00100000:0.0:1746065148.485910:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3637 00000100:00100000:0.0:1746065148.485916:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263450368:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065148.485926:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+19:32140:x1830881263450112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1312us (1678us total) trans 8589935933 rc 0/0 00000100:00100000:3.0:1746065148.485932:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13604 00000100:00100000:0.0:1746065148.493219:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.493256:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.493257:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450496 00000100:00100000:1.0:1746065148.493265:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450496 00000100:00100000:0.0:1746065148.493271:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450624 00000100:00100000:0.0:1746065148.493274:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450624 00010000:00010000:1.0:1746065148.493294:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 9 pid: 9549 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746065148.493294:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 32 pid: 9548 timeout: 844 lvb_type: 1 00000100:00100000:1.0:1746065148.493339:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5831 00000100:00100000:1.0:1746065148.493346:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263450624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.493357:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065148.493373:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263309696:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.493382:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263309824:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.493400:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->1196031] (req 1048576->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.493418:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167e00, rc 0) 00000100:00100000:2.0:1746065148.493454:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:32132:x1830881263449856:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9046us (9990us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.493461:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13029 00010000:00010000:1.0:1746065148.493495:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 31 pid: 9548 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746065148.493505:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 31 pid: 9548 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746065148.493523:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc146ecf0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93323a expref: 31 pid: 9548 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746065148.493537:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065148.493554:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5832 00000100:00100000:2.0:1746065148.493559:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263450496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065148.493563:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263450624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 218us (306us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065148.493566:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065148.493571:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5831 00010000:00010000:2.0:1746065148.493575:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 9 pid: 9549 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.493583:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 9 pid: 9549 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.493594:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc146ed59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933279 expref: 9 pid: 9549 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.493611:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.493613:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.493618:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.493625:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.493647:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065148.493658:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263309952:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065148.493701:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065148.496087:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.496184:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450752 00000100:00100000:3.0:1746065148.496191:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450752 00000100:00100000:3.0:1746065148.496227:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13605 00000100:00100000:3.0:1746065148.496233:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:32141:x1830881263450752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065148.496248:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.496263:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc146eeef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933336 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.496320:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.496330:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.496339:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.496349:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.496354:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.496358:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.496413:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.496422:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.496427:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.496450:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.496460:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 18 pid: 7203 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.496476:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263310080:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065148.496561:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065148.504440:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263310080:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065148.504469:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:2.0:1746065148.504483:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263309952:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065148.504494:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065148.504526:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263450496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10966us (11316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.504535:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5832 00000100:00100000:0.0:1746065148.506521:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.506603:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.506664:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451008 00000100:00100000:1.0:1746065148.506673:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451008 00002000:00100000:1.0:1746065148.506708:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1191936->1196031) req@ffff880097fab800 x1830881263451008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.506718:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab800 with x1830881263451008 ext(1191936->1196031) 00002000:00010000:1.0:1746065148.506722:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fab800 00000100:00100000:1.0:1746065148.506756:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3638 00000100:00100000:1.0:1746065148.506763:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263451008:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065148.506937:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263451008:12345-192.168.202.27@tcp:3:cat.0 Request processed in 174us (419us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065148.506942:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3638 00002000:00100000:1.0:1746065148.506947:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1191936->1196031) req@ffff880097fab800 x1830881263451008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065148.506965:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab800 with x1830881263451008 ext(1191936->1196031) 00002000:00010000:1.0:1746065148.506968:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fab800 00000100:00100000:0.0:1746065148.507071:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.507116:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451264 00000100:00100000:2.0:1746065148.507120:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451264 00000100:00100000:2.0:1746065148.507142:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4902 00000100:00100000:2.0:1746065148.507146:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+19:32140:x1830881263451264:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065148.507284:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+20:32140:x1830881263451264:12345-192.168.202.27@tcp:35:cat.0 Request processed in 136us (680us total) trans 8589935934 rc 0/0 00000100:00100000:2.0:1746065148.507290:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4902 00000100:00100000:0.0:1746065148.507706:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451392 00000100:00100000:0.0:1746065148.507709:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451392 00000100:00100000:0.0:1746065148.507730:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 721 00000100:00100000:0.0:1746065148.507735:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263451392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065148.507742:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065148.507763:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc146eee1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93332f expref: 21 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.507797:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065148.507801:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065148.507808:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065148.507812:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065148.507816:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065148.507835:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263451392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065148.507841:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 721 00000100:00100000:0.0:1746065148.507993:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263450368:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22077us (22191us total) trans 0 rc 1003520/1003520 00000100:00100000:0.0:1746065148.507998:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3637 00002000:00100000:0.0:1746065148.508003:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1003519) req@ffff8800983bb480 x1830881263450368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1003520/1003520 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.508010:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bb480 with x1830881263450368 ext(0->1003519) 00002000:00010000:0.0:1746065148.508013:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983bb480 00000100:00100000:0.0:1746065148.514760:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.515674:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.515822:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451904 00000100:00100000:2.0:1746065148.515831:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451904 00000100:00100000:3.0:1746065148.515964:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451648 00000100:00100000:3.0:1746065148.515968:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451648 00000100:00100000:3.0:1746065148.515996:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13030 00000100:00100000:3.0:1746065148.516003:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263451648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065148.516018:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.516034:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25800/0xad6b7ddc146ef0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933344 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065148.516075:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263310208:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065148.516143:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065148.516168:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.516373:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451520 00000100:00100000:0.0:1746065148.516377:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451520 00000100:00100000:0.0:1746065148.516397:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13031 00000100:00100000:0.0:1746065148.516403:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263451520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065148.516409:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065148.516417:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146ef12 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93333d expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065148.516438:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263310336:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065148.516467:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.516574:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4903 00000100:00100000:2.0:1746065148.516580:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:32132:x1830881263451904:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065148.516729:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+38:32132:x1830881263451904:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 148us (1977us total) trans 8589935935 rc 0/0 00000100:00100000:2.0:1746065148.516736:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4903 00000100:00100000:1.0:1746065148.523024:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:3.0:1746065148.523191:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065143 -> 1746065148 00002000:00010000:3.0:1746065148.523195:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065143 -> 1746065148 00002000:00010000:3.0:1746065148.523197:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065143 -> 1746065148 00000100:00100000:3.0:1746065148.523213:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263310208:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065148.523242:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25800/0xad6b7ddc146ef0b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933344 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.523255:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25800/0xad6b7ddc146ef0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933344 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065148.523276:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263452032 00010000:00010000:3.0:1746065148.523279:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25800, rc 0) 00000100:00100000:0.0:1746065148.523283:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263452032 00000100:00100000:3.0:1746065148.523317:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263451648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7315us (7645us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065148.523325:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13030 00010000:00010000:0.0:1746065148.523346:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 19 pid: 7203 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.523440:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065147 -> 1746065148 00002000:00010000:3.0:1746065148.523443:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065147 -> 1746065148 00002000:00010000:3.0:1746065148.523444:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065147 -> 1746065148 00000100:00100000:3.0:1746065148.523454:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263310336:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065148.523469:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146ef12 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93333d expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.523477:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146ef12 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93333d expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.523484:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:3.0:1746065148.523503:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263451520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7100us (7334us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065148.523508:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13031 00000100:00100000:1.0:1746065148.525488:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5833 00000100:00100000:1.0:1746065148.525506:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263452032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.525522:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.525532:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 19 pid: 7203 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.525544:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 19 pid: 7203 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.525562:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146edec lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332c6 expref: 19 pid: 7203 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.525582:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065148.525586:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.525595:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.525601:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.525627:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.525659:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263452032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 160us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.525665:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5833 00010000:00010000:2.0:1746065148.525847:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525855:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065148.525896:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065148.525901:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065148.525915:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525923:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525931:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525936:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525941:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525946:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993fe00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065148.525961:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525967:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525974:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065148.525976:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065148.525979:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525984:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc146eef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525995:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.525999:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.526003:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.526006:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065148.526009:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.526012:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.526017:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a600) 00010000:00010000:2.0:1746065148.526019:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065148.526021:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.526024:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146eefd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.526051:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc146eeef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.526061:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.526066:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065148.526068:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065148.526069:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:2.0:1746065148.526093:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32141:x1830881263450752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 29861us (30060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.526100:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13605 00000100:00100000:0.0:1746065148.540194:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.540512:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.540588:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263452288 00000100:00100000:2.0:1746065148.540596:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263452288 00002000:00100000:2.0:1746065148.540632:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1196032->2097151) req@ffff88008f3e6d80 x1830881263452288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.540641:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6d80 with x1830881263452288 ext(1196032->2097151) 00002000:00010000:2.0:1746065148.540646:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e6d80 00000100:00100000:3.0:1746065148.540715:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263452416 00000100:00100000:3.0:1746065148.540718:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263452416 00000100:00100000:3.0:1746065148.540744:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13032 00000100:00100000:3.0:1746065148.540750:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+11:32140:x1830881263452416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065148.540761:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.540800:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93334b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.540824:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.540830:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065148.540832:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065148.540835:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.540859:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.540869:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 24 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.540879:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263310464:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065148.540971:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.541948:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3639 00000100:00100000:2.0:1746065148.541964:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263452288:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065148.546456:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.547050:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.547120:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.547971:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.551272:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263452544 00000100:00100000:2.0:1746065148.551282:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263452544 00000100:00100000:2.0:1746065148.551316:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263452672 00000100:00100000:2.0:1746065148.551318:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263452672 00000100:00100000:2.0:1746065148.551335:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263452800 00000100:00100000:2.0:1746065148.551337:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263452800 00000100:00100000:2.0:1746065148.551348:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263452928 00000100:00100000:2.0:1746065148.551349:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263452928 00000100:00100000:2.0:1746065148.551363:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13033 00000100:00100000:2.0:1746065148.551369:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263452544:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065148.551384:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.551397:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ef20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933352 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065148.551437:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263310592:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065148.551492:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.551506:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13034 00000100:00100000:2.0:1746065148.551510:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263452672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065148.551516:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.551524:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc146ef27 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933359 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065148.551542:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263310720:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065148.551556:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.551564:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13035 00000100:00100000:2.0:1746065148.551569:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263452800:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065148.551573:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.551578:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933360 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.551585:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.551587:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.551594:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.551605:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.551613:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:2.0:1746065148.551627:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263452800:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 58us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.551632:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13035 00000100:00100000:2.0:1746065148.551644:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13036 00000100:00100000:2.0:1746065148.551648:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263452928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065148.551652:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.551657:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933367 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.551664:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.551665:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.551668:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.551681:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.551686:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9400, rc 0) 00000100:00100000:2.0:1746065148.551695:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263452928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 47us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.551699:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13036 00000100:00100000:3.0:1746065148.552086:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.552100:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.552156:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263453056 00000100:00100000:0.0:1746065148.552160:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263453056 00000100:00100000:0.0:1746065148.552174:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263453184 00000100:00100000:0.0:1746065148.552176:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263453184 00000100:00100000:0.0:1746065148.552184:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13037 00000100:00100000:0.0:1746065148.552188:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263453056:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065148.552194:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065148.552199:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93336e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.552213:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065148.552214:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065148.552218:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065148.552227:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065148.552233:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be000, rc 0) 00000100:00100000:0.0:1746065148.552250:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263453056:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 62us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065148.552255:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13037 00000100:00100000:0.0:1746065148.552264:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13038 00000100:00100000:0.0:1746065148.552267:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263453184:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065148.552272:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065148.552276:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933375 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.552283:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065148.552284:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065148.552287:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065148.552295:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065148.552305:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf600, rc 0) 00000100:00100000:0.0:1746065148.552314:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263453184:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 47us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065148.552318:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13038 00000100:00100000:2.0:1746065148.555841:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263310464:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.555876:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.555894:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a24c00, rc 0) 00000100:00100000:2.0:1746065148.555936:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+12:32140:x1830881263452416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 15185us (15424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.555944:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13032 00000100:00100000:2.0:1746065148.558473:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.559959:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263453312 00000100:00100000:3.0:1746065148.559968:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263453312 00002000:00100000:3.0:1746065148.560004:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (1003520->1048575) req@ffff880099e12d80 x1830881263453312/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.560012:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e12d80 with x1830881263453312 ext(1003520->1048575) 00010000:00010000:3.0:1746065148.560020:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 25 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.560037:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 25 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.560043:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e12d80 00000100:00100000:3.0:1746065148.560070:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1281 00000100:00100000:3.0:1746065148.560077:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263453312:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065148.562673:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263310720:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065148.562708:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc146ef27 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933359 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065148.562722:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6c00/0xad6b7ddc146ef27 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933359 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065148.562758:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6c00, rc 0) 00000100:00100000:0.0:1746065148.562858:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263452672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11342us (15804us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065148.562866:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13034 00000100:00100000:2.0:1746065148.564386:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263452288:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22418us (24195us total) trans 0 rc 901120/901120 00000100:00100000:2.0:1746065148.564395:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3639 00002000:00100000:2.0:1746065148.564405:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1196032->2097151) req@ffff88008f3e6d80 x1830881263452288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.564413:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6d80 with x1830881263452288 ext(1196032->2097151) 00002000:00010000:2.0:1746065148.564418:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e6d80 00000100:00100000:3.0:1746065148.565087:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263310592:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065148.565115:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ef20 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933352 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.565128:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146ef20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933352 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.565163:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c000, rc 0) 00000100:00100000:3.0:1746065148.565195:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263452544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 13824us (18744us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065148.565201:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13033 00000100:00100000:1.0:1746065148.576807:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.576900:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263453568 00000100:00100000:2.0:1746065148.576909:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263453568 00000100:00100000:2.0:1746065148.576947:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13606 00000100:00100000:2.0:1746065148.576961:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32141:x1830881263453568:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065148.576976:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.576990:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2d600/0xad6b7ddc146ef4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93337c expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.577067:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.577078:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.577084:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065148.577106:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.577114:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 8 pid: 13395 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.577124:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263310848:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.577182:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065148.578746:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263453312:12345-192.168.202.27@tcp:4:cat.0 Request processed in 18661us (20270us total) trans 21474840897 rc 0/0 00000100:00100000:3.0:1746065148.578756:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1281 00002000:00100000:3.0:1746065148.578768:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (1003520->1048575) req@ffff880099e12d80 x1830881263453312/t21474840897(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/448 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.578818:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e12d80 with x1830881263453312 ext(1003520->1048575) 00010000:00010000:3.0:1746065148.578829:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 27 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.578840:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 27 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.578846:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e12d80 00000100:00100000:0.0:1746065148.580319:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.580422:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263453824 00000100:00100000:3.0:1746065148.580431:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263453824 00002000:00100000:3.0:1746065148.580469:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88008f3e4e00 x1830881263453824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.580477:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4e00 with x1830881263453824 ext(2097152->3145727) 00002000:00010000:3.0:1746065148.580482:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4e00 00000100:00100000:3.0:1746065148.580523:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3640 00000100:00100000:3.0:1746065148.580533:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263453824:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065148.587440:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263310848:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.587460:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065148.588003:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.588070:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263453952 00000100:00100000:3.0:1746065148.588076:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263453952 00010000:00010000:3.0:1746065148.588101:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.588130:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5834 00000100:00100000:3.0:1746065148.588136:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263453952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065148.588148:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065148.588153:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.588160:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.588179:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef04 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933336 expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.588200:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065148.588204:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.588212:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.588218:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.588232:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065148.588263:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263453952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 127us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.588268:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5834 00010000:00010000:3.0:1746065148.588291:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.588296:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065148.588310:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065148.588410:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2d600/0xad6b7ddc146ef4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.588422:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.588431:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065148.588433:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065148.588435:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c600, rc 0) 00000100:00100000:3.0:1746065148.588456:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32141:x1830881263453568:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11495us (11657us total) trans 8589935936 rc 0/0 00000100:00100000:3.0:1746065148.588462:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13606 00000100:00100000:3.0:1746065148.608349:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263453824:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27803us (28016us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065148.608362:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3640 00002000:00100000:3.0:1746065148.608378:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88008f3e4e00 x1830881263453824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.608387:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4e00 with x1830881263453824 ext(2097152->3145727) 00002000:00010000:3.0:1746065148.608393:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4e00 00000100:00100000:1.0:1746065148.608724:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.608747:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263454080 00000100:00100000:1.0:1746065148.608754:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263454080 00010000:00010000:1.0:1746065148.608794:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 27 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.608816:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5835 00000100:00100000:1.0:1746065148.608823:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263454080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.608835:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.608851:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 27 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.608863:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 27 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.608883:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136166000/0xad6b7ddc146ee78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933313 expref: 27 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.608900:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.608902:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.608909:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.608916:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.608942:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.608965:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263310976:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065148.609023:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065148.609077:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.609106:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263454208 00000100:00100000:1.0:1746065148.609109:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263454208 00000100:00100000:1.0:1746065148.609131:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13607 00000100:00100000:1.0:1746065148.609136:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32141:x1830881263454208:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065148.609150:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065148.609162:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc146ef5f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933383 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.609222:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.609233:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.609239:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.609254:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.609263:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.609270:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263311104:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065148.609288:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065148.612723:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.612824:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263311104:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.612847:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:3.0:1746065148.612911:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263454336 00000100:00100000:3.0:1746065148.612917:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263454336 00010000:00010000:3.0:1746065148.612942:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 10 pid: 13395 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.612975:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5836 00000100:00100000:3.0:1746065148.612982:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263454336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065148.612993:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065148.612998:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 10 pid: 13395 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.613007:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 10 pid: 13395 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.613025:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc146ef51 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93337c expref: 10 pid: 13395 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.613039:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065148.613042:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.613050:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.613056:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.613071:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065148.613103:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263454336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 121us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.613109:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5836 00010000:00010000:3.0:1746065148.613125:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.613130:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065148.613169:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065148.613172:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065148.613186:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.613209:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc146ef5f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.613223:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.613229:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065148.613231:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065148.613233:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:3.0:1746065148.613253:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32141:x1830881263454208:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4117us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.613258:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13607 00000100:00100000:1.0:1746065148.614651:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263310976:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065148.614670:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.614701:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263454080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5877us (5977us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.614709:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5835 00000100:00100000:3.0:1746065148.615278:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.615433:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263454592 00000100:00100000:2.0:1746065148.615439:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263454592 00002000:00100000:2.0:1746065148.615475:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009a6dd880 x1830881263454592/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.615484:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dd880 with x1830881263454592 ext(0->1048575) 00002000:00010000:2.0:1746065148.615488:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dd880 00000100:00100000:2.0:1746065148.615506:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3641 00000100:00100000:2.0:1746065148.615513:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263454592:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065148.629520:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.629589:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.630615:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.630641:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263454720 00000100:00100000:3.0:1746065148.630649:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263454720 00000100:00100000:3.0:1746065148.630700:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263454848 00000100:00100000:3.0:1746065148.630703:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263454848 00000100:00100000:3.0:1746065148.630718:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263454976 00000100:00100000:3.0:1746065148.630721:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263454976 00000100:00100000:3.0:1746065148.630737:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13039 00000100:00100000:3.0:1746065148.630744:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263454720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065148.630762:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065148.630832:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13040 00000100:00100000:0.0:1746065148.630840:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263454848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065148.630847:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065148.630901:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13041 00000100:00100000:2.0:1746065148.630909:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263454976:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065148.630916:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.630929:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc146ef6d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933398 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065148.630981:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263311232:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065148.630982:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93338a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.630994:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.630996:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.631004:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.631017:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.631027:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:2.0:1746065148.631064:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e540 going to sleep for 11 seconds 00010000:00010000:0.0:1746065148.631297:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933391 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.631313:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065148.631315:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065148.631319:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065148.631328:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065148.631334:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:0.0:1746065148.632571:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263454848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1728us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065148.632579:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13040 00000100:00100000:3.0:1746065148.632649:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263454720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1905us (3138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.632655:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13039 00000100:00100000:2.0:1746065148.634402:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263311232:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065148.634718:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc146ef6d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933398 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.634731:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc146ef6d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933398 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.634760:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174a00, rc 0) 00000100:00100000:2.0:1746065148.635009:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263454976:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4099us (4393us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065148.635016:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13041 00000100:00100000:3.0:1746065148.635188:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263454592:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19674us (19910us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065148.635195:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3641 00002000:00100000:3.0:1746065148.635203:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009a6dd880 x1830881263454592/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.635212:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dd880 with x1830881263454592 ext(0->1048575) 00002000:00010000:3.0:1746065148.635216:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dd880 00000100:00100000:0.0:1746065148.636694:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.636766:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263455232 00000100:00100000:3.0:1746065148.636791:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263455232 00000100:00100000:3.0:1746065148.636831:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13608 00000100:00100000:3.0:1746065148.636837:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32141:x1830881263455232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065148.636850:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.636868:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef82 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93339f expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.636943:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.636969:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.636978:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.636987:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.636993:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.636998:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.637002:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065148.637005:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.637011:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.637020:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065148.637023:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065148.637025:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.637030:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc146ef89 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.637065:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef82 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93339f expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.637076:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef82 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93339f expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.637082:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:3.0:1746065148.637117:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32141:x1830881263455232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 279us (427us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065148.637122:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13608 00000100:00100000:0.0:1746065148.638666:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.638735:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263455488 00000100:00100000:2.0:1746065148.638741:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263455488 00000100:00100000:2.0:1746065148.638788:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4904 00000100:00100000:2.0:1746065148.638794:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32141:x1830881263455488:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065148.639678:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32141:x1830881263455488:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 882us (1014us total) trans 8589935937 rc 0/0 00000100:00100000:2.0:1746065148.639685:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4904 00000100:00100000:2.0:1746065148.645232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.645303:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263455616 00000100:00100000:0.0:1746065148.645311:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263455616 00000100:00100000:0.0:1746065148.645573:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13042 00000100:00100000:0.0:1746065148.645581:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+8:32140:x1830881263455616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065148.645596:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065148.645610:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333a6 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.645635:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.645641:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065148.645644:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065148.645648:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 9 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.645673:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065148.645684:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 29 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746065148.645693:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263311360:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065148.647856:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.647930:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065148.647988:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263455744 00000100:00100000:3.0:1746065148.647995:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263455744 00000100:00100000:3.0:1746065148.648025:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13043 00000100:00100000:3.0:1746065148.648031:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+12:32138:x1830881263455744:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065148.648042:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.648055:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333ad expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.648077:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 26 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.648084:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.648090:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.648095:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.648097:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.648100:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1302528->1982463] (req 1302528->1982463) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.648121:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.648129:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 13 pid: 1880 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746065148.648139:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263311488:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065148.648185:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065148.648197:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.648205:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 11 pid: 3068 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746065148.648212:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263311616:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065148.648236:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 26 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.648325:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 26 pid: 1880 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746065148.648332:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263311744:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065148.648353:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065148.648423:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263456000 00000100:00100000:1.0:1746065148.648426:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263456000 00000100:00100000:1.0:1746065148.648461:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13609 00000100:00100000:1.0:1746065148.648466:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+38:32145:x1830881263456000:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065148.648478:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065148.648488:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07c00/0xad6b7ddc146ef9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333b4 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.648541:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648551:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648559:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648570:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648575:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648580:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648651:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648659:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648665:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065148.648671:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065148.648726:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648735:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648740:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648746:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648817:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065148.648821:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648827:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648837:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065148.648839:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065148.648842:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648846:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc146efa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648864:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648868:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648871:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648874:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065148.648876:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648880:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648885:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5000) 00010000:00010000:1.0:1746065148.648887:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065148.648890:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648894:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc146efac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.648924:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07c00/0xad6b7ddc146ef9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.648933:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.648938:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065148.648939:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065148.648941:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:1.0:1746065148.649368:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+40:32145:x1830881263456000:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 900us (1182us total) trans 8589935938 rc 0/0 00000100:00100000:1.0:1746065148.649374:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13609 00000100:00100000:0.0:1746065148.652037:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.652063:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.652105:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.652275:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263456256 00000100:00100000:2.0:1746065148.652283:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263456256 00010000:00010000:2.0:1746065148.652311:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 14 pid: 1880 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746065148.652439:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263311488:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065148.652449:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263311616:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065148.652466:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263456128 00000100:00100000:3.0:1746065148.652469:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263456128 00002000:00100000:3.0:1746065148.652494:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1196031) req@ffff88009856d180 x1830881263456128/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.652501:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881263456128 ext(1048576->1196031) 00010000:00010000:3.0:1746065148.652508:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 30 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.652518:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 30 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.652524:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856d180 00000100:00100000:3.0:1746065148.652541:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1282 00000100:00100000:3.0:1746065148.652547:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263456128:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065148.652675:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263456384 00000100:00100000:2.0:1746065148.652678:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263456384 00010000:00010000:2.0:1746065148.652690:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 12 pid: 3068 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.652703:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5837 00000100:00100000:2.0:1746065148.652707:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263456256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065148.652715:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065148.652729:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 14 pid: 1880 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.652737:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 14 pid: 1880 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.652754:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146ed6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93328e expref: 14 pid: 1880 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.652769:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065148.652815:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263456256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.652821:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5837 00000100:00100000:2.0:1746065148.652833:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5838 00000100:00100000:2.0:1746065148.652838:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263456384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065148.652844:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065148.652850:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 12 pid: 3068 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.652857:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 12 pid: 3068 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.652866:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9400/0xad6b7ddc146ef35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933367 expref: 12 pid: 3068 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.652874:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065148.652886:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263456384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 48us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.652892:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5838 00000100:00100000:2.0:1746065148.652917:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263311360:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.652934:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 9 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.652942:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be200, rc 0) 00000100:00100000:2.0:1746065148.652972:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+9:32140:x1830881263455616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7391us (7745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.652977:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13042 00000100:00100000:2.0:1746065148.656415:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263311744:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.656445:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1302528->1982463] (req 1302528->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.656459:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:2.0:1746065148.656491:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+12:32138:x1830881263455744:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8460us (8640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.656499:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13043 00000100:00100000:1.0:1746065148.657066:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.657102:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.657139:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263456640 00000100:00100000:2.0:1746065148.657144:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263456640 00000100:00100000:3.0:1746065148.657156:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263456512 00000100:00100000:3.0:1746065148.657159:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263456512 00010000:00010000:3.0:1746065148.657171:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 28 pid: 1880 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.657178:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13044 00000100:00100000:2.0:1746065148.657184:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:32145:x1830881263456640:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:3.0:1746065148.657186:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5839 00000100:00100000:3.0:1746065148.657190:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263456512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065148.657195:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.657199:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065148.657206:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333bb expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.657214:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 28 pid: 1880 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746065148.657222:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 29 pid: 1880 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.657225:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.657231:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065148.657236:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146ecf7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933248 expref: 29 pid: 1880 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746065148.657237:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.657242:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.657244:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.657246:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2953216->3133439] (req 2953216->3133439) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.657247:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.657248:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.657252:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.657258:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.657270:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.657272:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.657278:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 11 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.657281:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263312000:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065148.657285:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263311872:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065148.657521:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00010000:00010000:2.0:1746065148.657667:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.657675:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 10 pid: 11461 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.657687:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263312128:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.657732:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.657740:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 28 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.657748:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263312256:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.657764:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065148.658358:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263456128:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5809us (6250us total) trans 17179873450 rc 0/0 00000100:00100000:3.0:1746065148.658365:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1282 00002000:00100000:3.0:1746065148.658372:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1196031) req@ffff88009856d180 x1830881263456128/t17179873450(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/448 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.658380:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881263456128 ext(1048576->1196031) 00010000:00010000:3.0:1746065148.658387:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 32 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.658395:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 32 pid: 3068 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.658401:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856d180 00000100:00100000:2.0:1746065148.660109:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263311872:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065148.660127:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263312000:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065148.660139:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065148.660229:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263456512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3036us (3163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.660238:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5839 00000100:00100000:1.0:1746065148.663756:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.663874:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263312128:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.663884:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263312256:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.663914:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2953216->3133439] (req 2953216->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.663932:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c000, rc 0) 00000100:00100000:2.0:1746065148.663993:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:32145:x1830881263456640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6808us (6889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.664002:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13044 00000100:00100000:1.0:1746065148.664167:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.664197:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.664214:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263457152 00000100:00100000:1.0:1746065148.664219:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263457152 00010000:00010000:1.0:1746065148.664241:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 12 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.664260:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263457024 00000100:00100000:1.0:1746065148.664262:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263457024 00010000:00010000:1.0:1746065148.664270:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 11 pid: 11461 timeout: 844 lvb_type: 1 00000100:00100000:1.0:1746065148.664282:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5840 00000100:00100000:1.0:1746065148.664287:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263457152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.664297:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.664313:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 12 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.664322:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 12 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.664339:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146ee40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f7 expref: 12 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.664351:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.664369:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263457152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.664374:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5840 00000100:00100000:1.0:1746065148.664385:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5841 00000100:00100000:1.0:1746065148.664389:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263457024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.664396:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.664402:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 11 pid: 11461 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746065148.664409:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 11 pid: 11461 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746065148.664419:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc146ef3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93336e expref: 11 pid: 11461 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746065148.664428:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065148.664442:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263457024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.664447:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5841 00000100:00100000:3.0:1746065148.664846:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263456896 00000100:00100000:3.0:1746065148.664850:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263456896 00002000:00100000:3.0:1746065148.664873:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1302528->1306623) req@ffff880097fa9880 x1830881263456896/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.664882:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9880 with x1830881263456896 ext(1302528->1306623) 00002000:00010000:3.0:1746065148.664885:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa9880 00000100:00100000:3.0:1746065148.664903:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3642 00000100:00100000:3.0:1746065148.664908:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263456896:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065148.665007:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263456896:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 99us (1259us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065148.665013:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3642 00002000:00100000:3.0:1746065148.665017:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1302528->1306623) req@ffff880097fa9880 x1830881263456896/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.665029:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9880 with x1830881263456896 ext(1302528->1306623) 00002000:00010000:3.0:1746065148.665032:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa9880 00000100:00100000:0.0:1746065148.666548:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.666583:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.666638:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263457280 00000100:00100000:3.0:1746065148.666643:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263457280 00010000:00010000:3.0:1746065148.666661:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 32 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.666678:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263457408 00000100:00100000:3.0:1746065148.666679:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263457408 00010000:00010000:3.0:1746065148.666686:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 27 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.666701:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5842 00000100:00100000:3.0:1746065148.666706:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263457280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065148.666714:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065148.666727:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 32 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.666734:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 32 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.666748:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136167e00/0xad6b7ddc146eec5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933328 expref: 32 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.666762:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.666763:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.666769:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 8 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.666794:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 8 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.666817:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 8 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065148.666825:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263312384:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065148.666873:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.666966:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5843 00000100:00100000:2.0:1746065148.666972:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263457408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065148.666979:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065148.666989:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 27 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.666997:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 27 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.667008:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146ee39 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332f0 expref: 27 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.667019:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.667020:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.667024:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.667030:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.667044:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065148.667051:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263312512:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065148.667070:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065148.673111:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.673140:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.673154:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.673177:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.673206:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263457664 00000100:00100000:0.0:1746065148.673214:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263457664 00002000:00100000:0.0:1746065148.673251:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009856df80 x1830881263457664/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.673260:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856df80 with x1830881263457664 ext(1048576->2097151) 00002000:00010000:0.0:1746065148.673265:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856df80 00000100:00100000:0.0:1746065148.673278:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263457920 00000100:00100000:0.0:1746065148.673280:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263457920 00002000:00100000:0.0:1746065148.673290:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1302527) req@ffff88009856dc00 x1830881263457920/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.673304:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856dc00 with x1830881263457920 ext(1048576->1302527) 00002000:00010000:0.0:1746065148.673308:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856dc00 00000100:00100000:0.0:1746065148.673315:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263458176 00000100:00100000:0.0:1746065148.673317:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263458176 00002000:00100000:0.0:1746065148.673327:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2953216->2957311) req@ffff88009856c380 x1830881263458176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.673332:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c380 with x1830881263458176 ext(2953216->2957311) 00002000:00010000:0.0:1746065148.673335:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c380 00000100:00100000:0.0:1746065148.673342:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263458432 00000100:00100000:0.0:1746065148.673344:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263458432 00002000:00100000:0.0:1746065148.673352:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1978368->1982463) req@ffff88009856f800 x1830881263458432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.673358:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f800 with x1830881263458432 ext(1978368->1982463) 00002000:00010000:0.0:1746065148.673360:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856f800 00000100:00100000:0.0:1746065148.673369:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3643 00000100:00100000:0.0:1746065148.673375:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263457664:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.673962:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3644 00000100:00100000:0.0:1746065148.673967:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263457920:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.674129:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3645 00000100:00100000:0.0:1746065148.674133:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263458176:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.674224:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263458176:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 90us (1069us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065148.674229:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3645 00002000:00100000:0.0:1746065148.674234:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2953216->2957311) req@ffff88009856c380 x1830881263458176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.674239:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c380 with x1830881263458176 ext(2953216->2957311) 00002000:00010000:0.0:1746065148.674243:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c380 00000100:00100000:0.0:1746065148.674254:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3646 00000100:00100000:0.0:1746065148.674258:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263458432:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.674286:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263458432:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 28us (1109us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065148.674290:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3646 00002000:00100000:0.0:1746065148.674293:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1978368->1982463) req@ffff88009856f800 x1830881263458432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.674298:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f800 with x1830881263458432 ext(1978368->1982463) 00002000:00010000:0.0:1746065148.674300:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856f800 00000100:00100000:2.0:1746065148.674424:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263312512:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065148.674438:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065148.674456:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263457408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7484us (7873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.674462:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5843 00000100:00100000:3.0:1746065148.675026:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263312384:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065148.675035:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065148.675049:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263457280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8343us (8506us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.675054:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5842 00000100:00100000:2.0:1746065148.685709:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263457664:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12324us (12598us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065148.685720:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3643 00002000:00100000:2.0:1746065148.685730:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009856df80 x1830881263457664/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.685739:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856df80 with x1830881263457664 ext(1048576->2097151) 00002000:00010000:2.0:1746065148.685745:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856df80 00000100:00100000:2.0:1746065148.687185:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263457920:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13212us (14039us total) trans 0 rc 253952/253952 00000100:00100000:2.0:1746065148.687192:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3644 00002000:00100000:2.0:1746065148.687198:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1302527) req@ffff88009856dc00 x1830881263457920/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 253952/253952 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.687206:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856dc00 with x1830881263457920 ext(1048576->1302527) 00002000:00010000:2.0:1746065148.687210:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856dc00 00000100:00100000:0.0:1746065148.693878:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.693933:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.694002:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263458944 00000100:00100000:3.0:1746065148.694011:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263458944 00000100:00100000:2.0:1746065148.694024:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263458688 00000100:00100000:2.0:1746065148.694028:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263458688 00002000:00100000:3.0:1746065148.694047:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1982464->2097151) req@ffff88009856c000 x1830881263458944/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065148.694051:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4905 00002000:00100000:3.0:1746065148.694056:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c000 with x1830881263458944 ext(1982464->2097151) 00000100:00100000:2.0:1746065148.694057:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+18:32138:x1830881263458688:12345-192.168.202.27@tcp:35:multiop.0 00002000:00010000:3.0:1746065148.694060:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c000 00000100:00100000:3.0:1746065148.694071:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3647 00000100:00100000:3.0:1746065148.694075:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263458944:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065148.694586:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+19:32138:x1830881263458688:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 526us (714us total) trans 8589935939 rc 0/0 00000100:00100000:2.0:1746065148.694593:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4905 00000100:00100000:0.0:1746065148.694754:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.694768:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263459200 00000100:00100000:0.0:1746065148.694793:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263459200 00002000:00100000:0.0:1746065148.694810:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (3129344->3133439) req@ffff88009856d500 x1830881263459200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.694817:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d500 with x1830881263459200 ext(3129344->3133439) 00002000:00010000:0.0:1746065148.694822:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856d500 00000100:00100000:0.0:1746065148.694842:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3648 00000100:00100000:0.0:1746065148.694848:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263459200:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065148.695148:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263459200:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 299us (393us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065148.695154:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3648 00002000:00100000:0.0:1746065148.695159:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (3129344->3133439) req@ffff88009856d500 x1830881263459200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.695166:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d500 with x1830881263459200 ext(3129344->3133439) 00002000:00010000:0.0:1746065148.695169:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856d500 00000100:00100000:3.0:1746065148.700426:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263458944:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 6341us (6484us total) trans 0 rc 114688/114688 00000100:00100000:3.0:1746065148.700439:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3647 00002000:00100000:3.0:1746065148.700447:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1982464->2097151) req@ffff88009856c000 x1830881263458944/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 114688/114688 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.700455:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c000 with x1830881263458944 ext(1982464->2097151) 00002000:00010000:3.0:1746065148.700460:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c000 00000100:00100000:0.0:1746065148.703412:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.703486:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263459456 00000100:00100000:2.0:1746065148.703493:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263459456 00000100:00100000:2.0:1746065148.703524:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4906 00000100:00100000:2.0:1746065148.703530:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+40:32145:x1830881263459456:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065148.703675:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+41:32145:x1830881263459456:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 145us (270us total) trans 8589935940 rc 0/0 00000100:00100000:2.0:1746065148.703681:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4906 00000100:00100000:0.0:1746065148.705249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.705417:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263459584 00000100:00100000:2.0:1746065148.705422:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263459584 00000100:00100000:2.0:1746065148.705650:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13045 00000100:00100000:2.0:1746065148.705656:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+11:32140:x1830881263459584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065148.705666:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.705681:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333c2 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.705703:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.705709:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065148.705711:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065148.705713:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.705736:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.705744:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 25 pid: 9549 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.705754:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263312640:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.706464:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.708743:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263312640:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.708769:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.708805:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856600, rc 0) 00000100:00100000:2.0:1746065148.708840:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+12:32140:x1830881263459584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3183us (3592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.708847:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13045 00000100:00100000:0.0:1746065148.711121:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.713566:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263459712 00000100:00100000:3.0:1746065148.713578:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263459712 00002000:00100000:3.0:1746065148.713619:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2953216->3133439) req@ffff88009856ca80 x1830881263459712/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.713627:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856ca80 with x1830881263459712 ext(2953216->3133439) 00010000:00010000:3.0:1746065148.713636:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 26 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.713650:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 26 pid: 9549 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.713656:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856ca80 00000100:00100000:3.0:1746065148.713675:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1283 00000100:00100000:3.0:1746065148.713683:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263459712:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065148.718166:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263459712:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 4476us (7043us total) trans 21474840898 rc 0/0 00000100:00100000:3.0:1746065148.718177:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1283 00002000:00100000:3.0:1746065148.718186:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2953216->3133439) req@ffff88009856ca80 x1830881263459712/t21474840898(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/448 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.718199:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856ca80 with x1830881263459712 ext(2953216->3133439) 00010000:00010000:3.0:1746065148.718208:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 28 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.718220:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 28 pid: 9549 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746065148.718227:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856ca80 00000100:00100000:0.0:1746065148.723428:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.726078:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263459840 00000100:00100000:3.0:1746065148.726096:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263459840 00010000:00010000:3.0:1746065148.726148:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 28 pid: 9549 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.726198:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5844 00000100:00100000:3.0:1746065148.726206:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263459840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065148.726221:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065148.726240:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 28 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.726252:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 28 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.726280:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc146efc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2953216->3133439) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333bb expref: 28 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.726304:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.726306:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.726313:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.726320:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.726352:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065148.726363:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263312768:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065148.726451:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065148.728956:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263312768:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065148.728972:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065148.729010:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263459840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2803us (5592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.729019:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5844 00000100:00100000:0.0:1746065148.734730:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.734867:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263460096 00000100:00100000:3.0:1746065148.734874:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263460096 00002000:00100000:3.0:1746065148.734918:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009856ea00 x1830881263460096/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.734928:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856ea00 with x1830881263460096 ext(2097152->4194303) 00002000:00010000:3.0:1746065148.734932:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856ea00 00000100:00100000:3.0:1746065148.735148:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3649 00000100:00100000:3.0:1746065148.735156:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263460096:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065148.758387:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263460096:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23223us (23657us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065148.758400:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3649 00002000:00100000:3.0:1746065148.758411:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009856ea00 x1830881263460096/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.758420:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856ea00 with x1830881263460096 ext(2097152->4194303) 00002000:00010000:3.0:1746065148.758426:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856ea00 00000100:00100000:0.0:1746065148.769199:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.771290:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263460352 00000100:00100000:3.0:1746065148.771301:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263460352 00002000:00100000:3.0:1746065148.771344:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88009856e300 x1830881263460352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.771353:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856e300 with x1830881263460352 ext(4194304->5021695) 00002000:00010000:3.0:1746065148.771358:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856e300 00000100:00100000:3.0:1746065148.771389:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3650 00000100:00100000:3.0:1746065148.771397:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263460352:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065148.782595:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.782631:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.783033:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263460480 00000100:00100000:2.0:1746065148.783042:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263460480 00000100:00100000:2.0:1746065148.783083:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263460608 00000100:00100000:2.0:1746065148.783085:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263460608 00000100:00100000:2.0:1746065148.783101:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13046 00000100:00100000:2.0:1746065148.783107:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263460480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065148.783122:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.783136:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333c9 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.783156:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.783158:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.783165:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 32 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.783178:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 32 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.783192:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857400, rc 0) 00000100:00100000:2.0:1746065148.783242:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263460480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 134us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.783247:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13046 00000100:00100000:2.0:1746065148.783260:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13047 00000100:00100000:2.0:1746065148.783265:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263460608:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065148.783272:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.783281:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857200/0xad6b7ddc146efd6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333d0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065148.783316:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263312896:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065148.783368:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065148.783995:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.784020:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263460736 00000100:00100000:1.0:1746065148.784024:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263460736 00000100:00100000:1.0:1746065148.784043:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13048 00000100:00100000:1.0:1746065148.784047:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263460736:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065148.784054:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065148.784061:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333d7 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.784071:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.784073:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065148.784077:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065148.784090:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065148.784097:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489e00, rc 0) 00000100:00100000:1.0:1746065148.784119:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263460736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.784123:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13048 00000100:00100000:3.0:1746065148.787038:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263460352:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15634us (17840us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065148.787046:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3650 00002000:00100000:3.0:1746065148.787054:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88009856e300 x1830881263460352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.787062:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856e300 with x1830881263460352 ext(4194304->5021695) 00002000:00010000:3.0:1746065148.787066:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856e300 00002000:00010000:2.0:1746065148.792958:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746065145 -> 1746065148 00002000:00010000:2.0:1746065148.792965:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065141 -> 1746065148 00002000:00010000:2.0:1746065148.792967:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746065145 -> 1746065148 00000100:00100000:2.0:1746065148.792987:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263312896:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065148.793018:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d857200/0xad6b7ddc146efd6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d0 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.793031:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857200/0xad6b7ddc146efd6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d0 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.793057:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:2.0:1746065148.793109:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263460608:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9842us (10475us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065148.793118:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13047 00000100:00100000:0.0:1746065148.809875:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.809987:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263460992 00000100:00100000:3.0:1746065148.809995:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263460992 00002000:00100000:3.0:1746065148.810029:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880090dd9180 x1830881263460992/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.810044:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9180 with x1830881263460992 ext(0->1048575) 00002000:00010000:3.0:1746065148.810048:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9180 00000100:00100000:3.0:1746065148.810065:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3651 00000100:00100000:3.0:1746065148.810072:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263460992:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065148.810656:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.812972:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263461248 00000100:00100000:0.0:1746065148.812982:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263461248 00002000:00100000:0.0:1746065148.813022:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009aced180 x1830881263461248/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.813032:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aced180 with x1830881263461248 ext(1048576->2097151) 00002000:00010000:0.0:1746065148.813037:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aced180 00000100:00100000:0.0:1746065148.813055:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3652 00000100:00100000:0.0:1746065148.813061:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263461248:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065148.818568:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263460992:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8488us (8789us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065148.818578:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3651 00002000:00100000:3.0:1746065148.818589:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880090dd9180 x1830881263460992/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.818598:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9180 with x1830881263460992 ext(0->1048575) 00002000:00010000:3.0:1746065148.818603:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9180 00000100:00100000:2.0:1746065148.823912:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263461248:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10841us (13247us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065148.823922:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3652 00002000:00100000:2.0:1746065148.823931:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009aced180 x1830881263461248/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.823940:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aced180 with x1830881263461248 ext(1048576->2097151) 00002000:00010000:2.0:1746065148.823945:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aced180 00000100:00100000:0.0:1746065148.834101:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.835875:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263461376 00000100:00100000:2.0:1746065148.835885:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263461376 00000100:00100000:2.0:1746065148.835935:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13049 00000100:00100000:2.0:1746065148.835941:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:32152:x1830881263461376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065148.835964:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.835978:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333de expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.836001:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.836008:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065148.836009:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065148.836012:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.836038:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.836052:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 11 pid: 9549 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.836061:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263313024:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.836133:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.838420:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263313024:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.838441:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.838455:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857600, rc 0) 00000100:00100000:2.0:1746065148.838489:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32152:x1830881263461376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2546us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.838496:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13049 00000100:00100000:0.0:1746065148.839469:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.839523:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263461504 00000100:00100000:2.0:1746065148.839528:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263461504 00002000:00100000:2.0:1746065148.839557:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1302528->1982463) req@ffff880090dda300 x1830881263461504/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.839565:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda300 with x1830881263461504 ext(1302528->1982463) 00010000:00010000:2.0:1746065148.839571:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 12 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.839581:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 12 pid: 9549 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746065148.839593:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dda300 00000100:00100000:2.0:1746065148.839617:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1284 00000100:00100000:2.0:1746065148.839623:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263461504:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065148.851472:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263461504:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11840us (11995us total) trans 21474840899 rc 0/0 00000100:00100000:0.0:1746065148.851483:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1284 00002000:00100000:0.0:1746065148.851494:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1302528->1982463) req@ffff880090dda300 x1830881263461504/t21474840899(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/448 e 0 to 0 dl 1746065159 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065148.851503:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda300 with x1830881263461504 ext(1302528->1982463) 00010000:00010000:0.0:1746065148.851512:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 14 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746065148.851525:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 14 pid: 9549 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746065148.851532:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dda300 00000100:00100000:0.0:1746065148.856833:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.856895:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263461632 00000100:00100000:3.0:1746065148.856904:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263461632 00010000:00010000:3.0:1746065148.856934:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 14 pid: 9549 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.856985:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5845 00000100:00100000:3.0:1746065148.856993:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263461632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065148.857005:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065148.857021:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 14 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.857031:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 14 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.857049:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc146ef97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ad expref: 14 pid: 9549 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.857077:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.857078:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065148.857085:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.857092:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.857119:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065148.857130:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263313152:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065148.857212:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065148.858379:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263313152:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065148.858396:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065148.858424:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263461632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1431us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.858431:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5845 00000100:00100000:0.0:1746065148.864106:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.864214:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263461888 00000100:00100000:2.0:1746065148.864224:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263461888 00002000:00100000:2.0:1746065148.864264:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880090dd9f80 x1830881263461888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.864273:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9f80 with x1830881263461888 ext(1048576->2097151) 00002000:00010000:2.0:1746065148.864278:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9f80 00000100:00100000:3.0:1746065148.864909:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3653 00000100:00100000:3.0:1746065148.864917:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263461888:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065148.874409:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263461888:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9485us (10304us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065148.874420:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3653 00002000:00100000:3.0:1746065148.874430:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880090dd9f80 x1830881263461888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.874438:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9f80 with x1830881263461888 ext(1048576->2097151) 00002000:00010000:3.0:1746065148.874443:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9f80 00000100:00100000:0.0:1746065148.881904:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.881970:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263462144 00000100:00100000:3.0:1746065148.881981:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263462144 00002000:00100000:3.0:1746065148.882020:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880090dd9500 x1830881263462144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.882029:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9500 with x1830881263462144 ext(2097152->4194303) 00002000:00010000:3.0:1746065148.882034:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9500 00000100:00100000:3.0:1746065148.882498:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3654 00000100:00100000:3.0:1746065148.882505:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263462144:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065148.899695:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263462144:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17181us (17790us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065148.899704:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3654 00002000:00100000:3.0:1746065148.899713:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880090dd9500 x1830881263462144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.899722:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9500 with x1830881263462144 ext(2097152->4194303) 00002000:00010000:3.0:1746065148.899728:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9500 00010000:00010000:2.0:1746065148.905913:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065148.928256:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.928509:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263462400 00000100:00100000:1.0:1746065148.928517:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263462400 00000100:00100000:1.0:1746065148.928570:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13610 00000100:00100000:1.0:1746065148.928577:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+19:32155:x1830881263462400:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065148.928597:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065148.928613:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44000/0xad6b7ddc146efeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333e5 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.928675:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928687:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928696:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928707:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928712:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928718:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928830:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928839:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928844:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065148.928851:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065148.928906:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928911:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928916:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928920:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928925:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065148.928928:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928932:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928941:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065148.928943:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065148.928955:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928960:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc146eff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928981:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928985:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928990:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928993:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f45800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065148.928995:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.928999:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.929003:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5f00) 00010000:00010000:1.0:1746065148.929005:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065148.929007:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.929011:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc146eff9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065148.929038:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44000/0xad6b7ddc146efeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 22 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.929047:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 21 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065148.929053:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065148.929054:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065148.929056:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44200, rc 0) 00000100:00100000:1.0:1746065148.929095:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+21:32155:x1830881263462400:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 519us (850us total) trans 8589935941 rc 0/0 00000100:00100000:1.0:1746065148.929100:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13610 00000100:00100000:0.0:1746065148.934235:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.935310:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263462656 00000100:00100000:3.0:1746065148.935319:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263462656 00002000:00100000:3.0:1746065148.935357:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880090ddad80 x1830881263462656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.935371:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddad80 with x1830881263462656 ext(4194304->5021695) 00002000:00010000:3.0:1746065148.935376:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddad80 00000100:00100000:3.0:1746065148.935599:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3655 00000100:00100000:3.0:1746065148.935607:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263462656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065148.950803:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263462656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15188us (16570us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065148.950815:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3655 00002000:00100000:3.0:1746065148.950825:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880090ddad80 x1830881263462656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:64/0 lens 488/440 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065148.950834:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddad80 with x1830881263462656 ext(4194304->5021695) 00002000:00010000:3.0:1746065148.950839:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddad80 00000100:00100000:0.0:1746065148.956340:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.956528:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263462784 00000100:00100000:2.0:1746065148.956536:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263462784 00000100:00100000:2.0:1746065148.956569:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13050 00000100:00100000:2.0:1746065148.956575:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32155:x1830881263462784:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065148.956589:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065148.956602:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333ec expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.956626:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.956634:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 7 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.956641:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 31 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.956647:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.956648:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.956651:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [3584000->3887103] (req 3584000->3887103) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.956676:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 31 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.956686:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 31 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.956696:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263313280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.959116:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 7 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065148.959130:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 7 pid: 11461 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.959140:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263313408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.959176:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.959183:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.959194:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263313536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.959204:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065148.965923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.966545:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.966559:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.966577:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263463040 00000100:00100000:2.0:1746065148.966583:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263463040 00010000:00010000:2.0:1746065148.966614:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 32 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.966640:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263463168 00000100:00100000:2.0:1746065148.966642:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263463168 00010000:00010000:2.0:1746065148.966650:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 11 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.966662:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5846 00000100:00100000:2.0:1746065148.966667:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263463040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065148.966671:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5847 00010000:00010000:2.0:1746065148.966678:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065148.966680:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263463168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.966688:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065148.966693:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 32 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.966697:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 11 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746065148.966702:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 32 pid: 1880 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.966715:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 11 pid: 3068 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.966735:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065148.966746:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263463424 00000100:00100000:3.0:1746065148.966749:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263463424 00000100:00100000:1.0:1746065148.966787:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263463168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.966791:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13611 00000100:00100000:1.0:1746065148.966792:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5847 00000100:00100000:3.0:1746065148.966796:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+41:32157:x1830881263463424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065148.966812:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065148.966825:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333f3 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065148.966828:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.966839:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263462912 00000100:00100000:1.0:1746065148.966841:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263462912 00010000:00010000:1.0:1746065148.966851:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 8 pid: 11461 timeout: 844 lvb_type: 1 00000100:00100000:1.0:1746065148.966864:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5848 00000100:00100000:1.0:1746065148.966867:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263462912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065148.966871:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.966876:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 8 pid: 11461 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746065148.966881:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 8 pid: 11461 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746065148.966888:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065148.966898:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065148.966898:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263462912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 31us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065148.966901:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5848 00010000:00010000:3.0:1746065148.966909:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.966918:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 42 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.966923:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.966928:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.966958:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.966967:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 20 pid: 9571 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.966975:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263313664:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065148.967025:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 42 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.967032:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 42 pid: 9571 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.967039:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263313792:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.967157:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.967159:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065148.967164:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.967171:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.967191:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065148.967198:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263313920:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065148.967353:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.967360:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 8 pid: 13395 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.967369:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263314048:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065148.967523:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00010000:00010000:2.0:1746065148.967603:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146ee4e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933305 expref: 32 pid: 1880 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.968289:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065148.968512:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263313280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.968530:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc146ef43 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933375 expref: 7 pid: 11461 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746065148.968540:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263313408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.968549:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc146ee47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332fe expref: 10 pid: 3068 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.968557:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263313536:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065148.968575:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 9 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065148.968589:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856800, rc 0) 00000100:00100000:2.0:1746065148.968611:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32155:x1830881263462784:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12035us (12278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.968618:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13050 00000100:00100000:3.0:1746065148.970898:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263313664:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065148.971655:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065148.971847:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263313792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065148.972063:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065148.972191:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065148.972279:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263463552 00000100:00100000:1.0:1746065148.972284:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263463552 00010000:00010000:1.0:1746065148.972309:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 21 pid: 9571 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.972318:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263314048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065148.972330:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263463680 00000100:00100000:1.0:1746065148.972332:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263463680 00010000:00010000:3.0:1746065148.972338:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.972339:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 43 pid: 9571 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746065148.972354:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263463808 00000100:00100000:1.0:1746065148.972356:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263463808 00010000:00010000:1.0:1746065148.972363:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746065148.972369:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5849 00000100:00100000:3.0:1746065148.972376:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263463552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065148.972378:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5850 00000100:00100000:1.0:1746065148.972383:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263463680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065148.972389:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.972389:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065148.972394:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 43 pid: 9571 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.972395:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 21 pid: 9571 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.972402:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 43 pid: 9571 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746065148.972444:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5851 00000100:00100000:0.0:1746065148.972450:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263463808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065148.972457:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065148.972461:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746065148.972500:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263313920:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065148.972511:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065148.972541:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263463040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5873us (5997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065148.972548:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5846 00000100:00100000:2.0:1746065148.972592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.972653:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263464064 00000100:00100000:2.0:1746065148.972656:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263464064 00002000:00100000:2.0:1746065148.972678:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3584000->3588095) req@ffff880092747480 x1830881263464064/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.972687:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747480 with x1830881263464064 ext(3584000->3588095) 00002000:00010000:2.0:1746065148.972691:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092747480 00000100:00100000:2.0:1746065148.972701:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3656 00000100:00100000:2.0:1746065148.972706:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263464064:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:3.0:1746065148.973009:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 21 pid: 9571 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.973028:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44200/0xad6b7ddc146f000 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333e5 expref: 21 pid: 9571 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746065148.973033:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.973048:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065148.973050:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc146efb3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333b4 expref: 43 pid: 9571 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746065148.973052:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.973059:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.973063:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065148.973069:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065148.973070:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc146ef66 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933383 expref: 9 pid: 13395 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746065148.973073:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065148.973080:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00000100:00100000:3.0:1746065148.973085:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263463552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 709us (1432us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065148.973085:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00000100:00100000:3.0:1746065148.973090:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5849 00010000:00010000:0.0:1746065148.973091:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065148.973094:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065148.973100:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065148.973110:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065148.973115:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065148.973128:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065148.973221:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 44 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.973232:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 43 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065148.973237:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065148.973239:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065148.973241:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:0.0:1746065148.973256:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263463808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 805us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065148.973263:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5851 00000100:00100000:1.0:1746065148.973379:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263463680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 994us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065148.973385:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+43:32157:x1830881263463424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6588us (7470us total) trans 8589935942 rc 0/0 00000100:00100000:1.0:1746065148.973385:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5850 00000100:00100000:3.0:1746065148.973391:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13611 00000100:00100000:2.0:1746065148.973737:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263464064:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1029us (1142us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065148.973743:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3656 00002000:00100000:2.0:1746065148.973749:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3584000->3588095) req@ffff880092747480 x1830881263464064/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.973762:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747480 with x1830881263464064 ext(3584000->3588095) 00002000:00010000:2.0:1746065148.973765:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092747480 00000100:00100000:0.0:1746065148.983521:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.983611:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263464320 00000100:00100000:2.0:1746065148.983619:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263464320 00002000:00100000:2.0:1746065148.983931:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3883008->3887103) req@ffff880090ddb800 x1830881263464320/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/0 e 0 to 0 dl 1746065159 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.983943:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb800 with x1830881263464320 ext(3883008->3887103) 00002000:00010000:2.0:1746065148.983958:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090ddb800 00000100:00100000:2.0:1746065148.984008:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3657 00000100:00100000:2.0:1746065148.984019:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263464320:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065148.984704:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263464320:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 683us (1189us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065148.984712:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3657 00002000:00100000:2.0:1746065148.984719:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3883008->3887103) req@ffff880090ddb800 x1830881263464320/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746065159 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065148.984726:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb800 with x1830881263464320 ext(3883008->3887103) 00002000:00010000:2.0:1746065148.984730:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090ddb800 00000100:00100000:0.0:1746065148.987098:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065148.987192:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263464576 00000100:00100000:2.0:1746065148.987203:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263464576 00000100:00100000:2.0:1746065148.991053:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4907 00000100:00100000:2.0:1746065148.991070:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+20:32155:x1830881263464576:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065148.991598:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+21:32155:x1830881263464576:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 533us (4504us total) trans 8589935943 rc 0/0 00000100:00100000:2.0:1746065148.991609:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4907 00000100:00100000:0.0:1746065149.030859:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.030906:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.030992:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263464704 00000100:00100000:2.0:1746065149.030999:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263464704 00000100:00100000:2.0:1746065149.031049:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263464832 00000100:00100000:2.0:1746065149.031052:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263464832 00000100:00100000:2.0:1746065149.031068:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13051 00000100:00100000:2.0:1746065149.031075:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263464704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.031090:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.031105:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9333fa expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.031126:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.031127:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.031135:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.031149:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.031157:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856400, rc 0) 00000100:00100000:2.0:1746065149.031193:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263464704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 118us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.031198:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13051 00000100:00100000:2.0:1746065149.031214:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13052 00000100:00100000:2.0:1746065149.031218:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263464832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.031224:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.031233:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146f031 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933401 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.031263:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263314176:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065149.031311:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065149.031683:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065149.031686:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065149.032099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.032192:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263464960 00000100:00100000:3.0:1746065149.032196:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263464960 00000100:00080000:0.0:1746065149.032815:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065149.033009:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13053 00000100:00100000:3.0:1746065149.033017:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:32157:x1830881263464960:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065149.033026:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.033036:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933408 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.033055:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.033063:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.033068:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.033070:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.033073:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2224128->2797567] (req 2224128->2797567) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.033092:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.033102:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.033111:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263314304:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.034912:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.034925:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 13 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.034934:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263314432:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.034984:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00002000:00010000:2.0:1746065149.041505:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065148 -> 1746065149 00002000:00010000:2.0:1746065149.041511:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065148 -> 1746065149 00002000:00010000:2.0:1746065149.041513:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065148 -> 1746065149 00000100:00100000:2.0:1746065149.041533:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263314176:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065149.041559:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146f031 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933401 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.041571:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857000/0xad6b7ddc146f031 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933401 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.041595:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857000, rc 0) 00000100:00100000:2.0:1746065149.041636:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263464832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10416us (10729us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.041643:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13052 00000100:00100000:3.0:1746065149.041893:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263314304:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.041902:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263314432:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.041918:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2224128->2797567] (req 2224128->2797567) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.041929:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c600, rc 0) 00000100:00100000:3.0:1746065149.041954:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:32157:x1830881263464960:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8930us (9848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.041959:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13053 00000100:00100000:0.0:1746065149.042471:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.042500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.042561:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263465088 00000100:00100000:2.0:1746065149.042568:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263465088 00010000:00010000:2.0:1746065149.042592:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.042611:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263465216 00000100:00100000:2.0:1746065149.042614:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263465216 00010000:00010000:2.0:1746065149.042622:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 14 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.042646:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5852 00000100:00100000:2.0:1746065149.042652:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263465088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.042665:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.042677:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.042687:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.042703:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146efdd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333d7 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.042712:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.042729:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263465088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.042734:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5852 00000100:00100000:2.0:1746065149.042744:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5853 00000100:00100000:2.0:1746065149.042749:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263465216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.042754:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.042760:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 14 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.042768:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 14 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.042805:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146efc8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c2 expref: 14 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.042812:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.043125:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.043132:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.043140:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.043166:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.043178:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263314560:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065149.046653:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.048667:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263314560:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065149.048685:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.048726:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881263465216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5975us (6224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.048736:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5853 00000100:00100000:0.0:1746065149.051630:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.052236:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263465472 00000100:00100000:1.0:1746065149.052247:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263465472 00002000:00100000:1.0:1746065149.052289:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2224128->2228223) req@ffff88012f1a7100 x1830881263465472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.052299:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7100 with x1830881263465472 ext(2224128->2228223) 00002000:00010000:1.0:1746065149.052304:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7100 00000100:00100000:1.0:1746065149.052331:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3658 00000100:00100000:1.0:1746065149.052338:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263465472:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065149.052465:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263465472:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 127us (844us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065149.052471:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3658 00002000:00100000:1.0:1746065149.052476:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2224128->2228223) req@ffff88012f1a7100 x1830881263465472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.052482:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7100 with x1830881263465472 ext(2224128->2228223) 00002000:00010000:1.0:1746065149.052485:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7100 00000100:00100000:0.0:1746065149.053236:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.053332:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263465728 00000100:00100000:3.0:1746065149.053336:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263465728 00002000:00100000:3.0:1746065149.053354:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012f1a7b80 x1830881263465728/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.053362:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881263465728 ext(1048576->2097151) 00002000:00010000:3.0:1746065149.053365:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7b80 00000100:00100000:3.0:1746065149.053376:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3659 00000100:00100000:3.0:1746065149.053380:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263465728:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065149.067712:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.067747:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.067819:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263465984 00000100:00100000:1.0:1746065149.067826:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263465984 00002000:00100000:1.0:1746065149.067861:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2793472->2797567) req@ffff88012f1a7480 x1830881263465984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.067870:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7480 with x1830881263465984 ext(2793472->2797567) 00002000:00010000:1.0:1746065149.067875:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7480 00000100:00100000:1.0:1746065149.067901:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3660 00000100:00100000:1.0:1746065149.067907:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263465984:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065149.068023:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263465984:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 115us (318us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065149.068028:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3660 00002000:00100000:1.0:1746065149.068034:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2793472->2797567) req@ffff88012f1a7480 x1830881263465984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.068040:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7480 with x1830881263465984 ext(2793472->2797567) 00002000:00010000:1.0:1746065149.068043:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7480 00000100:00100000:3.0:1746065149.068155:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263466112 00000100:00100000:3.0:1746065149.068159:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263466112 00000100:00100000:3.0:1746065149.068186:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13612 00000100:00100000:3.0:1746065149.068191:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32163:x1830881263466112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065149.068205:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.068218:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146f03f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93340f expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.068259:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.068270:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.068281:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.068291:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.068296:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.068301:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.068350:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.068358:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 41 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.068364:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.068385:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 41 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.068394:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 41 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.068408:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263314688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.068457:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988463c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065149.068839:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065149.076734:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263314688:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.076758:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065149.077296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.077380:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263466240 00000100:00100000:2.0:1746065149.077386:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263466240 00010000:00010000:2.0:1746065149.077425:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 42 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.077456:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5854 00000100:00100000:2.0:1746065149.077462:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263466240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.077471:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.077477:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 42 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.077486:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 42 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.077504:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f01c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333f3 expref: 42 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.077518:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065149.077522:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077530:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077536:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077549:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.077578:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263466240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.077584:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5854 00010000:00010000:2.0:1746065149.077605:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077613:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065149.077651:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065149.077654:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065149.077667:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077675:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077682:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077687:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077692:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077697:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065149.077700:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077705:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077712:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065149.077714:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.077716:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077721:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146f046 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077728:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077732:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077736:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077739:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065149.077741:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077745:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077749:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2ae00) 00010000:00010000:2.0:1746065149.077750:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065149.077752:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077756:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047e00/0xad6b7ddc146f04d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.077799:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146f03f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.077810:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.077815:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065149.077817:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065149.077819:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046800, rc 0) 00000100:00100000:2.0:1746065149.077842:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32163:x1830881263466112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9650us (10093us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.077847:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13612 00000100:00080000:0.0:1746065149.078689:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065149.079073:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263465728:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25690us (25836us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065149.079081:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3659 00002000:00100000:3.0:1746065149.079087:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012f1a7b80 x1830881263465728/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.079096:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881263465728 ext(1048576->2097151) 00002000:00010000:3.0:1746065149.079099:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7b80 00000100:00100000:0.0:1746065149.081767:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.081824:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.081848:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.081875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.081901:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263466368 00000100:00100000:0.0:1746065149.081906:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263466368 00000100:00100000:0.0:1746065149.081939:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263466496 00000100:00100000:0.0:1746065149.081941:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263466496 00000100:00100000:0.0:1746065149.081960:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263466624 00000100:00100000:0.0:1746065149.081962:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263466624 00000100:00100000:0.0:1746065149.081969:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263466752 00000100:00100000:0.0:1746065149.081971:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263466752 00000100:00100000:0.0:1746065149.081981:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13054 00000100:00100000:0.0:1746065149.081986:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263466368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065149.081998:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.082011:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933416 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.082030:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.082032:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.082038:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.082057:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.082066:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:0.0:1746065149.082094:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263466368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 108us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.082099:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13054 00000100:00100000:0.0:1746065149.082110:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13055 00000100:00100000:0.0:1746065149.082114:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263466496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065149.082120:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.082126:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93341d expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.082135:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.082136:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.082140:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.082148:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.082154:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488800, rc 0) 00000100:00100000:0.0:1746065149.082164:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263466496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 50us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.082169:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13055 00000100:00100000:0.0:1746065149.082176:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13056 00000100:00100000:0.0:1746065149.082180:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263466624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065149.082184:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.082188:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146f069 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933424 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.082215:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263314816:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065149.082258:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.082274:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13057 00000100:00100000:0.0:1746065149.082279:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263466752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065149.082284:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.082290:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146f070 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93342b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.082309:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263314944:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065149.082324:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00080000:0.0:1746065149.082332:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065149.082335:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065149.086463:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.086513:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.086523:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263467008 00000100:00100000:2.0:1746065149.086530:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263467008 00000100:00100000:2.0:1746065149.086574:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4908 00000100:00100000:2.0:1746065149.086582:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+41:32157:x1830881263467008:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065149.086805:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+42:32157:x1830881263467008:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 222us (347us total) trans 8589935944 rc 0/0 00000100:00100000:2.0:1746065149.086811:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4908 00000100:00100000:2.0:1746065149.086887:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263314944:192.168.202.27@tcp:106: 00002000:00010000:0.0:1746065149.086887:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065148 -> 1746065149 00002000:00010000:0.0:1746065149.086890:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065147 -> 1746065149 00002000:00010000:0.0:1746065149.086892:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065148 -> 1746065149 00000100:00100000:0.0:1746065149.086903:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263314816:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065149.086913:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146f070 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93342b expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.086920:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146f069 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933424 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.086924:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc146f070 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93342b expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.086932:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539a00, rc 0) 00010000:00010000:0.0:1746065149.086934:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc146f069 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933424 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.086955:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489e00, rc 0) 00000100:00100000:2.0:1746065149.086965:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263466752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4685us (5089us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.086971:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13057 00000100:00100000:0.0:1746065149.086975:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263466624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4793us (5126us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065149.086981:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13056 00000100:00100000:2.0:1746065149.086985:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263467136 00000100:00100000:2.0:1746065149.086987:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263467136 00000100:00100000:2.0:1746065149.087001:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13058 00000100:00100000:2.0:1746065149.087010:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+13:32162:x1830881263467136:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.087017:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.087028:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933432 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.087047:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.087054:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065149.087056:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065149.087059:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.087082:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.087091:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 28 pid: 12258 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.087102:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263315072:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.087264:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.090351:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.090418:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.090451:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263467520 00000100:00100000:0.0:1746065149.090464:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263467520 00000100:00100000:0.0:1746065149.090513:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13613 00000100:00100000:0.0:1746065149.090521:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32163:x1830881263467520:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065149.090816:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263467264 00000100:00100000:3.0:1746065149.090820:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263467264 00002000:00100000:3.0:1746065149.090848:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2224128->2797567) req@ffff880097fa7100 x1830881263467264/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.090857:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa7100 with x1830881263467264 ext(2224128->2797567) 00010000:00010000:3.0:1746065149.090865:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 29 pid: 12258 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.090929:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263315072:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.090957:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.090969:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856a00, rc 0) 00000100:00100000:2.0:1746065149.091014:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+14:32162:x1830881263467136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4003us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.091023:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13058 00010000:00010000:3.0:1746065149.091112:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 29 pid: 12258 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746065149.091124:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa7100 00000100:00100000:3.0:1746065149.091146:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1285 00000100:00100000:3.0:1746065149.091153:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263467264:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:0.0:1746065149.091563:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.091577:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f07e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933439 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.091650:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065149.091663:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.091680:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065149.091705:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.091714:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 10 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.091725:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263315200:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.091825:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.096228:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.096298:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263315200:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.096316:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:3.0:1746065149.096908:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263467648 00000100:00100000:3.0:1746065149.096914:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263467648 00010000:00010000:3.0:1746065149.096939:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 11 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.096980:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5855 00000100:00100000:3.0:1746065149.096987:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263467648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.096998:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.097002:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 11 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.097010:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 11 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.097028:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc146f054 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93340f expref: 11 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.097041:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.097045:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.097054:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.097062:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.097076:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.097107:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263467648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 121us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.097113:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5855 00010000:00010000:1.0:1746065149.097318:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065149.097324:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065149.097341:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065149.097447:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f07e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.097464:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.097469:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065149.097471:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065149.097473:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539800, rc 0) 00000100:00100000:1.0:1746065149.097512:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32163:x1830881263467520:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6992us (7167us total) trans 8589935945 rc 0/0 00000100:00100000:1.0:1746065149.097518:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13613 00000100:00100000:0.0:1746065149.099405:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263467264:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 8247us (8982us total) trans 21474840900 rc 0/0 00000100:00100000:0.0:1746065149.099414:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1285 00002000:00100000:0.0:1746065149.099423:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2224128->2797567) req@ffff880097fa7100 x1830881263467264/t21474840900(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.099432:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa7100 with x1830881263467264 ext(2224128->2797567) 00010000:00010000:0.0:1746065149.099440:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 31 pid: 12258 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.099452:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 31 pid: 12258 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746065149.099458:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa7100 00000100:00100000:1.0:1746065149.102640:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.103457:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263467776 00000100:00100000:2.0:1746065149.103466:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263467776 00010000:00010000:2.0:1746065149.103497:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 31 pid: 12258 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.103538:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5856 00000100:00100000:2.0:1746065149.103546:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263467776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.103559:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.103575:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 31 pid: 12258 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.103586:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 31 pid: 12258 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.103606:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c600/0xad6b7ddc146f038 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2224128->2797567) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933408 expref: 31 pid: 12258 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.103633:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.103635:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.103642:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.103649:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.103682:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.103693:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263315328:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065149.103757:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065149.104067:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.104200:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263467904 00000100:00100000:0.0:1746065149.104205:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263467904 00000100:00100000:0.0:1746065149.104231:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13614 00000100:00100000:0.0:1746065149.104235:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32163:x1830881263467904:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065149.104252:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.104265:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f093 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933440 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.104337:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065149.104348:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.104354:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065149.104371:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.104379:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 11 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.104387:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263315456:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.104430:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.109084:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.109131:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263468032 00000100:00100000:3.0:1746065149.109138:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263468032 00010000:00010000:3.0:1746065149.109168:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746065149.110061:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5857 00000100:00100000:1.0:1746065149.110072:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263468032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.110086:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.110092:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.110105:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.110119:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263315456:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.110126:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146f085 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933439 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.110142:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065149.110152:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065149.110157:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065149.110166:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065149.110173:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00000100:00100000:3.0:1746065149.110277:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263315328:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065149.110288:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.110324:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263467776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6779us (7691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.110331:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5856 00010000:00010000:1.0:1746065149.110526:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.110544:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263468032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 476us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.110550:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5857 00010000:00010000:2.0:1746065149.110612:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.110619:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065149.110659:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065149.110663:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065149.110676:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.111085:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f093 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.111449:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.111457:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065149.111459:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065149.111462:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488a00, rc 0) 00000100:00100000:2.0:1746065149.111488:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32163:x1830881263467904:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7252us (7421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.111494:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13614 00000100:00100000:0.0:1746065149.113833:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.113883:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.113960:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263468160 00000100:00100000:2.0:1746065149.113968:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263468160 00000100:00100000:1.0:1746065149.114010:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263468288 00000100:00100000:1.0:1746065149.114015:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263468288 00000100:00100000:2.0:1746065149.114065:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13059 00000100:00100000:2.0:1746065149.114073:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263468160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065149.114086:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.114100:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933447 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.114117:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.114119:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.114126:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.114137:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.114145:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856600, rc 0) 00000100:00100000:2.0:1746065149.114178:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263468160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 106us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.114183:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13059 00000100:00100000:2.0:1746065149.114196:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13060 00000100:00100000:2.0:1746065149.114201:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263468288:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065149.114208:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.114217:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856200/0xad6b7ddc146f0a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93344e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.114247:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263315584:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065149.115135:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.115707:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.116084:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263468544 00000100:00100000:2.0:1746065149.116090:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263468544 00002000:00100000:2.0:1746065149.116122:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097fa6680 x1830881263468544/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.116131:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa6680 with x1830881263468544 ext(2097152->4194303) 00002000:00010000:2.0:1746065149.116135:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa6680 00000100:00100000:2.0:1746065149.116150:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3661 00000100:00100000:2.0:1746065149.116156:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263468544:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065149.117441:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263315584:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065149.117471:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856200/0xad6b7ddc146f0a8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93344e expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.117482:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856200/0xad6b7ddc146f0a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93344e expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.117597:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856200, rc 0) 00000100:00100000:3.0:1746065149.117653:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263468288:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3449us (3768us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065149.117661:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13060 00000100:00100000:0.0:1746065149.122132:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.122818:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263468800 00000100:00100000:2.0:1746065149.122827:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263468800 00000100:00100000:2.0:1746065149.122876:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13615 00000100:00100000:2.0:1746065149.122883:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32163:x1830881263468800:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065149.122899:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.123010:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933455 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.123089:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.123100:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.123109:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065149.123120:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065149.123204:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 13 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.123232:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.123240:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065149.123242:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065149.123244:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:2.0:1746065149.123292:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32163:x1830881263468800:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 410us (1169us total) trans 8589935946 rc 0/0 00000100:00100000:2.0:1746065149.123298:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13615 00000100:00100000:1.0:1746065149.128459:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.128566:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263469056 00000100:00100000:2.0:1746065149.128574:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263469056 00000100:00080000:3.0:1746065149.128642:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065149.128802:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13616 00000100:00100000:2.0:1746065149.128811:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+21:32166:x1830881263469056:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065149.128831:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.128847:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146f0c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93345c expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.128928:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.128940:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.128961:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.128967:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.128993:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.129002:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 11 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.129012:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263315712:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.129084:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.129091:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 11 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.129097:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263315840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.129116:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.133216:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.133470:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263469184 00000100:00100000:1.0:1746065149.133477:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263469184 00000100:00100000:2.0:1746065149.133507:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263315712:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.133511:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.133517:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263315840:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.133537:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065149.133548:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5858 00000100:00100000:1.0:1746065149.133555:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263469184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.133569:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.133574:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.133581:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.133600:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f09a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933440 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.133622:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065149.133626:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065149.133633:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065149.133638:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.133670:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263469184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.133675:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5858 00000100:00100000:0.0:1746065149.133902:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.133924:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.133958:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263469440 00000100:00100000:0.0:1746065149.133961:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263469440 00000100:00100000:0.0:1746065149.133983:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13617 00000100:00100000:0.0:1746065149.133989:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32163:x1830881263469440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065149.134006:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.134016:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146f0d2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933463 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.134054:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146f0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933463 expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.134064:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146f0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933463 expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.134072:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263469312 00000100:00100000:3.0:1746065149.134076:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263469312 00010000:00010000:0.0:1746065149.134077:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065149.134079:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065149.134081:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00010000:00010000:3.0:1746065149.134088:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 13 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.134100:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:32163:x1830881263469440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 111us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.134101:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5859 00000100:00100000:0.0:1746065149.134105:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13617 00000100:00100000:3.0:1746065149.134106:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263469312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.134112:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.134115:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.134122:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.134131:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f0b6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933455 expref: 12 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.134149:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.134152:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.134157:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.134162:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.134178:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.134200:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263469312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.134205:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5859 00010000:00010000:2.0:1746065149.134207:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.134213:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065149.134227:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065149.134315:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc146f0c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.134339:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.134348:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065149.134350:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065149.134351:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:2.0:1746065149.134375:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+23:32166:x1830881263469056:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5566us (5922us total) trans 8589935947 rc 0/0 00000100:00100000:2.0:1746065149.134379:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13616 00000100:00100000:2.0:1746065149.134857:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263468544:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18699us (19149us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065149.134864:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3661 00002000:00100000:2.0:1746065149.134870:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097fa6680 x1830881263468544/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.134878:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa6680 with x1830881263468544 ext(2097152->4194303) 00002000:00010000:2.0:1746065149.134882:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa6680 00000100:00100000:0.0:1746065149.139199:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.139340:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.139372:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.139398:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.139412:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.139413:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263469568 00000100:00100000:2.0:1746065149.139422:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263469568 00000100:00100000:2.0:1746065149.139551:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263469696 00000100:00100000:3.0:1746065149.139553:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263469952 00000100:00100000:2.0:1746065149.139554:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263469696 00000100:00100000:3.0:1746065149.139556:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263469952 00000100:00100000:2.0:1746065149.139569:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263470208 00000100:00100000:2.0:1746065149.139571:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263470208 00000100:00100000:0.0:1746065149.139681:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.140407:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263469824 00000100:00100000:0.0:1746065149.140408:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263470080 00000100:00100000:2.0:1746065149.140410:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263469824 00000100:00100000:0.0:1746065149.140411:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263470080 00000100:00100000:3.0:1746065149.140427:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13061 00000100:00100000:3.0:1746065149.140436:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263469568:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:2.0:1746065149.140436:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13062 00000100:00100000:2.0:1746065149.140440:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263469696:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:0.0:1746065149.140441:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13063 00000100:00100000:0.0:1746065149.140447:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263469952:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065149.140467:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.140467:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.140467:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.140481:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.140481:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 8 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.140481:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.140488:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140488:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.140488:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140494:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.140494:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 13 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.140495:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.140500:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.140500:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.140500:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.140501:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.140501:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.140501:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.140504:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.140504:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.140504:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.140525:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140525:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.140526:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 13 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140535:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 30 pid: 9549 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.140537:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 29 pid: 9549 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746065149.140541:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 13 pid: 9549 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.140546:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263316096:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.140546:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263316224:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.140549:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263315968:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.140593:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13064 00000100:00100000:1.0:1746065149.140600:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263470208:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065149.140611:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140618:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 10 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.140618:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.140625:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263316352:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.140626:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.140632:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.140638:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.140643:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746065149.140644:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746065149.140646:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.140659:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.140666:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 8 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746065149.140679:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263316480:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.140756:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140761:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 8 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.140764:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 14 pid: 13375 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746065149.140765:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140768:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 8 pid: 9548 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.140784:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263316608:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.140787:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263316736:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065149.140792:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 14 pid: 9548 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746065149.140800:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263316864:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.140811:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13065 00000100:00100000:2.0:1746065149.140815:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263469824:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065149.140816:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.140823:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 13 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.140829:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263316992:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.140829:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.140837:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 30 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140843:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065149.140846:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988463c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065149.140852:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 8 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140857:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.140858:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.140860:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.140866:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13066 00000100:00100000:3.0:1746065149.140870:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263470080:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065149.140872:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 8 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140879:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 8 pid: 1880 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.140883:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.140885:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263317120:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.140895:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.140902:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.140902:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.140907:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.140908:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.140909:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 10 pid: 3068 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.140910:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.140916:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263317248:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.140921:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.140927:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 14 pid: 11461 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.140929:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 30 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065149.140934:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263317376:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.140939:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.140961:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263317504:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065149.141655:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.141665:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 29 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.141674:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263317632:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.142686:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.142695:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 13 pid: 11461 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.142698:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.142702:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263317760:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.142724:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065149.142754:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00010000:00010000:0.0:1746065149.142767:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.142788:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 30 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.142795:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263317888:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065149.142833:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 8 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.142840:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 8 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.142851:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263318016:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.142866:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.143215:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.147893:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263316096:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.148375:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263316224:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.153064:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.153095:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.153874:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263470336 00000100:00100000:1.0:1746065149.153885:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263470336 00010000:00010000:1.0:1746065149.153914:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 30 pid: 9549 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.153938:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263470464 00000100:00100000:1.0:1746065149.153940:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263470464 00010000:00010000:1.0:1746065149.153964:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 31 pid: 9549 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.153978:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5860 00000100:00100000:1.0:1746065149.153983:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263470336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.153993:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.154008:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 30 pid: 9549 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.154017:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 30 pid: 9549 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746065149.154030:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065149.154035:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc146ef74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93338a expref: 30 pid: 9549 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746065149.154043:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065149.154056:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.154146:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263316352:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.154433:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263470336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 448us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.154439:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5860 00000100:00100000:1.0:1746065149.154453:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263470592 00000100:00100000:1.0:1746065149.154455:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263470592 00010000:00010000:1.0:1746065149.154465:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 11 pid: 9548 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.154475:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263470720 00000100:00100000:1.0:1746065149.154477:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263470720 00010000:00010000:1.0:1746065149.154485:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 14 pid: 9549 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.154494:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5861 00000100:00100000:1.0:1746065149.154498:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263470464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.154504:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.154514:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 31 pid: 9549 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.154521:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 31 pid: 9549 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.154532:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc146efcf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333c9 expref: 31 pid: 9549 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.154540:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.155185:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5862 00000100:00100000:3.0:1746065149.155195:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5863 00000100:00100000:3.0:1746065149.155201:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263470720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.155209:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.155219:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 14 pid: 9549 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.155228:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 14 pid: 9549 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.155239:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1746065149.155571:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065149.155745:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263470464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1245us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.155752:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5861 00000100:00100000:3.0:1746065149.157907:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263470720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2697us (3852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.157917:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5863 00000100:00100000:2.0:1746065149.157978:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.157994:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.157998:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263316608:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.158008:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263470848 00000100:00100000:2.0:1746065149.158008:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263470976 00000100:00100000:3.0:1746065149.158012:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263470848 00000100:00100000:2.0:1746065149.158012:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263470976 00010000:00010000:3.0:1746065149.158032:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 15 pid: 13375 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.158038:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13067 00000100:00100000:2.0:1746065149.158043:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+9:32162:x1830881263470976:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065149.158049:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5864 00000100:00100000:3.0:1746065149.158052:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263470848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.158054:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.158062:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.158066:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93346a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.158076:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 15 pid: 13375 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158082:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.158085:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 15 pid: 13375 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158085:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.158091:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065149.158094:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.158098:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146ef7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933391 expref: 15 pid: 13375 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.158111:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065149.158112:0:13375:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.158122:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.158128:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad000, rc 0) 00000100:00100000:3.0:1746065149.158138:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263470848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.158140:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+10:32162:x1830881263470976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 98us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.158143:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5864 00000100:00100000:2.0:1746065149.158144:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13067 00000100:00100000:3.0:1746065149.158159:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263470592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.158165:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.158176:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 11 pid: 9548 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.158183:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263316736:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.158185:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 11 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.158195:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc146f05b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933416 expref: 11 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.158202:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065149.158203:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.158215:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263470592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3025us (4185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.158223:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5862 00000100:00100000:2.0:1746065149.158251:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263317120:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.158259:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263316992:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.158272:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.158273:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263317248:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.158297:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.158309:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.158310:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263471232 00000100:00100000:3.0:1746065149.158312:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263471232 00000100:00100000:2.0:1746065149.158330:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.158353:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263317504:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.158366:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.158407:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.158418:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263471488 00000100:00100000:2.0:1746065149.158421:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263471488 00010000:00010000:2.0:1746065149.158433:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 14 pid: 11461 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.158444:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263471360 00000100:00100000:2.0:1746065149.158446:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263471360 00010000:00010000:2.0:1746065149.158453:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 10 pid: 3068 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.158460:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263471744 00000100:00100000:2.0:1746065149.158461:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263471744 00010000:00010000:2.0:1746065149.158468:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.158476:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5865 00000100:00100000:2.0:1746065149.158480:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263471488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.158486:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.158495:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 14 pid: 11461 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158502:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 14 pid: 11461 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158512:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.158526:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263471488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.158530:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5865 00000100:00100000:2.0:1746065149.158539:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5866 00000100:00100000:2.0:1746065149.158542:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263471360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.158547:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.158554:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 10 pid: 3068 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158560:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 10 pid: 3068 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158570:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc146ef2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933360 expref: 10 pid: 3068 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158581:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.158595:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263471360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.158599:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5866 00000100:00100000:2.0:1746065149.158607:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5867 00000100:00100000:2.0:1746065149.158611:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263471744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.158616:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.158621:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158628:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158637:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc146ece9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933241 expref: 30 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.158644:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.158653:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263471744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.158657:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5867 00000100:00100000:2.0:1746065149.158692:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.158702:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263471872 00000100:00100000:2.0:1746065149.158705:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263471872 00010000:00010000:2.0:1746065149.158714:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 29 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.158725:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5868 00000100:00100000:2.0:1746065149.158729:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263471872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.158734:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.158741:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 29 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.158748:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 29 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.158758:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.158768:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263471872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.158794:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5868 00000100:00100000:2.0:1746065149.158832:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.158852:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.158860:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263472256 00000100:00100000:2.0:1746065149.158862:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263472256 00010000:00010000:2.0:1746065149.158870:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 29 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.158881:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5869 00000100:00100000:2.0:1746065149.158885:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263472256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.158891:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.158898:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 29 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.158905:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 29 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.158915:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.158925:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263472256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.158930:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5869 00000100:00100000:2.0:1746065149.158967:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.158977:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263471616 00000100:00100000:2.0:1746065149.158979:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263471616 00010000:00010000:2.0:1746065149.158989:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 11 pid: 9548 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.159006:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5870 00000100:00100000:2.0:1746065149.159010:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263471616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.159016:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.159022:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 11 pid: 9548 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.159030:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 11 pid: 9548 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.159041:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146ef90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333a6 expref: 11 pid: 9548 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.159049:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.159050:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.159054:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159061:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159074:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.159083:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263471616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.159088:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5870 00010000:00010000:2.0:1746065149.159102:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159113:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159127:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159133:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159139:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159144:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065149.159146:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159153:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159160:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.159166:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857c00/0xad6b7ddc146f0e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.159193:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263469696:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 18752us (19852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.159199:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13062 00010000:00010000:1.0:1746065149.159227:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856400/0xad6b7ddc146f02a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333fa expref: 13 pid: 9549 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.159236:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263315968:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.160026:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.160046:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.160056:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263472384 00000100:00100000:2.0:1746065149.160060:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263472384 00010000:00010000:2.0:1746065149.160072:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 13 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.160085:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263471104 00000100:00100000:2.0:1746065149.160086:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263471104 00010000:00010000:2.0:1746065149.160094:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 14 pid: 9548 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.160103:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5871 00000100:00100000:2.0:1746065149.160108:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2005:x1830881263472384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.160115:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.160125:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 13 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.160133:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 13 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.160145:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146ef19 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93334b expref: 13 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.160155:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.160156:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.160160:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.160167:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.160236:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263316864:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.160245:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263316480:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.160246:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc146efe4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333de expref: 28 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746065149.160255:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263317632:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065149.160255:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146ee24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332db expref: 28 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.160273:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.160292:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5872 00000100:00100000:1.0:1746065149.160298:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263471104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.160304:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.160312:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 14 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.160318:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 14 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.160328:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f062 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93341d expref: 14 pid: 9548 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.160334:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.160335:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.160338:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160343:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160354:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.160370:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263471104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.160375:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5872 00010000:00010000:1.0:1746065149.160388:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160393:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160403:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160408:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160414:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160418:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835da00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065149.160420:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160425:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160436:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.160441:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc146f0ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.160462:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263469952:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 20017us (21090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.160467:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13063 00010000:00010000:3.0:1746065149.160562:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 9 pid: 1880 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.160578:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5873 00000100:00100000:3.0:1746065149.160582:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263471232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.160588:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.160596:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 9 pid: 1880 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.160603:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 9 pid: 1880 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.160612:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc146ed60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933287 expref: 9 pid: 1880 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.160619:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.160620:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.160623:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160631:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160645:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.160658:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263471232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.160663:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5873 00010000:00010000:3.0:1746065149.160690:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160696:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160705:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160710:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160715:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160720:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd3a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065149.160722:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160731:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160739:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.160743:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc146f0fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.160769:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263469824:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 19953us (21356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.160788:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13065 00010000:00010000:3.0:1746065149.160817:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856600/0xad6b7ddc146f0a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933447 expref: 11 pid: 11461 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.160824:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263317376:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.160833:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263317760:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.160842:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.162027:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263317888:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.162046:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263318016:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065149.162062:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.162092:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263472000 00000100:00100000:0.0:1746065149.162097:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263472000 00002000:00100000:0.0:1746065149.162122:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3584000->3887103) req@ffff880092744380 x1830881263472000/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.162129:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744380 with x1830881263472000 ext(3584000->3887103) 00010000:00010000:0.0:1746065149.162134:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 8 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.162146:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 8 pid: 9549 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746065149.162151:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092744380 00000100:00100000:0.0:1746065149.162168:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1286 00000100:00100000:0.0:1746065149.162174:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263472000:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:2.0:1746065149.162226:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.162247:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263472384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2138us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.162255:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5871 00000100:00100000:1.0:1746065149.162884:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.163158:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263472128 00000100:00100000:2.0:1746065149.163163:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263472128 00010000:00010000:2.0:1746065149.163177:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 10 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.163195:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5874 00000100:00100000:2.0:1746065149.163200:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263472128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.163207:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.163215:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 10 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.163224:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 10 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.163239:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc146ee32 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332e9 expref: 10 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.163250:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065149.163300:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.163308:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.163333:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.163339:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.163345:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.163350:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065149.163352:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.163358:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.163368:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.163373:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc146f0e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.163470:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263472128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 266us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.163476:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5874 00000100:00100000:3.0:1746065149.163733:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263469568:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 23297us (24540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.163740:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13061 00000100:00100000:0.0:1746065149.164365:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.164402:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263472512 00000100:00100000:3.0:1746065149.164407:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263472512 00010000:00010000:3.0:1746065149.164423:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 12 pid: 11461 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.164449:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5875 00000100:00100000:3.0:1746065149.164455:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263472512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.164464:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.164476:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 12 pid: 11461 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.164484:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 12 pid: 11461 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.164496:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc146f077 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933432 expref: 12 pid: 11461 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.164505:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.164507:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.164511:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164518:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164536:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.164554:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263472512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.164559:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5875 00010000:00010000:3.0:1746065149.164575:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164581:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164593:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164603:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164608:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164613:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065149.164616:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164622:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164630:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.164635:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc146f103 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.164670:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263470080:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 23799us (24989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.164676:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13066 00000100:00100000:2.0:1746065149.167014:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263472000:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4832us (8173us total) trans 17179873451 rc 0/0 00000100:00100000:2.0:1746065149.167024:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1286 00002000:00100000:2.0:1746065149.167033:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3584000->3887103) req@ffff880092744380 x1830881263472000/t17179873451(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.167043:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744380 with x1830881263472000 ext(3584000->3887103) 00010000:00010000:2.0:1746065149.167052:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 9 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.167064:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 9 pid: 9549 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746065149.167069:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092744380 00000100:00100000:0.0:1746065149.168834:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.168962:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263472640 00000100:00100000:1.0:1746065149.168971:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263472640 00010000:00010000:1.0:1746065149.169007:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 9 pid: 9549 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746065149.169045:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5876 00000100:00100000:1.0:1746065149.169426:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263472640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.169440:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.169461:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 9 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.169472:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 9 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.169491:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856800/0xad6b7ddc146f00e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3584000->18446744073709551615] (req 3584000->3887103) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9333ec expref: 9 pid: 9549 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.169511:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.169513:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.169516:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.169524:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.169545:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.169583:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263472640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 160us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.169588:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5876 00010000:00010000:0.0:1746065149.169715:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169723:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169741:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169747:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169753:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169759:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065149.169762:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169769:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169805:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.169806:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.169813:0:9548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169819:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.169850:0:9548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.169862:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263318144:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065149.169986:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.176058:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263318144:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065149.176083:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.176092:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146f0f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.176162:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2005:x1830881263470208:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 35560us (36761us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.176170:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13064 00000100:00100000:0.0:1746065149.183298:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.183367:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263472896 00000100:00100000:2.0:1746065149.183376:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263472896 00002000:00100000:2.0:1746065149.183418:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff8800900f1880 x1830881263472896/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.183428:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1880 with x1830881263472896 ext(3145728->4194303) 00002000:00010000:2.0:1746065149.183436:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1880 00000100:00100000:2.0:1746065149.183455:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3662 00000100:00100000:2.0:1746065149.183462:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263472896:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065149.183856:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.184739:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263473152 00000100:00100000:3.0:1746065149.184745:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263473152 00000100:00100000:3.0:1746065149.184812:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13618 00000100:00100000:3.0:1746065149.184822:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32163:x1830881263473152:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065149.185443:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.185467:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc146f0d2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933463 expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.185498:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.185502:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.185556:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32163:x1830881263473152:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 734us (1699us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746065149.185562:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13618 00000100:00100000:0.0:1746065149.191067:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.191144:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263473408 00000100:00100000:2.0:1746065149.191152:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263473408 00000100:00100000:2.0:1746065149.191191:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4909 00000100:00100000:2.0:1746065149.191198:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32163:x1830881263473408:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065149.192239:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32163:x1830881263473408:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1036us (1176us total) trans 8589935948 rc 0/0 00000100:00100000:2.0:1746065149.192249:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4909 00000100:00100000:3.0:1746065149.193090:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263472896:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9626us (9798us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065149.193098:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3662 00002000:00100000:3.0:1746065149.193106:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff8800900f1880 x1830881263472896/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.193114:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1880 with x1830881263472896 ext(3145728->4194303) 00002000:00010000:3.0:1746065149.193118:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1880 00000100:00100000:0.0:1746065149.193744:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.194100:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263473664 00000100:00100000:2.0:1746065149.194107:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263473664 00000100:00100000:2.0:1746065149.194140:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4910 00000100:00100000:2.0:1746065149.194147:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32163:x1830881263473664:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065149.194281:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32163:x1830881263473664:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 134us (539us total) trans 8589935949 rc 0/0 00000100:00100000:2.0:1746065149.194287:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4910 00000100:00100000:2.0:1746065149.198283:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.200049:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.200084:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.200098:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.200113:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.200132:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263473792 00000100:00100000:2.0:1746065149.200140:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.200141:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263473792 00000100:00100000:1.0:1746065149.200421:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263473920 00000100:00100000:1.0:1746065149.200425:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263473920 00000100:00100000:2.0:1746065149.200432:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.200444:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263474176 00000100:00100000:1.0:1746065149.200444:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263474048 00000100:00100000:1.0:1746065149.200445:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263474048 00000100:00100000:2.0:1746065149.200446:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263474176 00000100:00100000:1.0:1746065149.200453:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263474304 00000100:00100000:1.0:1746065149.200455:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263474304 00000100:00100000:2.0:1746065149.200458:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263474432 00000100:00100000:2.0:1746065149.200459:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263474432 00000100:00100000:1.0:1746065149.200462:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263474560 00000100:00100000:1.0:1746065149.200463:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263474560 00000100:00100000:2.0:1746065149.200467:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13068 00000100:00100000:1.0:1746065149.200473:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13069 00000100:00100000:2.0:1746065149.200474:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263473792:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065149.200477:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263473920:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.200489:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.200489:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.200505:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933471 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.200505:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933478 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065149.200523:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6fc, atime: 0x6812d6fc, ctime: 0x6812d6fc, blocks: 0x7f8 00002000:00010000:1.0:1746065149.200523:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6fc, atime: 0x6812d6fc, ctime: 0x6812d6fc, blocks: 0x808 00010000:00010000:2.0:1746065149.200539:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.200539:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.200540:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.200540:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.200547:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.200547:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.200560:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.200560:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.200569:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00010000:00010000:1.0:1746065149.200569:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9c00, rc 0) 00000100:00100000:1.0:1746065149.200602:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263473920:12345-192.168.202.27@tcp:101:cat.0 Request processed in 124us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.200605:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263473792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 133us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.200607:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13069 00000100:00100000:2.0:1746065149.200610:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13068 00000100:00100000:2.0:1746065149.200619:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13070 00000100:00100000:1.0:1746065149.200622:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13071 00000100:00100000:2.0:1746065149.200624:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263474048:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065149.200626:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263474176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.200629:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.200630:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.200635:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93347f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.200635:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933486 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065149.200644:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6f8, atime: 0x6812d6f6, ctime: 0x6812d6f8, blocks: 0x800 00002000:00010000:1.0:1746065149.200644:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6fc, atime: 0x6812d6fc, ctime: 0x6812d6fc, blocks: 0x808 00010000:00010000:2.0:1746065149.200650:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.200650:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.200651:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.200651:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.200654:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.200654:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.200662:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.200662:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.200668:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abade00, rc 0) 00010000:00010000:1.0:1746065149.200673:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9600, rc 0) 00000100:00100000:2.0:1746065149.200682:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263474048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 57us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.200683:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263474176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.200686:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13070 00000100:00100000:1.0:1746065149.200688:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13071 00000100:00100000:2.0:1746065149.200694:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13072 00000100:00100000:1.0:1746065149.200697:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13073 00000100:00100000:1.0:1746065149.200701:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263474432:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065149.200705:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263474304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065149.200705:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.200710:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.200711:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933494 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.200715:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93348d expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.200718:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.200720:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746065149.200723:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d6fd, atime: 0x6812d6fb, ctime: 0x6812d6fd, blocks: 0x1650 00010000:00010000:1.0:1746065149.200723:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.200728:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.200729:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.200730:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.200732:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.200736:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9a00, rc 0) 00010000:00010000:2.0:1746065149.200739:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.200745:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:1.0:1746065149.200747:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263474432:12345-192.168.202.27@tcp:101:cat.0 Request processed in 47us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.200751:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13073 00000100:00100000:2.0:1746065149.200755:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263474304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 49us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.200759:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13072 00000100:00100000:1.0:1746065149.200761:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13074 00000100:00100000:1.0:1746065149.200765:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263474560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065149.200788:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.200794:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93349b expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.200797:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065149.200803:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.200804:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.200808:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065149.200812:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263474816 00000100:00100000:2.0:1746065149.200814:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263474816 00010000:00010000:1.0:1746065149.200815:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.200821:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8000, rc 0) 00000100:00100000:2.0:1746065149.200829:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13075 00000100:00100000:2.0:1746065149.200833:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263474816:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065149.200834:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263474560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.200838:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13074 00010000:00010000:2.0:1746065149.200839:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.200844:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334a9 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.200853:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.200854:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065149.201145:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.201172:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.201177:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263474688 00000100:00100000:3.0:1746065149.201183:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263474688 00000100:00100000:0.0:1746065149.201198:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.201206:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263474944 00000100:00100000:3.0:1746065149.201209:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263474944 00000100:00100000:0.0:1746065149.201210:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263475072 00000100:00100000:0.0:1746065149.201213:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263475072 00000100:00100000:3.0:1746065149.201230:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13076 00000100:00100000:3.0:1746065149.201237:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263474688:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.201248:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.201257:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334a2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.201264:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13077 00000100:00100000:0.0:1746065149.201270:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263474944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.201271:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.201273:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.201276:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.201280:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.201282:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334b0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.201290:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.201291:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.201291:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.201295:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.201298:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee600, rc 0) 00010000:00010000:0.0:1746065149.201303:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.201309:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45800, rc 0) 00000100:00100000:3.0:1746065149.201318:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263474688:12345-192.168.202.27@tcp:101:cat.0 Request processed in 81us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.201321:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263474944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.201324:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13076 00000100:00100000:0.0:1746065149.201327:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13077 00000100:00100000:0.0:1746065149.201336:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13078 00000100:00100000:0.0:1746065149.201340:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263475072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065149.201344:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.201348:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334b7 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.201356:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.201357:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.201359:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.201370:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.201375:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44000, rc 0) 00000100:00100000:0.0:1746065149.201384:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263475072:12345-192.168.202.27@tcp:101:cat.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.201388:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13078 00010000:00010000:2.0:1746065149.201430:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.201440:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.201450:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:2.0:1746065149.201462:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263474816:12345-192.168.202.27@tcp:101:cat.0 Request processed in 629us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.201467:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13075 00000100:00100000:0.0:1746065149.208664:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.208755:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263475328 00000100:00100000:3.0:1746065149.208764:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263475328 00002000:00100000:3.0:1746065149.208831:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff8800900f2d80 x1830881263475328/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.208841:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2d80 with x1830881263475328 ext(4194304->5021695) 00002000:00010000:3.0:1746065149.208846:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f2d80 00000100:00100000:3.0:1746065149.208866:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3663 00000100:00100000:3.0:1746065149.208874:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263475328:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065149.213325:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.213671:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.213876:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263475584 00000100:00100000:2.0:1746065149.213884:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263475584 00002000:00100000:2.0:1746065149.213919:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800900f0380 x1830881263475584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.213929:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0380 with x1830881263475584 ext(0->1048575) 00002000:00010000:2.0:1746065149.213934:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0380 00000100:00100000:2.0:1746065149.213967:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263475840 00000100:00100000:2.0:1746065149.213969:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263475840 00002000:00100000:2.0:1746065149.213982:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012f09d180 x1830881263475840/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.213989:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881263475840 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.213991:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d180 00000100:00100000:2.0:1746065149.214012:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3664 00000100:00100000:2.0:1746065149.214019:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263475584:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065149.214632:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3665 00000100:00100000:2.0:1746065149.214638:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263475840:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065149.219371:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.219406:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.219458:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263476096 00000100:00100000:3.0:1746065149.219466:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263476096 00002000:00100000:3.0:1746065149.219510:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009a6df800 x1830881263476096/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.219520:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df800 with x1830881263476096 ext(1048576->2097151) 00002000:00010000:3.0:1746065149.219525:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6df800 00000100:00100000:3.0:1746065149.219540:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263476352 00000100:00100000:3.0:1746065149.219543:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263476352 00002000:00100000:3.0:1746065149.219554:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009a6dca80 x1830881263476352/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.219560:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881263476352 ext(1048576->2097151) 00002000:00010000:3.0:1746065149.219563:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dca80 00000100:00100000:3.0:1746065149.219574:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3666 00000100:00100000:3.0:1746065149.219581:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263476096:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065149.219742:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263475328:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10867us (11084us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065149.219750:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3663 00002000:00100000:2.0:1746065149.219755:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff8800900f2d80 x1830881263475328/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.219762:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2d80 with x1830881263475328 ext(4194304->5021695) 00002000:00010000:2.0:1746065149.219765:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f2d80 00000100:00100000:2.0:1746065149.219795:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3667 00000100:00100000:2.0:1746065149.219801:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263476352:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065149.226574:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.226825:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263476608 00000100:00100000:3.0:1746065149.226833:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263476608 00000100:00100000:3.0:1746065149.227480:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13619 00000100:00100000:3.0:1746065149.227488:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+42:32171:x1830881263476608:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065149.227509:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.227527:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334be expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.227611:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.227624:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065149.227634:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065149.227643:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065149.227724:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 45 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.227755:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 44 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.227763:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.227765:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065149.227767:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e000, rc 0) 00000100:00100000:3.0:1746065149.227924:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+44:32171:x1830881263476608:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 436us (1358us total) trans 8589935950 rc 0/0 00000100:00100000:3.0:1746065149.227930:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13619 00000100:00100000:0.0:1746065149.233896:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263475584:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19868us (20573us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065149.233906:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3664 00002000:00100000:0.0:1746065149.233916:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800900f0380 x1830881263475584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.233925:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0380 with x1830881263475584 ext(0->1048575) 00002000:00010000:0.0:1746065149.233930:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0380 00000100:00100000:2.0:1746065149.246355:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263475840:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31708us (32676us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.246364:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3665 00002000:00100000:2.0:1746065149.246373:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88012f09d180 x1830881263475840/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.246382:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881263475840 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.246386:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d180 00000100:00100000:2.0:1746065149.253498:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263476352:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33690us (34084us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.253511:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3667 00002000:00100000:2.0:1746065149.253521:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009a6dca80 x1830881263476352/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.253529:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881263476352 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.253535:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dca80 00000100:00100000:0.0:1746065149.255210:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.255268:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263476736 00000100:00100000:1.0:1746065149.255275:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263476736 00000100:00100000:1.0:1746065149.255323:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13079 00000100:00100000:1.0:1746065149.255329:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:32166:x1830881263476736:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065149.255343:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.255356:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334c5 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.255380:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.255392:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.255397:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.255398:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.255401:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1097728->1744895] (req 1097728->1744895) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.255424:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.255433:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 11 pid: 12258 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.255443:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318272:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.255514:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.255521:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 32 pid: 12260 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.255528:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318400:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.255543:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.255648:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263476096:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36067us (36286us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065149.255655:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3666 00002000:00100000:3.0:1746065149.255662:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009a6df800 x1830881263476096/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.255675:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df800 with x1830881263476096 ext(1048576->2097151) 00010000:00010000:3.0:1746065149.255679:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 31 pid: 12260 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.255691:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 31 pid: 12260 timeout: 845 lvb_type: 1 00002000:00010000:3.0:1746065149.255696:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6df800 00000100:00100000:0.0:1746065149.264631:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.264713:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318272:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.264721:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263476864 00000100:00100000:1.0:1746065149.264723:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318400:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.264726:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263476864 00010000:00010000:1.0:1746065149.264752:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1097728->1744895] (req 1097728->1744895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.264756:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 12 pid: 12258 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.264768:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112400, rc 0) 00000100:00100000:3.0:1746065149.264795:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5877 00000100:00100000:3.0:1746065149.264801:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263476864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.264812:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065149.264817:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+12:32166:x1830881263476736:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9488us (9612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.264824:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13079 00010000:00010000:3.0:1746065149.264830:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 12 pid: 12258 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.264840:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 11 pid: 12258 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.264860:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc146f142 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a9 expref: 11 pid: 12258 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.264888:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.264909:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263476864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.264914:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5877 00000100:00100000:0.0:1746065149.275601:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.275654:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.275733:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263476992 00000100:00100000:2.0:1746065149.275741:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263476992 00010000:00010000:2.0:1746065149.275770:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 31 pid: 12260 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.275822:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5878 00000100:00100000:2.0:1746065149.275829:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263476992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.275841:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.275857:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 31 pid: 12260 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.275867:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 31 pid: 12260 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.275885:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abade00/0xad6b7ddc146f126 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93347f expref: 31 pid: 12260 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.276005:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.276007:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.276013:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.276021:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.276048:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.276059:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263318528:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065149.276280:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263477248 00000100:00100000:3.0:1746065149.276285:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263477248 00002000:00100000:3.0:1746065149.276311:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88012f09c380 x1830881263477248/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.276318:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881263477248 ext(2097152->4194303) 00002000:00010000:3.0:1746065149.276322:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c380 00000100:00100000:3.0:1746065149.276337:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3668 00000100:00100000:3.0:1746065149.276342:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263477248:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065149.276588:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.283975:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.284108:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263477504 00000100:00100000:2.0:1746065149.284115:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263477504 00002000:00100000:2.0:1746065149.284148:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88012f09e300 x1830881263477504/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.284158:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881263477504 ext(2097152->4194303) 00002000:00010000:2.0:1746065149.284162:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09e300 00000100:00100000:2.0:1746065149.284187:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3669 00000100:00100000:2.0:1746065149.284192:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263477504:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065149.289267:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.289483:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263318528:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065149.289505:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.289544:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263476992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 13715us (13951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.289554:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5878 00000100:00100000:3.0:1746065149.290168:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263477760 00000100:00100000:3.0:1746065149.290176:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263477760 00002000:00100000:3.0:1746065149.290210:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1097728->1101823) req@ffff88012f09d500 x1830881263477760/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.290219:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881263477760 ext(1097728->1101823) 00002000:00010000:3.0:1746065149.290223:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d500 00000100:00100000:3.0:1746065149.290238:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3670 00000100:00100000:3.0:1746065149.290245:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263477760:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065149.290338:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263477760:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 95us (1078us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065149.290343:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3670 00002000:00100000:3.0:1746065149.290348:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1097728->1101823) req@ffff88012f09d500 x1830881263477760/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.290359:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881263477760 ext(1097728->1101823) 00002000:00010000:3.0:1746065149.290363:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d500 00000100:00100000:3.0:1746065149.300652:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263477248:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24301us (24989us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065149.300662:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3668 00002000:00100000:3.0:1746065149.300671:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88012f09c380 x1830881263477248/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.300678:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881263477248 ext(2097152->4194303) 00002000:00010000:3.0:1746065149.300683:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c380 00000100:00100000:2.0:1746065149.311810:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263477504:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27608us (27831us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065149.311821:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3669 00002000:00100000:2.0:1746065149.311832:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88012f09e300 x1830881263477504/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.311840:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881263477504 ext(2097152->4194303) 00002000:00010000:2.0:1746065149.311846:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09e300 00000100:00100000:0.0:1746065149.318406:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.320086:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263478016 00000100:00100000:2.0:1746065149.320098:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263478016 00002000:00100000:2.0:1746065149.320142:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1740800->1744895) req@ffff88012f09e680 x1830881263478016/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.320157:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e680 with x1830881263478016 ext(1740800->1744895) 00002000:00010000:2.0:1746065149.320162:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09e680 00000100:00100000:2.0:1746065149.320199:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3671 00000100:00100000:2.0:1746065149.320206:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263478016:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065149.320325:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263478016:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 119us (1927us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065149.320330:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3671 00002000:00100000:2.0:1746065149.320336:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1740800->1744895) req@ffff88012f09e680 x1830881263478016/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.320342:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e680 with x1830881263478016 ext(1740800->1744895) 00002000:00010000:2.0:1746065149.320345:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09e680 00000100:00100000:0.0:1746065149.322030:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.322104:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263478144 00000100:00100000:1.0:1746065149.322109:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263478144 00000100:00100000:1.0:1746065149.322151:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13080 00000100:00100000:1.0:1746065149.322158:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263478144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065149.322170:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.322184:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146f17a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334cc expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.322226:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318656:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065149.322289:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00002000:00010000:1.0:1746065149.323761:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime: 1746065144 -> 1746065149 00002000:00010000:1.0:1746065149.323766:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime: 1746065142 -> 1746065149 00002000:00010000:1.0:1746065149.323768:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime: 1746065144 -> 1746065149 00000100:00100000:1.0:1746065149.323810:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318656:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065149.323835:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146f17a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334cc expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.323847:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146f17a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334cc expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.323864:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00000100:00100000:1.0:1746065149.324615:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263478144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2454us (2587us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065149.324623:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13080 00000100:00100000:0.0:1746065149.331538:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.331761:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263478400 00000100:00100000:3.0:1746065149.331811:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263478400 00002000:00100000:3.0:1746065149.331857:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012f09dc00 x1830881263478400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.331867:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09dc00 with x1830881263478400 ext(4194304->5021695) 00002000:00010000:3.0:1746065149.331872:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09dc00 00000100:00100000:3.0:1746065149.331918:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3672 00000100:00100000:3.0:1746065149.331928:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263478400:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065149.346091:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263478400:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14156us (14555us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065149.346101:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3672 00002000:00100000:3.0:1746065149.346110:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012f09dc00 x1830881263478400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.346119:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09dc00 with x1830881263478400 ext(4194304->5021695) 00002000:00010000:3.0:1746065149.346125:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09dc00 00000100:00100000:0.0:1746065149.365313:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.365399:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263478528 00000100:00100000:1.0:1746065149.365407:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263478528 00000100:00100000:1.0:1746065149.365458:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13081 00000100:00100000:1.0:1746065149.365466:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263478528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065149.365482:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.365497:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146f181 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334d3 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.365540:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318784:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065149.366009:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065149.367520:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318784:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065149.367542:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146f181 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334d3 expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.367553:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146f181 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334d3 expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.367565:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:1.0:1746065149.367767:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263478528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2301us (2460us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065149.367881:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13081 00000100:00100000:0.0:1746065149.373601:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.373691:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263478656 00000100:00100000:1.0:1746065149.373699:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263478656 00000100:00100000:1.0:1746065149.373745:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13082 00000100:00100000:1.0:1746065149.373752:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263478656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065149.373768:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.373809:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146f188 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334da expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.373854:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318912:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065149.374215:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065149.375799:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263318912:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065149.375824:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146f188 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334da expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.375836:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146f188 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334da expref: 31 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.375849:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30400, rc 0) 00000100:00100000:1.0:1746065149.376040:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263478656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2286us (2445us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065149.376048:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13082 00000100:00100000:0.0:1746065149.392261:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.392347:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263478784 00000100:00100000:1.0:1746065149.392355:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263478784 00000100:00100000:1.0:1746065149.392403:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13083 00000100:00100000:1.0:1746065149.392411:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:32171:x1830881263478784:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065149.392426:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.392440:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334e1 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.392465:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.392473:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.392480:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.392481:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.392484:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3620864->4194303] (req 3620864->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.392509:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.392519:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.392530:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263319040:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.393314:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.393327:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 9 pid: 13375 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746065149.393336:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263319168:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.393385:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065149.394467:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263319040:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.394475:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263319168:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.394491:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3620864->4194303] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.394505:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00000100:00100000:1.0:1746065149.394533:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:32171:x1830881263478784:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2122us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.394541:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13083 00000100:00100000:0.0:1746065149.396300:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.396351:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263478912 00000100:00100000:2.0:1746065149.396357:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263478912 00010000:00010000:2.0:1746065149.396660:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 10 pid: 13375 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.396691:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5879 00000100:00100000:2.0:1746065149.396697:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263478912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.396708:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.396723:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 10 pid: 13375 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.396732:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 10 pid: 13375 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.396749:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad000/0xad6b7ddc146f10a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93346a expref: 10 pid: 13375 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.396792:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.396819:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263478912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 122us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.396823:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5879 00000100:00100000:0.0:1746065149.398856:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.398930:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263479040 00000100:00100000:2.0:1746065149.398935:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263479040 00010000:00010000:2.0:1746065149.398965:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.399206:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5880 00000100:00100000:2.0:1746065149.399214:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263479040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.399224:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.399237:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.399247:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.399263:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9a00/0xad6b7ddc146f12d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933494 expref: 31 pid: 3067 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.399274:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.399277:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.399283:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.399291:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.399315:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.399326:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263319296:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065149.399986:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.401191:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263319296:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065149.401207:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.401483:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263479040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2269us (2630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.401492:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5880 00000100:00100000:0.0:1746065149.405366:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.405421:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263479296 00000100:00100000:3.0:1746065149.405428:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263479296 00002000:00100000:3.0:1746065149.405469:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3620864->3624959) req@ffff88012f09f100 x1830881263479296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.405479:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f100 with x1830881263479296 ext(3620864->3624959) 00002000:00010000:3.0:1746065149.405483:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f100 00000100:00100000:3.0:1746065149.405514:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3673 00000100:00100000:3.0:1746065149.405521:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263479296:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065149.405642:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263479296:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 121us (283us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065149.405649:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3673 00002000:00100000:3.0:1746065149.405655:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3620864->3624959) req@ffff88012f09f100 x1830881263479296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.405662:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f100 with x1830881263479296 ext(3620864->3624959) 00002000:00010000:3.0:1746065149.405664:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f100 00000100:00100000:1.0:1746065149.412936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.413349:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263479424 00000100:00100000:2.0:1746065149.413357:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263479424 00000100:00100000:2.0:1746065149.413398:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13084 00000100:00100000:2.0:1746065149.413405:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:32171:x1830881263479424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065149.413418:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.413431:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334e8 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.413455:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.413467:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.413473:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.413475:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.413478:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->4460543] (req 4194304->4460543) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.413502:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.413513:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 13 pid: 10219 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.413524:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263319424:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.414156:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.414166:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 32 pid: 12260 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.414174:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263319552:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.414193:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.416388:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263319424:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065149.417677:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263319552:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.417704:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->4460543] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.417718:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3a00, rc 0) 00000100:00100000:2.0:1746065149.417768:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:32171:x1830881263479424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4363us (4839us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.420383:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.420479:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13084 00000100:00100000:3.0:1746065149.421255:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263479552 00000100:00100000:3.0:1746065149.421263:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263479552 00010000:00010000:3.0:1746065149.421289:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 14 pid: 10219 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.421321:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5881 00000100:00100000:3.0:1746065149.421327:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263479552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.421339:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.421354:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 14 pid: 10219 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.421368:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 14 pid: 10219 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.421386:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44000/0xad6b7ddc146f157 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b7 expref: 14 pid: 10219 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.421401:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.421435:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263479552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.421441:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5881 00000100:00100000:0.0:1746065149.428162:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.428661:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263479680 00000100:00100000:3.0:1746065149.428669:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263479680 00010000:00010000:3.0:1746065149.428699:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 32 pid: 12260 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.428724:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5882 00000100:00100000:3.0:1746065149.428731:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263479680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.428743:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.428758:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 32 pid: 12260 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.428770:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 32 pid: 12260 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.428806:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f134 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93348d expref: 32 pid: 12260 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.428837:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.428839:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.428845:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.428852:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.428884:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.428894:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263319680:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065149.428971:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.432412:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263319680:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065149.432439:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.432485:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263479680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3753us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.432495:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5882 00000100:00100000:0.0:1746065149.435281:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.435485:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263479936 00000100:00100000:2.0:1746065149.435492:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263479936 00002000:00100000:2.0:1746065149.435529:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4456448->4460543) req@ffff88008c458a80 x1830881263479936/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.435537:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458a80 with x1830881263479936 ext(4456448->4460543) 00002000:00010000:2.0:1746065149.435542:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458a80 00000100:00100000:2.0:1746065149.435606:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3674 00000100:00100000:2.0:1746065149.435612:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263479936:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065149.435796:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263479936:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 183us (520us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065149.435803:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3674 00002000:00100000:2.0:1746065149.435808:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4456448->4460543) req@ffff88008c458a80 x1830881263479936/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.435814:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458a80 with x1830881263479936 ext(4456448->4460543) 00002000:00010000:2.0:1746065149.435817:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458a80 00000100:00100000:0.0:1746065149.458259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.458508:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.459054:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263480064 00000100:00100000:2.0:1746065149.459062:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263480064 00000100:00100000:2.0:1746065149.459098:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263480192 00000100:00100000:2.0:1746065149.459101:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263480192 00000100:00100000:2.0:1746065149.459116:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13085 00000100:00100000:2.0:1746065149.459124:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263480064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.459139:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.459154:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cd2600/0xad6b7ddc146f19d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334ef expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.459197:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263319808:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065149.459274:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.459350:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13086 00000100:00100000:2.0:1746065149.459356:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263480192:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.459363:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.459373:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146f1a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334f6 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.459396:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263319936:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065149.459421:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809000 going to sleep for 11 seconds 00002000:00010000:2.0:1746065149.461242:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065147 -> 1746065149 00000100:00100000:2.0:1746065149.461260:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263319808:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065149.461283:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099cd2600/0xad6b7ddc146f19d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334ef expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.461293:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cd2600/0xad6b7ddc146f19d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334ef expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.461316:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd2600, rc 0) 00000100:00100000:2.0:1746065149.461349:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263480064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2226us (3097us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.461356:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13085 00000100:00100000:3.0:1746065149.461830:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263319936:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065149.461845:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146f1a4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334f6 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.461853:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc146f1a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334f6 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.461865:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:3.0:1746065149.461884:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263480192:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2530us (3378us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065149.461890:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13086 00000100:00100000:0.0:1746065149.464979:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.465289:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263480320 00000100:00100000:3.0:1746065149.465297:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263480320 00000100:00100000:3.0:1746065149.465502:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13087 00000100:00100000:3.0:1746065149.465510:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+9:32178:x1830881263480320:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065149.465526:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.465539:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9334fd expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.465562:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.465569:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.465570:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.465573:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3854336->4136959] (req 3854336->4136959) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.465596:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.465606:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 29 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.465621:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263320064:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.466608:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.467454:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.467542:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263320064:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.467564:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3854336->4136959] (req 3854336->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.467576:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047400, rc 0) 00000100:00100000:0.0:1746065149.467826:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263480448 00000100:00100000:0.0:1746065149.467831:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263480448 00002000:00100000:0.0:1746065149.467860:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3620864->4194303) req@ffff88009a6df480 x1830881263480448/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.467868:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df480 with x1830881263480448 ext(3620864->4194303) 00010000:00010000:0.0:1746065149.467873:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 30 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.467883:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 30 pid: 3068 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746065149.467888:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6df480 00000100:00100000:0.0:1746065149.467901:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1287 00000100:00100000:0.0:1746065149.467907:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263480448:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065149.468083:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+10:32178:x1830881263480320:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2573us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.468090:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13087 00000100:00100000:1.0:1746065149.474142:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.474248:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263480704 00000100:00100000:2.0:1746065149.474256:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263480704 00002000:00100000:2.0:1746065149.474290:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880090dd9880 x1830881263480704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.474299:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9880 with x1830881263480704 ext(0->1048575) 00002000:00010000:2.0:1746065149.474304:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9880 00000100:00100000:2.0:1746065149.474335:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3675 00000100:00100000:2.0:1746065149.474342:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263480704:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065149.476410:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.476451:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.476482:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263480960 00000100:00100000:0.0:1746065149.476487:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263480960 00002000:00100000:0.0:1746065149.476515:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88008c459c00 x1830881263480960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.476523:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881263480960 ext(1048576->2097151) 00002000:00010000:0.0:1746065149.476527:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c459c00 00000100:00100000:1.0:1746065149.477889:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263480448:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 9977us (10435us total) trans 17179873452 rc 0/0 00000100:00100000:1.0:1746065149.477897:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1287 00002000:00100000:1.0:1746065149.477904:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3620864->4194303) req@ffff88009a6df480 x1830881263480448/t17179873452(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.477911:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df480 with x1830881263480448 ext(3620864->4194303) 00010000:00010000:1.0:1746065149.477919:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 32 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.477932:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 32 pid: 3068 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746065149.477939:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6df480 00000100:00100000:1.0:1746065149.477967:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263481216 00000100:00100000:1.0:1746065149.477971:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263481216 00002000:00100000:1.0:1746065149.477988:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88008c458e00 x1830881263481216/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 504/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.477994:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458e00 with x1830881263481216 ext(1048576->2097151) 00002000:00010000:1.0:1746065149.477997:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458e00 00000100:00100000:0.0:1746065149.478393:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3676 00000100:00100000:0.0:1746065149.478402:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263480960:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065149.478583:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3677 00000100:00100000:3.0:1746065149.478592:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263481216:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065149.479172:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.479188:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263481472 00000100:00100000:0.0:1746065149.479192:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263481472 00002000:00100000:0.0:1746065149.479207:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88008c459f80 x1830881263481472/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.479214:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459f80 with x1830881263481472 ext(1048576->2097151) 00002000:00010000:0.0:1746065149.479218:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459f80 00000100:00100000:0.0:1746065149.479227:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3678 00000100:00100000:0.0:1746065149.479231:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263481472:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065149.482818:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.482841:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263481600 00000100:00100000:2.0:1746065149.482849:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263481600 00010000:00010000:2.0:1746065149.482875:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 32 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.482899:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5883 00000100:00100000:2.0:1746065149.482906:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263481600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.482918:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.482934:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 32 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.482956:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 32 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.482979:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f18f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e1 expref: 32 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.483000:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.483001:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.483008:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.483014:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.483041:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.483052:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263320192:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065149.483447:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.488529:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.489581:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263481856 00000100:00100000:1.0:1746065149.489592:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263481856 00002000:00100000:1.0:1746065149.489630:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3854336->3858431) req@ffff88008c459880 x1830881263481856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.489639:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459880 with x1830881263481856 ext(3854336->3858431) 00002000:00010000:1.0:1746065149.489644:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c459880 00000100:00100000:1.0:1746065149.489666:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3679 00000100:00100000:1.0:1746065149.489673:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263481856:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065149.489820:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263481856:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 145us (1297us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065149.489826:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3679 00002000:00100000:1.0:1746065149.489831:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3854336->3858431) req@ffff88008c459880 x1830881263481856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.489837:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459880 with x1830881263481856 ext(3854336->3858431) 00002000:00010000:1.0:1746065149.489840:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c459880 00000100:00100000:2.0:1746065149.490010:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263320192:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065149.490026:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.490060:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263481600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7154us (7249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.490067:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5883 00000100:00100000:3.0:1746065149.500467:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263481216:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 21867us (24005us total) trans 0 rc 401408/401408 00000100:00100000:3.0:1746065149.500478:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3677 00002000:00100000:3.0:1746065149.500488:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88008c458e00 x1830881263481216/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 504/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 401408/401408 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.500498:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458e00 with x1830881263481216 ext(1048576->2097151) 00002000:00010000:3.0:1746065149.500503:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458e00 00000100:00100000:2.0:1746065149.501746:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263480704:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 27399us (27606us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.501754:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3675 00002000:00100000:2.0:1746065149.501760:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880090dd9880 x1830881263480704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.501768:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9880 with x1830881263480704 ext(0->1048575) 00002000:00010000:2.0:1746065149.501788:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9880 00000100:00100000:2.0:1746065149.506259:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263480960:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 27151us (29146us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.506270:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3676 00002000:00100000:2.0:1746065149.506281:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88008c459c00 x1830881263480960/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.506290:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881263480960 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.506295:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c459c00 00000100:00100000:0.0:1746065149.514368:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.514692:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263481472:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 35457us (35519us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.514701:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3678 00002000:00100000:2.0:1746065149.514710:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88008c459f80 x1830881263481472/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.514719:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459f80 with x1830881263481472 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.514725:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459f80 00000100:00100000:2.0:1746065149.514743:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263482112 00000100:00100000:2.0:1746065149.514748:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263482112 00002000:00100000:2.0:1746065149.514798:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (4132864->4136959) req@ffff88008c45aa00 x1830881263482112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.514805:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45aa00 with x1830881263482112 ext(4132864->4136959) 00002000:00010000:2.0:1746065149.514808:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45aa00 00000100:00100000:2.0:1746065149.514823:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3680 00000100:00100000:2.0:1746065149.514829:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263482112:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065149.514922:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263482112:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 93us (562us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065149.514927:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3680 00002000:00100000:2.0:1746065149.514931:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (4132864->4136959) req@ffff88008c45aa00 x1830881263482112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.514937:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45aa00 with x1830881263482112 ext(4132864->4136959) 00002000:00010000:2.0:1746065149.514939:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45aa00 00000100:00100000:0.0:1746065149.525720:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.526152:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263482240 00000100:00100000:3.0:1746065149.526162:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263482240 00000100:00100000:3.0:1746065149.526213:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13088 00000100:00100000:3.0:1746065149.526221:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+13:32182:x1830881263482240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.526237:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.526252:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933504 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.526276:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.526283:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.526285:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.526288:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.526312:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.526322:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 30 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.526332:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263320320:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.526406:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.528938:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263320320:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.528967:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.528981:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683b800, rc 0) 00000100:00100000:3.0:1746065149.529263:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+14:32182:x1830881263482240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3041us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.529271:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13088 00000100:00100000:0.0:1746065149.529691:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.529881:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263482368 00000100:00100000:3.0:1746065149.529886:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263482368 00002000:00100000:3.0:1746065149.529914:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4460543) req@ffff88008c458000 x1830881263482368/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.529922:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458000 with x1830881263482368 ext(4194304->4460543) 00010000:00010000:3.0:1746065149.529928:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 31 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.529938:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 31 pid: 3068 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746065149.529957:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c458000 00000100:00100000:3.0:1746065149.529981:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1288 00000100:00100000:3.0:1746065149.529988:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263482368:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065149.540676:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263482368:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 10679us (10976us total) trans 21474840901 rc 0/0 00000100:00100000:3.0:1746065149.540687:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1288 00002000:00100000:3.0:1746065149.540696:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4460543) req@ffff88008c458000 x1830881263482368/t21474840901(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.540704:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458000 with x1830881263482368 ext(4194304->4460543) 00010000:00010000:3.0:1746065149.540714:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.540733:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746065149.540739:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c458000 00000100:00100000:0.0:1746065149.542884:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.543672:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263482496 00000100:00100000:2.0:1746065149.543680:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263482496 00010000:00010000:2.0:1746065149.543710:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.543745:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5884 00000100:00100000:2.0:1746065149.543752:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263482496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.543763:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.543801:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.543811:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.543830:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc146f196 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334e8 expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.543858:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.543860:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.543866:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.543872:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.543902:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.543914:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263320448:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065149.544047:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.545658:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263320448:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065149.545672:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.545709:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263482496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1957us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.545717:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5884 00000100:00100000:0.0:1746065149.558172:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.558211:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.558955:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263482880 00000100:00100000:3.0:1746065149.558963:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263482880 00002000:00100000:3.0:1746065149.558997:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008f7fdf80 x1830881263482880/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 504/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.559006:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdf80 with x1830881263482880 ext(2097152->4194303) 00002000:00010000:3.0:1746065149.559011:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fdf80 00000100:00100000:3.0:1746065149.559024:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263483008 00000100:00100000:3.0:1746065149.559025:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263483008 00002000:00100000:3.0:1746065149.559033:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88008f7fd500 x1830881263483008/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.559040:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd500 with x1830881263483008 ext(2097152->4194303) 00002000:00010000:3.0:1746065149.559042:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd500 00000100:00100000:3.0:1746065149.559057:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3681 00000100:00100000:3.0:1746065149.559063:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263482880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065149.559963:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3682 00000100:00100000:3.0:1746065149.559970:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263483008:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065149.577347:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263482880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18275us (19172us total) trans 0 rc 1814528/1814528 00000100:00100000:3.0:1746065149.577356:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3681 00002000:00100000:3.0:1746065149.577366:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008f7fdf80 x1830881263482880/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 504/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1814528/1814528 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.577375:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdf80 with x1830881263482880 ext(2097152->4194303) 00002000:00010000:3.0:1746065149.577381:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fdf80 00000100:00100000:3.0:1746065149.600712:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263483008:12345-192.168.202.27@tcp:3:cat.0 Request processed in 40733us (42490us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065149.600723:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3682 00002000:00100000:3.0:1746065149.600733:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88008f7fd500 x1830881263483008/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.600742:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd500 with x1830881263483008 ext(2097152->4194303) 00002000:00010000:3.0:1746065149.600747:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd500 00000100:00100000:0.0:1746065149.608862:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.609195:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263483264 00000100:00100000:3.0:1746065149.609203:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263483264 00002000:00100000:3.0:1746065149.609240:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008f7ff100 x1830881263483264/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.609249:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff100 with x1830881263483264 ext(4194304->5021695) 00002000:00010000:3.0:1746065149.609253:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff100 00000100:00100000:3.0:1746065149.609269:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3683 00000100:00100000:3.0:1746065149.609275:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263483264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065149.611292:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.611333:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.611733:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.612968:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263483392 00000100:00100000:3.0:1746065149.612978:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263483392 00000100:00100000:3.0:1746065149.613025:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263483520 00000100:00100000:3.0:1746065149.613027:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263483520 00000100:00100000:3.0:1746065149.613039:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263483648 00000100:00100000:3.0:1746065149.613041:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263483648 00000100:00100000:3.0:1746065149.613053:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13089 00000100:00100000:3.0:1746065149.613061:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263483392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.613075:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.613089:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc146f1b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93350b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.613131:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263320576:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065149.613196:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.613219:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13090 00000100:00100000:2.0:1746065149.613227:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263483520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.613235:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065149.613243:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13091 00010000:00010000:2.0:1746065149.613244:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933512 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.613251:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263483648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.613255:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.613257:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.613257:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.613263:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.613267:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580f800/0xad6b7ddc146f1c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933519 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.613274:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.613282:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358600, rc 0) 00000100:00100000:2.0:1746065149.613303:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263483520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 77us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.613308:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13090 00000100:00100000:1.0:1746065149.613360:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263320704:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065149.613380:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.618552:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263483264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9268us (9688us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065149.618562:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3683 00002000:00100000:3.0:1746065149.618570:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008f7ff100 x1830881263483264/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.618579:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff100 with x1830881263483264 ext(4194304->5021695) 00002000:00010000:3.0:1746065149.618583:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff100 00000100:00100000:2.0:1746065149.618684:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263320576:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065149.618710:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc146f1b9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93350b expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.618722:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc146f1b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93350b expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.618970:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683aa00, rc 0) 00000100:00100000:2.0:1746065149.619001:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263483392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5940us (7713us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.619007:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13089 00000100:00100000:1.0:1746065149.619697:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263320704:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065149.619714:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009580f800/0xad6b7ddc146f1c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933519 expref: 32 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.619723:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009580f800/0xad6b7ddc146f1c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933519 expref: 32 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.619733:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f800, rc 0) 00000100:00100000:1.0:1746065149.619753:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263483648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6504us (8021us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065149.619757:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13091 00000100:00100000:0.0:1746065149.633927:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.634043:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263483776 00000100:00100000:1.0:1746065149.634052:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263483776 00000100:00100000:1.0:1746065149.634102:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13092 00000100:00100000:1.0:1746065149.634110:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+31:32186:x1830881263483776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065149.634125:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.634141:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933520 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.634168:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.634174:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065149.634176:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065149.634179:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.634751:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.634763:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 9 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746065149.634793:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263320832:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.634876:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.638658:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.638872:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263320832:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.638897:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.638911:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719800, rc 0) 00000100:00100000:1.0:1746065149.639157:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+32:32186:x1830881263483776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4849us (5037us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.639167:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13092 00000100:00100000:3.0:1746065149.639460:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263483904 00000100:00100000:3.0:1746065149.639466:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263483904 00002000:00100000:3.0:1746065149.639499:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1097728->1744895) req@ffff88008f7fc380 x1830881263483904/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.639508:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc380 with x1830881263483904 ext(1097728->1744895) 00010000:00010000:3.0:1746065149.639514:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 10 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.639524:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 10 pid: 3068 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746065149.639530:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7fc380 00000100:00100000:3.0:1746065149.639542:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1289 00000100:00100000:3.0:1746065149.639547:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263483904:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065149.655016:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263483904:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15458us (16356us total) trans 17179873453 rc 0/0 00000100:00100000:3.0:1746065149.655027:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1289 00002000:00100000:3.0:1746065149.655037:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1097728->1744895) req@ffff88008f7fc380 x1830881263483904/t17179873453(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.655045:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc380 with x1830881263483904 ext(1097728->1744895) 00010000:00010000:3.0:1746065149.655055:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 12 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.655069:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 12 pid: 3068 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746065149.655075:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7fc380 00000100:00100000:0.0:1746065149.666401:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.666473:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263484032 00000100:00100000:2.0:1746065149.666482:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263484032 00010000:00010000:2.0:1746065149.666515:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 12 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.666569:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5885 00000100:00100000:2.0:1746065149.666576:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263484032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.666589:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.666606:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 12 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.666617:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 12 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.666637:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc146f173 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1744895) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334c5 expref: 12 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.666667:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.666669:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.666675:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 31 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.666683:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 31 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.666714:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 31 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.666725:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263320960:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065149.667919:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.674745:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263320960:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065149.674765:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.674865:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263484032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8288us (8470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.674883:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5885 00000100:00100000:0.0:1746065149.677080:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263321088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065149.677134:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065149.677207:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321088 00000100:00100000:0.0:1746065149.677214:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321088 00000100:00100000:0.0:1746065149.677246:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1746065149.677252:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263321088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065149.677279:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065149.677635:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263321088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.677643:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1746065149.677679:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263321088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746065149.681144:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.681179:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.681241:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263484416 00000100:00100000:2.0:1746065149.681249:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263484416 00002000:00100000:2.0:1746065149.681284:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009856c700 x1830881263484416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.681292:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c700 with x1830881263484416 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.681297:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856c700 00000100:00100000:2.0:1746065149.681312:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3684 00000100:00100000:2.0:1746065149.681318:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263484416:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065149.682997:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263484160 00000100:00100000:0.0:1746065149.683006:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263484160 00000100:00100000:0.0:1746065149.683039:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13093 00000100:00100000:0.0:1746065149.683046:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32191:x1830881263484160:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065149.683059:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.683073:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933527 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.683100:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.683108:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.683114:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.683115:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.683118:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2908160->3006463] (req 2908160->3006463) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 34 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.683141:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.683150:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 34 pid: 3068 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746065149.683160:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263321216:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065149.683228:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.683236:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 13 pid: 9550 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.683243:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263321344:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.683262:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.688081:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263484416:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 6754us (6893us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.688091:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3684 00002000:00100000:2.0:1746065149.688100:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009856c700 x1830881263484416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.688108:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c700 with x1830881263484416 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.688112:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856c700 00000100:00100000:2.0:1746065149.692085:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263321216:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.692270:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.692340:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263484544 00000100:00100000:2.0:1746065149.692346:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263484544 00010000:00010000:2.0:1746065149.692373:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 35 pid: 3068 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746065149.692402:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5886 00000100:00100000:2.0:1746065149.692408:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263484544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.692418:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.692433:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 35 pid: 3068 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.692442:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 35 pid: 3068 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.692458:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d358600/0xad6b7ddc146f1c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933512 expref: 35 pid: 3068 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.692471:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.692504:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263484544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.692509:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5886 00000100:00100000:0.0:1746065149.696152:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263321344:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065149.696185:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2908160->3006463] (req 2908160->3006463) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.696199:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3200, rc 0) 00000100:00100000:0.0:1746065149.696239:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32191:x1830881263484160:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 13191us (15100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.696246:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13093 00000100:00100000:2.0:1746065149.696836:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263321600:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.696876:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.696909:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881263322112:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.696925:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.696935:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263322624:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.696957:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.696970:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746065149.696974:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881263321728:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.696985:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.696993:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3759:1830881263322240:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697004:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.697011:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263322752:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697022:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.697038:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321600 00000100:00100000:2.0:1746065149.697042:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321600 00000100:00100000:2.0:1746065149.697064:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1746065149.697068:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263321600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697095:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263321600:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.697099:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1746065149.697119:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263321600:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697131:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322624 00000100:00100000:2.0:1746065149.697133:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322624 00000100:00100000:2.0:1746065149.697151:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322752 00000100:00100000:2.0:1746065149.697152:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322752 00000100:00100000:2.0:1746065149.697162:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1746065149.697165:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263322624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697183:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263322624:12345-0@lo:400:kworker.0 Request processed in 18us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.697188:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1746065149.697193:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1746065149.697202:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263322752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697217:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263322752:12345-0@lo:400:kworker.0 Request processed in 20us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.697224:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00080000:2.0:1746065149.697233:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065149.697235:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065149.697243:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873446 gen 2 00000004:00080000:2.0:1746065149.697247:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa5180, transno 17179873380 00000004:00080000:2.0:1746065149.697252:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa5f80, transno 17179873381 00000004:00080000:2.0:1746065149.697255:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa4e00, transno 17179873382 00000004:00080000:2.0:1746065149.697256:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa5c00, transno 17179873383 00000004:00080000:2.0:1746065149.697258:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa4a80, transno 17179873384 00000004:00080000:2.0:1746065149.697260:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa5880, transno 17179873385 00000004:00080000:2.0:1746065149.697261:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa5500, transno 17179873386 00000004:00080000:2.0:1746065149.697263:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa6300, transno 17179873387 00000004:00080000:2.0:1746065149.697264:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f51880, transno 17179873388 00000004:00080000:2.0:1746065149.697266:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f51180, transno 17179873389 00000004:00080000:2.0:1746065149.697268:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f53480, transno 17179873390 00000004:00080000:2.0:1746065149.697269:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f53800, transno 17179873391 00000004:00080000:2.0:1746065149.697271:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6d500, transno 17179873392 00000004:00080000:2.0:1746065149.697272:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6f800, transno 17179873393 00000004:00080000:2.0:1746065149.697274:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6e300, transno 17179873394 00000004:00080000:2.0:1746065149.697275:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6f100, transno 17179873395 00000004:00080000:2.0:1746065149.697277:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd8a80, transno 17179873402 00000004:00080000:2.0:1746065149.697279:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd8e00, transno 17179873403 00000004:00080000:2.0:1746065149.697280:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098ddb480, transno 17179873404 00000004:00080000:2.0:1746065149.697282:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513aa00, transno 17179873405 00000004:00080000:2.0:1746065149.697283:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513a680, transno 17179873406 00000004:00080000:2.0:1746065149.697285:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139f80, transno 17179873407 00000004:00080000:2.0:1746065149.697287:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138a80, transno 17179873408 00000004:00080000:2.0:1746065149.697288:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138e00, transno 17179873409 00000004:00080000:2.0:1746065149.697290:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528700, transno 17179873411 00000004:00080000:2.0:1746065149.697292:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954bfb80, transno 17179873412 00000004:00080000:2.0:1746065149.697294:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52b800, transno 17179873413 00000004:00080000:2.0:1746065149.697295:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52a300, transno 17179873414 00000004:00080000:2.0:1746065149.697297:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954bed80, transno 17179873415 00000004:00080000:2.0:1746065149.697299:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954bdf80, transno 17179873416 00000004:00080000:2.0:1746065149.697301:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954be680, transno 17179873417 00000004:00080000:2.0:1746065149.697302:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800954bd880, transno 17179873418 00000004:00080000:2.0:1746065149.697304:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097e54380, transno 17179873419 00000004:00080000:2.0:1746065149.697306:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097e56a00, transno 17179873420 00000004:00080000:2.0:1746065149.697307:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a6a00, transno 17179873421 00000004:00080000:2.0:1746065149.697309:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097e54e00, transno 17179873422 00000004:00080000:2.0:1746065149.697310:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097e55880, transno 17179873423 00000004:00080000:2.0:1746065149.697312:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097e54700, transno 17179873424 00000004:00080000:2.0:1746065149.697313:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097e54000, transno 17179873425 00000004:00080000:2.0:1746065149.697315:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097e57100, transno 17179873426 00000004:00080000:2.0:1746065149.697317:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f800, transno 17179873431 00000004:00080000:2.0:1746065149.697319:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f100, transno 17179873432 00000004:00080000:2.0:1746065149.697321:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577e680, transno 17179873433 00000004:00080000:2.0:1746065149.697322:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577fb80, transno 17179873434 00000004:00080000:2.0:1746065149.697325:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f480, transno 17179873435 00000004:00080000:2.0:1746065149.697326:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ea00, transno 17179873436 00000004:00080000:2.0:1746065149.697328:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c700, transno 17179873437 00000004:00080000:2.0:1746065149.697330:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c000, transno 17179873438 00000004:00080000:2.0:1746065149.697331:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221f80, transno 17179873439 00000004:00080000:2.0:1746065149.697333:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135220000, transno 17179873440 00000004:00080000:2.0:1746065149.697334:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135220380, transno 17179873441 00000004:00080000:2.0:1746065149.697336:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6de680, transno 17179873442 00000004:00080000:2.0:1746065149.697338:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222d80, transno 17179873443 00000004:00080000:2.0:1746065149.697339:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222300, transno 17179873444 00000004:00080000:2.0:1746065149.697341:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221180, transno 17179873445 00000004:00080000:2.0:1746065149.697344:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221500, transno 17179873446 00000100:00100000:2.0:1746065149.697347:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263322752:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697358:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263322624:0@lo:400:kworker.0 00000004:00080000:2.0:1746065149.697584:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 56 done 00000100:00100000:2.0:1746065149.697604:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322112 00000100:00100000:2.0:1746065149.697606:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322112 00000100:00100000:2.0:1746065149.697624:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321728 00000100:00100000:2.0:1746065149.697626:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321728 00000100:00100000:2.0:1746065149.697633:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322240 00000100:00100000:2.0:1746065149.697635:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322240 00000100:00100000:2.0:1746065149.697644:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1746065149.697648:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881263322112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697669:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881263322112:12345-0@lo:400:kworker.0 Request processed in 21us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.697673:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1746065149.697680:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1746065149.697683:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881263321728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697697:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881263321728:12345-0@lo:400:kworker.0 Request processed in 14us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.697701:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1746065149.697706:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1746065149.697709:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3759:x1830881263322240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697721:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3759:x1830881263322240:12345-0@lo:400:kworker.0 Request processed in 11us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.697724:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00080000:2.0:1746065149.697735:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746065149.697737:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065149.697749:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881263321728:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697756:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3759:1830881263322240:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697761:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881263322112:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697813:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ceddf226-8ddf-479f-9953-8a74c62285a9:3762:1830881263321472:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697833:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.697852:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263321984:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697865:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.697872:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3762:1830881263322496:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697882:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.697890:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1746065149.697894:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263321856:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697904:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.697911:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881263322368:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697920:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.697927:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881263322880:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.697936:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.697961:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321472 00000100:00100000:2.0:1746065149.697964:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321472 00000100:00100000:2.0:1746065149.697981:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1746065149.697985:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a91b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3762:x1830881263321472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698008:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a91b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3762:x1830881263321472:12345-0@lo:400:kworker.0 Request processed in 22us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.698012:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1746065149.698032:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321984 00000100:00100000:2.0:1746065149.698034:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321984 00000100:00100000:2.0:1746065149.698048:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321856 00000100:00100000:2.0:1746065149.698049:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321856 00000100:00100000:2.0:1746065149.698059:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1746065149.698062:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263321984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698081:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263321984:12345-0@lo:400:kworker.0 Request processed in 19us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.698086:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1746065149.698093:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1746065149.698096:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263321856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698113:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263321856:12345-0@lo:400:kworker.0 Request processed in 17us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.698117:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1746065149.698128:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322496 00000100:00100000:2.0:1746065149.698130:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322496 00000100:00100000:2.0:1746065149.698143:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322368 00000100:00100000:2.0:1746065149.698144:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322368 00000100:00100000:2.0:1746065149.698152:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322880 00000100:00100000:2.0:1746065149.698153:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322880 00000100:00100000:2.0:1746065149.698161:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1746065149.698164:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3762:x1830881263322496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698186:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3762:x1830881263322496:12345-0@lo:400:kworker.0 Request processed in 20us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.698190:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1746065149.698198:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1746065149.698202:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881263322368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698218:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881263322368:12345-0@lo:400:kworker.0 Request processed in 16us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.698223:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1746065149.698229:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1746065149.698232:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881263322880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698246:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881263322880:12345-0@lo:400:kworker.0 Request processed in 13us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.698250:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00080000:2.0:1746065149.698260:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746065149.698262:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746065149.698263:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746065149.698265:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065149.698279:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263321856:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698286:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881263322368:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698292:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881263322880:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698298:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ceddf226-8ddf-479f-9953-8a74c62285a9:3762:1830881263321472:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698304:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263321984:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698310:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3762:1830881263322496:0@lo:400:kworker.0 00000100:00100000:2.0:1746065149.698754:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.700675:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263484672 00000100:00100000:1.0:1746065149.700685:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263484672 00010000:00010000:1.0:1746065149.700719:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 14 pid: 9550 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.701345:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.701365:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263484800 00000100:00100000:2.0:1746065149.701368:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263484800 00000100:00100000:2.0:1746065149.701390:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13094 00000100:00100000:2.0:1746065149.701396:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263484800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.701408:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.701421:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3400/0xad6b7ddc146f1dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93352e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.701438:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.701446:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3400/0xad6b7ddc146f1dc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93352e expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.701456:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3400/0xad6b7ddc146f1dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93352e expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.701466:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3400, rc 0) 00000100:00100000:1.0:1746065149.702740:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5887 00000100:00100000:1.0:1746065149.702751:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263484672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.702763:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.702798:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 14 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.702809:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 14 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.702826:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146f1b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933504 expref: 14 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.703028:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.703029:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.703036:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.703044:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.703074:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.703085:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263323008:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065149.703212:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263484800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1814us (1866us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.703220:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13094 00000100:00100000:3.0:1746065149.703319:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.703645:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263484928 00000100:00100000:2.0:1746065149.703650:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263484928 00000100:00100000:2.0:1746065149.703677:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13095 00000100:00100000:2.0:1746065149.703683:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263484928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.703693:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.703703:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc146f1e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933535 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.703728:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263323136:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065149.703760:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065149.704137:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.707497:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.707528:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263323008:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065149.707549:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.707585:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263484672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4836us (8829us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.707594:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5887 00000100:00100000:2.0:1746065149.707694:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263323136:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065149.707716:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc146f1e3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933535 expref: 33 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.707732:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc146f1e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933535 expref: 33 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.707741:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3e00, rc 0) 00000100:00100000:2.0:1746065149.707759:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263484928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4076us (4441us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.707765:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13095 00000100:00100000:3.0:1746065149.707854:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263485184 00000100:00100000:3.0:1746065149.707860:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263485184 00002000:00100000:3.0:1746065149.707890:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2908160->2912255) req@ffff88008f7fd880 x1830881263485184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.707898:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd880 with x1830881263485184 ext(2908160->2912255) 00002000:00010000:3.0:1746065149.707902:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd880 00000100:00100000:3.0:1746065149.707915:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3685 00000100:00100000:3.0:1746065149.707921:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263485184:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065149.708027:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263485184:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 105us (538us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065149.708033:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3685 00002000:00100000:3.0:1746065149.708038:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2908160->2912255) req@ffff88008f7fd880 x1830881263485184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.708044:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd880 with x1830881263485184 ext(2908160->2912255) 00002000:00010000:3.0:1746065149.708047:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd880 00000100:00100000:0.0:1746065149.712233:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.712319:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263485440 00000100:00100000:1.0:1746065149.712327:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263485440 00002000:00100000:1.0:1746065149.712362:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3002368->3006463) req@ffff88008f7ff800 x1830881263485440/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.712371:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881263485440 ext(3002368->3006463) 00002000:00010000:1.0:1746065149.712376:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff800 00000100:00100000:1.0:1746065149.712405:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3686 00000100:00100000:1.0:1746065149.712411:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263485440:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065149.712511:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263485440:12345-192.168.202.27@tcp:3:cat.0 Request processed in 99us (284us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065149.712516:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3686 00002000:00100000:1.0:1746065149.712520:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3002368->3006463) req@ffff88008f7ff800 x1830881263485440/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.712532:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881263485440 ext(3002368->3006463) 00002000:00010000:1.0:1746065149.712534:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff800 00000100:00100000:0.0:1746065149.714035:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.714090:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263485696 00000100:00100000:3.0:1746065149.714096:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263485696 00002000:00100000:3.0:1746065149.714118:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2908159) req@ffff88008f7fed80 x1830881263485696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.714126:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881263485696 ext(2097152->2908159) 00002000:00010000:3.0:1746065149.714130:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fed80 00000100:00100000:3.0:1746065149.714177:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3687 00000100:00100000:3.0:1746065149.714183:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263485696:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065149.727292:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.729722:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263485824 00000100:00100000:3.0:1746065149.729732:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263485824 00000100:00100000:3.0:1746065149.729801:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13620 00000100:00100000:3.0:1746065149.729808:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32192:x1830881263485824:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065149.729829:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.729846:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc146f1ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93353c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.729894:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.729906:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.729915:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.729925:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.729930:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.729934:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.730008:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.730018:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.730024:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 43 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.730030:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.730055:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 43 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.730065:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 43 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.730074:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263323264:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.730158:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.730166:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 22 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.730173:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263323392:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.730189:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.730568:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263485696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16383us (16534us total) trans 0 rc 811008/811008 00000100:00100000:3.0:1746065149.730575:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3687 00002000:00100000:3.0:1746065149.730583:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2908159) req@ffff88008f7fed80 x1830881263485696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 811008/811008 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.730591:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881263485696 ext(2097152->2908159) 00002000:00010000:3.0:1746065149.730595:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fed80 00000100:00100000:0.0:1746065149.731849:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.731872:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263486080 00000100:00100000:1.0:1746065149.731880:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263486080 00000100:00100000:3.0:1746065149.731937:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263323264:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.731960:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263323392:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.731975:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065149.731977:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4911 00000100:00100000:1.0:1746065149.731984:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+44:31232:x1830881263486080:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065149.732151:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+45:31232:x1830881263486080:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 167us (305us total) trans 8589935951 rc 0/0 00000100:00100000:1.0:1746065149.732157:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4911 00000100:00100000:0.0:1746065149.733483:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.734161:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263486208 00000100:00100000:1.0:1746065149.734168:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263486208 00010000:00010000:1.0:1746065149.734195:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 23 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746065149.734280:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5888 00000100:00100000:1.0:1746065149.734287:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263486208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.734298:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.734302:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 23 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.734312:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 23 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.734328:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc146f0cb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93345c expref: 23 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.734346:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065149.734350:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065149.734357:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065149.734361:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065149.734366:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.734575:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263486208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 289us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.734581:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5888 00000100:00100000:0.0:1746065149.735168:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.735205:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.735294:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263486336 00000100:00100000:1.0:1746065149.735298:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263486336 00010000:00010000:1.0:1746065149.735313:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 45 pid: 13395 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746065149.735330:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5889 00000100:00100000:1.0:1746065149.735335:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263486336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.735342:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.735346:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 45 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.735354:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 45 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.735370:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e000/0xad6b7ddc146f165 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334be expref: 45 pid: 13395 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.735380:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065149.735383:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065149.735391:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065149.735397:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065149.735414:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.735436:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263486336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.735441:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5889 00000100:00100000:2.0:1746065149.735496:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263486592 00000100:00100000:2.0:1746065149.735499:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263486592 00002000:00100000:2.0:1746065149.735524:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3006464->3145727) req@ffff88008f7fe300 x1830881263486592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.735532:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe300 with x1830881263486592 ext(3006464->3145727) 00002000:00010000:2.0:1746065149.735536:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe300 00000100:00100000:2.0:1746065149.735546:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3688 00000100:00100000:2.0:1746065149.735549:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263486592:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:3.0:1746065149.735734:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735741:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065149.735799:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065149.735803:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065149.735818:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735826:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735835:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735840:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735844:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735849:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735854:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065149.735857:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735862:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735869:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065149.735872:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065149.735874:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735878:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146f1f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735889:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735898:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735902:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735905:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065149.735907:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735911:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735916:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a000) 00010000:00010000:3.0:1746065149.735918:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065149.735920:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735924:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc146f1f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.735961:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc146f1ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.735971:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.735976:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.735978:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065149.735980:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71ae00, rc 0) 00000100:00100000:3.0:1746065149.736000:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:32192:x1830881263485824:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 6193us (8716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.736006:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13620 00000100:00100000:2.0:1746065149.738252:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263486592:12345-192.168.202.27@tcp:3:cat.0 Request processed in 2695us (3040us total) trans 0 rc 139264/139264 00000100:00100000:2.0:1746065149.738261:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3688 00002000:00100000:2.0:1746065149.738270:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3006464->3145727) req@ffff88008f7fe300 x1830881263486592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 139264/139264 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.738278:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe300 with x1830881263486592 ext(3006464->3145727) 00002000:00010000:2.0:1746065149.738282:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe300 00000100:00100000:0.0:1746065149.740185:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.740235:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.740306:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263486720 00000100:00100000:3.0:1746065149.740313:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263486720 00000100:00100000:3.0:1746065149.740346:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263486848 00000100:00100000:3.0:1746065149.740348:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263486848 00000100:00100000:3.0:1746065149.740363:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13096 00000100:00100000:3.0:1746065149.740368:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263486720:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065149.740410:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13097 00000100:00100000:0.0:1746065149.740416:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2005:x1830881263486848:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065149.740429:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.740448:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93354a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.740472:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.740474:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.740488:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 7 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.740504:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 7 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.740515:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:0.0:1746065149.740565:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263486848:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 150us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.740571:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13097 00010000:00010000:3.0:1746065149.740665:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.740675:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933543 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.740846:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.740847:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.740852:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.740861:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.741106:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72600, rc 0) 00000100:00100000:3.0:1746065149.741125:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263486720:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 756us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.741130:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13096 00000100:00100000:0.0:1746065149.750718:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.750747:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.750760:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.750795:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.750827:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.750853:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263486976 00000100:00100000:0.0:1746065149.750860:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263486976 00000100:00100000:0.0:1746065149.750888:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263487232 00000100:00100000:0.0:1746065149.750890:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263487232 00000100:00100000:0.0:1746065149.750900:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263487104 00000100:00100000:0.0:1746065149.750901:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263487104 00000100:00100000:0.0:1746065149.750908:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263487360 00000100:00100000:0.0:1746065149.750910:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263487360 00000100:00100000:0.0:1746065149.750917:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263487488 00000100:00100000:0.0:1746065149.750919:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263487488 00000100:00100000:0.0:1746065149.750932:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13098 00000100:00100000:0.0:1746065149.750949:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263486976:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065149.750968:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.750982:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933551 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.751002:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.751004:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.751012:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.751024:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.751034:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3c00, rc 0) 00000100:00100000:0.0:1746065149.751067:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263486976:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 129us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.751073:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13098 00000100:00100000:0.0:1746065149.751087:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13099 00000100:00100000:0.0:1746065149.751091:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263487232:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065149.751097:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.751105:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f21b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93355f expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.751137:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263323520:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065149.751224:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13100 00000100:00100000:1.0:1746065149.751231:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263487104:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065149.751237:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.751243:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933558 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.751253:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.751254:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.751259:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.751272:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.751278:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:1.0:1746065149.751294:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263487104:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 64us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.751298:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13100 00000100:00100000:1.0:1746065149.751309:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13101 00000100:00100000:1.0:1746065149.751313:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263487360:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065149.751319:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.751324:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146f229 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933566 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065149.751344:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263323648:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065149.754690:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13102 00000100:00100000:2.0:1746065149.754706:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:32186:x1830881263487488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.754722:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.754738:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93356d expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.754763:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.754771:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065149.754788:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065149.754791:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 33 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.754816:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.754826:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 10 pid: 9550 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.754836:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263323776:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.757584:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.757634:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.757667:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.757762:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263323904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746065149.757820:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.757853:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323904 00000100:00100000:2.0:1746065149.757859:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323904 00000100:00100000:2.0:1746065149.757890:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1746065149.757897:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263323904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746065149.757925:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445662720 avail 1316200448 00000100:00100000:2.0:1746065149.757972:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263323904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.757978:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1746065149.758015:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263323904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065149.765566:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.765685:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263323648:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065149.765710:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146f229 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933566 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.765727:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146f229 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933566 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065149.765739:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718800, rc 0) 00000100:00100000:0.0:1746065149.765809:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263487360:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 14493us (15035us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065149.765816:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13101 00000100:00100000:2.0:1746065149.765998:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263323776:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065149.766015:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 33 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.766026:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2e00, rc 0) 00000100:00100000:2.0:1746065149.766047:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:32186:x1830881263487488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11348us (15220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.766052:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13102 00000100:00100000:1.0:1746065149.766160:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263323520:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065149.766180:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f21b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93355f expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.766188:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f21b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93355f expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.766198:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2e00, rc 0) 00000100:00100000:1.0:1746065149.766220:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263487232:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 15128us (15471us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065149.766226:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13099 00000100:00100000:3.0:1746065149.766294:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263487616 00000100:00100000:3.0:1746065149.766301:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263487616 00002000:00100000:3.0:1746065149.766330:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3854336->4136959) req@ffff880099ec4380 x1830881263487616/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065149.766344:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4380 with x1830881263487616 ext(3854336->4136959) 00010000:00010000:3.0:1746065149.766350:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 11 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.766361:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 11 pid: 9550 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746065149.766366:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec4380 00000100:00100000:3.0:1746065149.766380:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1290 00000100:00100000:3.0:1746065149.766386:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263487616:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065149.779232:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263487616:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12837us (13665us total) trans 17179873454 rc 0/0 00000100:00100000:0.0:1746065149.779242:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1290 00002000:00100000:0.0:1746065149.779251:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3854336->4136959) req@ffff880099ec4380 x1830881263487616/t17179873454(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.779259:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4380 with x1830881263487616 ext(3854336->4136959) 00010000:00010000:0.0:1746065149.779268:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 13 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.779279:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 13 pid: 9550 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746065149.779284:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec4380 00000100:00100000:0.0:1746065149.781654:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.782034:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263487872 00000100:00100000:3.0:1746065149.782042:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263487872 00000100:00100000:3.0:1746065149.782136:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13621 00000100:00100000:3.0:1746065149.782144:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:32192:x1830881263487872:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065149.782160:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.782174:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146f237 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933574 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.782253:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.782266:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.782272:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.782299:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.782307:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 14 pid: 7203 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.782317:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263324032:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.782388:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.784515:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.784654:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263488000 00000100:00100000:1.0:1746065149.784659:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263488000 00000100:00100000:3.0:1746065149.784822:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263324032:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.784839:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065149.785376:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13103 00000100:00100000:1.0:1746065149.785385:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263488000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065149.785424:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065149.785436:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93357b expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.785453:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.785455:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065149.785461:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 14 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.785474:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 14 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065149.785483:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719c00, rc 0) 00000100:00100000:1.0:1746065149.785528:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263488000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 143us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.785533:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13103 00000100:00100000:0.0:1746065149.786627:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.786657:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.786691:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.786749:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263488256 00000100:00100000:2.0:1746065149.786754:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263488256 00000100:00100000:3.0:1746065149.786755:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263488128 00000100:00100000:3.0:1746065149.786759:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263488128 00000100:00100000:2.0:1746065149.786791:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263488384 00010000:00010000:3.0:1746065149.786794:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 15 pid: 7203 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.786794:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263488384 00000100:00100000:2.0:1746065149.786808:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13104 00000100:00100000:3.0:1746065149.786813:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5890 00000100:00100000:2.0:1746065149.786814:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263488256:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065149.786818:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263488128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.786829:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.786833:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 15 pid: 7203 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.786833:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.786842:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 15 pid: 7203 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.786843:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146f24c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933582 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.786856:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ae00/0xad6b7ddc146f1ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93353c expref: 15 pid: 7203 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.786870:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.786874:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065149.786878:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263324160:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065149.786882:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.786888:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.786899:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.786915:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263488128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.786921:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5890 00000100:00100000:2.0:1746065149.786922:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.786938:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13105 00000100:00100000:3.0:1746065149.786954:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263488384:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.786961:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.786968:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146f253 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933589 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.786989:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263324288:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065149.787011:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00010000:00010000:3.0:1746065149.787022:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.787028:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065149.787041:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065149.787131:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146f237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933574 expref: 15 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.787141:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933574 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.787147:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.787149:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065149.787151:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73200, rc 0) 00000100:00100000:3.0:1746065149.787181:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32192:x1830881263487872:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5038us (5533us total) trans 8589935952 rc 0/0 00000100:00100000:3.0:1746065149.787186:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13621 00000100:00100000:2.0:1746065149.788318:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263324160:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065149.788335:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146f24c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933582 expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065149.788344:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146f24c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933582 expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065149.788346:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263324288:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065149.788356:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00010000:00010000:3.0:1746065149.788360:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146f253 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933589 expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.788369:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc146f253 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933589 expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.788377:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73400, rc 0) 00000100:00100000:2.0:1746065149.788379:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263488256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1565us (1721us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065149.788384:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13104 00000100:00100000:3.0:1746065149.788393:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263488384:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1439us (1702us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065149.788399:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13105 00000100:00100000:2.0:1746065149.788870:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263324416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065149.788901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065149.788931:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324416 00000100:00100000:2.0:1746065149.788935:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324416 00000100:00100000:0.0:1746065149.789659:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.789699:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.789750:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263488512 00000100:00100000:3.0:1746065149.789754:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263488512 00000100:00100000:3.0:1746065149.789799:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13106 00000100:00100000:3.0:1746065149.789806:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+13:32188:x1830881263488512:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065149.789816:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.789827:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933590 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.789845:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.789852:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.789854:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.789857:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3842048->4194303] (req 3842048->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.789874:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.789883:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 32 pid: 9548 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.789892:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263324544:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.789924:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.789951:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263488768 00000100:00100000:3.0:1746065149.789954:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263488768 00000100:00100000:3.0:1746065149.789974:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13622 00000100:00100000:3.0:1746065149.789979:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32192:x1830881263488768:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065149.789988:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.789990:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065149.790002:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73200/0xad6b7ddc146f23e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933574 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.790011:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.790014:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065149.790020:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f268 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933597 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.790026:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1746065149.790033:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263324416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746065149.790046:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 122880 granted 1207588288 pending 3252224 free 3903262720 avail 3671740416 00000100:00100000:2.0:1746065149.790076:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263324416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.790080:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00010000:00010000:3.0:1746065149.790081:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790091:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790097:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790105:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065149.790107:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263324416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1746065149.790110:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790115:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790118:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065149.790121:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790126:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790130:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065149.790132:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065149.790135:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790139:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f26f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065149.790153:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f268 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933597 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.790158:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f268 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933597 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.790163:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45e00, rc 0) 00000100:00100000:3.0:1746065149.790181:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:32192:x1830881263488768:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 203us (482us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065149.790186:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13622 00000100:00100000:0.0:1746065149.792590:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.792622:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.792623:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263324544:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.792647:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3842048->4194303] (req 3842048->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.792650:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065149.792660:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:3.0:1746065149.792692:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+14:32188:x1830881263488512:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2886us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.792693:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263489024 00000100:00100000:0.0:1746065149.792697:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263489024 00000100:00100000:3.0:1746065149.792699:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13106 00010000:00010000:0.0:1746065149.792721:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 14 pid: 9550 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.792837:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263489280 00000100:00100000:3.0:1746065149.792841:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263489280 00000100:00100000:3.0:1746065149.792861:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4912 00000100:00100000:3.0:1746065149.792867:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:32192:x1830881263489280:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065149.792998:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32192:x1830881263489280:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 131us (347us total) trans 8589935953 rc 0/0 00000100:00100000:3.0:1746065149.793004:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4912 00000100:00100000:1.0:1746065149.793083:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263488896 00000100:00100000:1.0:1746065149.793088:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263488896 00002000:00100000:1.0:1746065149.793112:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2908160->3006463) req@ffff880099ec7100 x1830881263488896/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.793120:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7100 with x1830881263488896 ext(2908160->3006463) 00010000:00010000:1.0:1746065149.793126:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 33 pid: 9548 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.793135:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 33 pid: 9548 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746065149.793141:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec7100 00000100:00100000:1.0:1746065149.793154:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1291 00000100:00100000:1.0:1746065149.793159:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263488896:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065149.793803:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5891 00000100:00100000:0.0:1746065149.793810:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263489024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065149.793819:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065149.793831:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 14 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.793840:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 14 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.793857:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc146f1ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->4136959) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334fd expref: 14 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.794137:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.794140:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.794147:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.794159:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.794184:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.794194:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263324672:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065149.795055:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.796842:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.797075:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263489536 00000100:00100000:2.0:1746065149.797082:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263489536 00002000:00100000:2.0:1746065149.797114:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800957da680 x1830881263489536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.797129:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da680 with x1830881263489536 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.797133:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957da680 00000100:00100000:2.0:1746065149.797149:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3689 00000100:00100000:2.0:1746065149.797155:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263489536:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065149.802449:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263324672:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065149.802471:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065149.802501:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263489024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8691us (9877us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.802510:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5891 00000100:00100000:2.0:1746065149.804968:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065149.804986:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263324800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065149.805037:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065149.805163:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324800 00000100:00100000:1.0:1746065149.805169:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324800 00000100:00100000:1.0:1746065149.805209:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1746065149.805216:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263324800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746065149.805233:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1135454528 pending 2113536 free 3910807552 avail 3679285248 00000100:00100000:1.0:1746065149.805267:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263324800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.805272:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1746065149.805760:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263324800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065149.808755:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263488896:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15588us (16164us total) trans 21474840902 rc 0/0 00000100:00100000:1.0:1746065149.808765:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1291 00002000:00100000:1.0:1746065149.808789:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2908160->3006463) req@ffff880099ec7100 x1830881263488896/t21474840902(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.808798:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7100 with x1830881263488896 ext(2908160->3006463) 00010000:00010000:1.0:1746065149.808807:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 35 pid: 9548 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.808825:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 35 pid: 9548 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746065149.808831:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec7100 00000100:00100000:0.0:1746065149.808924:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.809203:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263489792 00000100:00100000:1.0:1746065149.809208:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263489792 00002000:00100000:1.0:1746065149.809232:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800957d9f80 x1830881263489792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.809239:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881263489792 ext(2097152->3145727) 00002000:00010000:1.0:1746065149.809243:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9f80 00000100:00100000:1.0:1746065149.809267:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3690 00000100:00100000:1.0:1746065149.809274:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263489792:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065149.814502:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263489536:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17333us (17651us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.814513:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3689 00002000:00100000:2.0:1746065149.814523:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800957da680 x1830881263489536/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.814531:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da680 with x1830881263489536 ext(1048576->2097151) 00002000:00010000:2.0:1746065149.814537:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957da680 00000100:00100000:0.0:1746065149.818528:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.818600:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263489920 00000100:00100000:2.0:1746065149.818609:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263489920 00010000:00010000:2.0:1746065149.818639:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 35 pid: 9548 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.818674:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5892 00000100:00100000:2.0:1746065149.818680:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263489920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.818690:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.818706:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 35 pid: 9548 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.818716:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 35 pid: 9548 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.818734:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc146f1d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3006463) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933527 expref: 35 pid: 9548 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.818749:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.818750:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.818755:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.818762:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.818802:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065149.818811:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263324928:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065149.819034:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065149.824705:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263489792:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15425us (15774us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065149.824714:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3690 00002000:00100000:1.0:1746065149.824723:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800957d9f80 x1830881263489792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.824731:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881263489792 ext(2097152->3145727) 00002000:00010000:1.0:1746065149.824736:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9f80 00000100:00100000:3.0:1746065149.824870:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263324928:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065149.824886:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.824905:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263489920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6225us (6384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.824912:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5892 00000100:00100000:0.0:1746065149.827588:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.827626:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.827647:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263490176 00000100:00100000:1.0:1746065149.827653:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263490176 00002000:00100000:1.0:1746065149.827692:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3842048->3846143) req@ffff8800957d8380 x1830881263490176/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.827706:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8380 with x1830881263490176 ext(3842048->3846143) 00002000:00010000:1.0:1746065149.827710:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8380 00000100:00100000:1.0:1746065149.827722:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263490432 00000100:00100000:1.0:1746065149.827724:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263490432 00002000:00100000:1.0:1746065149.827732:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800957d8e00 x1830881263490432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065149.827736:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3691 00002000:00100000:1.0:1746065149.827737:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8e00 with x1830881263490432 ext(2097152->3145727) 00002000:00010000:1.0:1746065149.827739:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8e00 00000100:00100000:0.0:1746065149.827743:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263490176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065149.827750:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3692 00000100:00100000:1.0:1746065149.827755:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263490432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065149.827877:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263490176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 134us (295us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065149.827882:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3691 00002000:00100000:0.0:1746065149.827888:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3842048->3846143) req@ffff8800957d8380 x1830881263490176/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.827897:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8380 with x1830881263490176 ext(3842048->3846143) 00002000:00010000:0.0:1746065149.827900:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8380 00000100:00100000:2.0:1746065149.833345:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.833405:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263490560 00000100:00100000:3.0:1746065149.833413:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263490560 00000100:00100000:3.0:1746065149.833452:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13107 00000100:00100000:3.0:1746065149.833459:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+34:32186:x1830881263490560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.833475:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.833490:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93359e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.833513:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.833520:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.833522:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065149.833525:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.833550:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.833564:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 15 pid: 9550 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.833575:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263325056:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.833648:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.849198:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.849219:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263490816 00000100:00100000:2.0:1746065149.849226:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263490816 00002000:00100000:2.0:1746065149.849256:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3842048->4194303) req@ffff88012f1a5880 x1830881263490816/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.849270:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881263490816 ext(3842048->4194303) 00010000:00010000:2.0:1746065149.849278:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 16 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.849289:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 15 pid: 9550 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746065149.849295:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1a5880 00000100:00100000:2.0:1746065149.849314:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1292 00000100:00100000:2.0:1746065149.849319:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263490816:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065149.849320:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263490432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21561us (21689us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065149.849328:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3692 00002000:00100000:1.0:1746065149.849334:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff8800957d8e00 x1830881263490432/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.849341:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8e00 with x1830881263490432 ext(2097152->3145727) 00010000:00010000:1.0:1746065149.849346:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 15 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.849356:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 15 pid: 9550 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746065149.849361:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957d8e00 00000100:00100000:1.0:1746065149.849406:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.849468:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263325056:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.849488:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.849500:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45a00, rc 0) 00000100:00100000:2.0:1746065149.849732:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263490944 00000100:00100000:2.0:1746065149.849736:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263490944 00000100:00100000:2.0:1746065149.849754:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13108 00000100:00100000:2.0:1746065149.849758:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+13:32188:x1830881263490944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065149.849766:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.849789:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335a5 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.849806:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.849813:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.849814:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.849817:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->3608575] (req 3145728->3608575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.849842:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.849850:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 32 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746065149.849859:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263325184:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.850285:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+35:32186:x1830881263490560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 16826us (16948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.850290:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13107 00000100:00100000:2.0:1746065149.850370:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.850709:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.850753:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263491200 00000100:00100000:2.0:1746065149.850758:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263491200 00000100:00100000:2.0:1746065149.850937:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13623 00000100:00100000:2.0:1746065149.850952:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+44:32200:x1830881263491200:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065149.850967:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.850977:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146f284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335ac expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.851484:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.851495:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065149.851503:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065149.851511:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065149.851590:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc146f284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 47 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.851610:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 46 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.851617:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065149.851619:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065149.851621:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d800, rc 0) 00000100:00100000:2.0:1746065149.851649:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+46:32200:x1830881263491200:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 697us (940us total) trans 8589935954 rc 0/0 00000100:00100000:2.0:1746065149.851653:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13623 00000100:00100000:2.0:1746065149.854100:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263490816:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4773us (4901us total) trans 21474840903 rc 0/0 00000100:00100000:2.0:1746065149.854114:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1292 00002000:00100000:2.0:1746065149.854122:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3842048->4194303) req@ffff88012f1a5880 x1830881263490816/t21474840903(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.854131:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881263490816 ext(3842048->4194303) 00010000:00010000:2.0:1746065149.854140:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 16 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.854151:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 16 pid: 9550 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746065149.854157:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1a5880 00000100:00100000:0.0:1746065149.854642:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.854698:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263491328 00000100:00100000:3.0:1746065149.854704:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263491328 00000100:00100000:3.0:1746065149.854740:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13109 00000100:00100000:3.0:1746065149.854747:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+15:32197:x1830881263491328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.854758:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.854769:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335b3 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.854807:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.854808:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.854815:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.854830:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.854838:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44200, rc 0) 00000100:00100000:3.0:1746065149.854877:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+16:32197:x1830881263491328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.854882:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13109 00000100:00100000:3.0:1746065149.855326:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263325184:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.855343:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3608575] (req 3145728->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.855350:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e890c00, rc 0) 00000100:00100000:3.0:1746065149.856312:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:32188:x1830881263490944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6550us (6902us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.856320:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13108 00000100:00100000:0.0:1746065149.858465:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.858754:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263491456 00000100:00100000:3.0:1746065149.858761:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263491456 00010000:00010000:3.0:1746065149.858814:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.858848:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5893 00000100:00100000:3.0:1746065149.858854:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263491456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.858868:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.858885:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.858895:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.858916:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc146f230 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93356d expref: 33 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.858950:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.858952:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.858958:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.858965:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.858989:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.859006:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263325312:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065149.859071:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065149.860251:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.860759:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263491712 00000100:00100000:2.0:1746065149.860765:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263491712 00002000:00100000:2.0:1746065149.860819:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800957d8000 x1830881263491712/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.860829:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8000 with x1830881263491712 ext(2097152->3145727) 00002000:00010000:2.0:1746065149.860833:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8000 00000100:00100000:2.0:1746065149.860849:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3693 00000100:00100000:2.0:1746065149.860855:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263491712:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065149.866710:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.867386:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263491840 00000100:00100000:0.0:1746065149.867395:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263491840 00010000:00010000:0.0:1746065149.867425:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 16 pid: 9550 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.867468:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5894 00000100:00100000:0.0:1746065149.867475:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263491840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065149.867488:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065149.867503:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065149 -> 1746065150 00002000:00010000:0.0:1746065149.867506:0:8352:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065149 -> 1746065150 00010000:00010000:0.0:1746065149.867512:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 16 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.867523:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 16 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.867542:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f261 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3842048->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933590 expref: 16 pid: 9550 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746065149.867575:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.867577:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.867584:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.867590:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.867616:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065149.867627:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263325440:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065149.867842:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.869760:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263325312:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065149.869798:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.869992:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263491456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11136us (11529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.870001:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5893 00000100:00100000:0.0:1746065149.871878:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.871988:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263492096 00000100:00100000:2.0:1746065149.871995:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263492096 00002000:00100000:2.0:1746065149.872033:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3604480->3608575) req@ffff8800957d9180 x1830881263492096/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.872041:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9180 with x1830881263492096 ext(3604480->3608575) 00002000:00010000:2.0:1746065149.872046:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9180 00000100:00100000:0.0:1746065149.872136:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.872164:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263325440:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065149.872178:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.872204:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263491840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4729us (5503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.872211:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5894 00000100:00100000:2.0:1746065149.872215:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3694 00000100:00100000:2.0:1746065149.872223:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263492096:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065149.872231:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263492224 00000100:00100000:3.0:1746065149.872233:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263492224 00000100:00100000:3.0:1746065149.872250:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13110 00000100:00100000:3.0:1746065149.872254:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+35:32200:x1830881263492224:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065149.872262:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.872274:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335ba expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.872293:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 36 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.872300:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065149.872494:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263492096:12345-192.168.202.27@tcp:3:cat.0 Request processed in 271us (620us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065149.872504:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3694 00002000:00100000:2.0:1746065149.872510:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3604480->3608575) req@ffff8800957d9180 x1830881263492096/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.872517:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9180 with x1830881263492096 ext(3604480->3608575) 00002000:00010000:2.0:1746065149.872519:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9180 00010000:00010000:3.0:1746065149.873118:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.873125:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.873126:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.873129:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1527808->1642495] (req 1527808->1642495) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 36 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.873154:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.873164:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 14 pid: 10219 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.873173:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263325568:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.873252:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.873259:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 10 pid: 13375 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.873265:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263325696:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065149.873810:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 36 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.873818:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 36 pid: 3067 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.873826:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263325824:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.873843:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065149.873918:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263491712:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13062us (13669us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.873925:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3693 00002000:00100000:2.0:1746065149.873930:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800957d8000 x1830881263491712/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.873949:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8000 with x1830881263491712 ext(2097152->3145727) 00002000:00010000:2.0:1746065149.873953:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8000 00000100:00100000:0.0:1746065149.874861:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.874937:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263492480 00000100:00100000:2.0:1746065149.874951:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263492480 00002000:00100000:2.0:1746065149.874976:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097242d80 x1830881263492480/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.874984:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097242d80 with x1830881263492480 ext(3145728->4194303) 00002000:00010000:2.0:1746065149.874987:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097242d80 00000100:00100000:2.0:1746065149.875013:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3695 00000100:00100000:2.0:1746065149.875019:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263492480:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065149.883726:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.883937:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263325568:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065149.883965:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263325696:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065149.887127:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.887149:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.887194:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263325824:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065149.887222:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1527808->1642495] (req 1527808->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 38 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065149.887237:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00000100:00100000:1.0:1746065149.887271:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+38:32200:x1830881263492224:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 15016us (15136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.887279:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13110 00000100:00100000:1.0:1746065149.887324:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.887343:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263492608 00000100:00100000:1.0:1746065149.887349:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263492608 00000100:00100000:3.0:1746065149.887364:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263492736 00010000:00010000:1.0:1746065149.887372:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 15 pid: 10219 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.887395:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263493120 00000100:00100000:1.0:1746065149.887397:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263493120 00010000:00010000:1.0:1746065149.887405:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 38 pid: 3067 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746065149.887419:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5895 00000100:00100000:1.0:1746065149.887424:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263492608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065149.887434:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065149.887449:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 15 pid: 10219 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.887462:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 15 pid: 10219 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746065149.887481:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc146f150 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334b0 expref: 15 pid: 10219 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746065149.887532:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263492992 00000100:00100000:0.0:1746065149.887536:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263492992 00000100:00100000:0.0:1746065149.887642:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4913 00000100:00100000:0.0:1746065149.887648:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+22:32188:x1830881263492992:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065149.887909:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5896 00000100:00100000:2.0:1746065149.887917:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263493120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065149.887925:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065149.887933:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 38 pid: 3067 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.887952:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 38 pid: 3067 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.887963:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc146f11f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933486 expref: 38 pid: 3067 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746065149.887975:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.887993:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263493120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.887998:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5896 00000100:00100000:2.0:1746065149.888186:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263492480:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13166us (13326us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.888192:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3695 00000100:00100000:3.0:1746065149.888199:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263492736 00002000:00100000:2.0:1746065149.888200:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097242d80 x1830881263492480/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.888208:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097242d80 with x1830881263492480 ext(3145728->4194303) 00002000:00010000:2.0:1746065149.888212:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097242d80 00010000:00010000:3.0:1746065149.888224:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 11 pid: 13375 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746065149.888243:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5897 00000100:00100000:3.0:1746065149.888247:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263492736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.888254:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065149.888261:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 11 pid: 13375 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.888270:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 11 pid: 13375 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.888282:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc146f222 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933558 expref: 11 pid: 13375 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746065149.888306:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.888308:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.888313:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.888320:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.888344:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.888358:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263325952:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065149.888398:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00010000:00010000:1.0:1746065149.888934:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065149.888962:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263492608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1537us (5242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065149.888968:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5895 00000100:00100000:0.0:1746065149.889219:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+23:32188:x1830881263492992:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1570us (2067us total) trans 8589935955 rc 0/0 00000100:00100000:0.0:1746065149.889225:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4913 00000100:00100000:1.0:1746065149.892624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.892932:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263325952:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065149.892959:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065149.893304:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263493376 00000100:00100000:2.0:1746065149.893310:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263493376 00002000:00100000:2.0:1746065149.893344:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1527808->1531903) req@ffff8800983b8380 x1830881263493376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.893353:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8380 with x1830881263493376 ext(1527808->1531903) 00002000:00010000:2.0:1746065149.893357:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b8380 00000100:00100000:2.0:1746065149.893383:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3696 00000100:00100000:2.0:1746065149.893390:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263493376:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065149.893605:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263492736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5355us (6484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.893614:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5897 00000100:00100000:1.0:1746065149.893729:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.894120:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263493376:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 728us (1500us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065149.894130:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3696 00002000:00100000:2.0:1746065149.894136:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1527808->1531903) req@ffff8800983b8380 x1830881263493376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.894143:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8380 with x1830881263493376 ext(1527808->1531903) 00002000:00010000:2.0:1746065149.894146:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b8380 00000100:00100000:1.0:1746065149.894314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.895080:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263493504 00000100:00100000:0.0:1746065149.895085:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263493504 00000100:00100000:0.0:1746065149.895120:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263493632 00000100:00100000:0.0:1746065149.895122:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263493632 00000100:00100000:0.0:1746065149.895134:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13111 00000100:00100000:0.0:1746065149.895139:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+14:32197:x1830881263493504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065149.895148:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.895160:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335c1 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.895177:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.895179:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065149.895184:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.895195:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.895202:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2400, rc 0) 00000100:00100000:0.0:1746065149.895223:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:32197:x1830881263493504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 84us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.895228:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13111 00000100:00100000:0.0:1746065149.895238:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13112 00000100:00100000:0.0:1746065149.895241:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:32186:x1830881263493632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065149.895246:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065149.895252:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335c8 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.895265:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.895274:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065149.895275:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065149.895278:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 33 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.895296:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.895304:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 14 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746065149.895313:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263326080:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065149.895351:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.898570:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.898625:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.898802:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263326080:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065149.898832:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 33 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065149.898846:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2e00, rc 0) 00000100:00100000:2.0:1746065149.899704:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263493888 00000100:00100000:2.0:1746065149.899710:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263493888 00002000:00100000:2.0:1746065149.899744:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1638400->1642495) req@ffff88009acedc00 x1830881263493888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.899752:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acedc00 with x1830881263493888 ext(1638400->1642495) 00002000:00010000:2.0:1746065149.899756:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acedc00 00000100:00100000:0.0:1746065149.899946:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:32186:x1830881263493632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4693us (5622us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065149.899954:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13112 00000100:00100000:2.0:1746065149.900307:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263494016 00000100:00100000:2.0:1746065149.900311:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263494016 00002000:00100000:2.0:1746065149.900325:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3608575) req@ffff88009acef480 x1830881263494016/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.900332:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef480 with x1830881263494016 ext(3145728->3608575) 00010000:00010000:2.0:1746065149.900337:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 15 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746065149.900348:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 15 pid: 3068 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746065149.900357:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acef480 00000100:00100000:1.0:1746065149.900385:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1293 00000100:00100000:1.0:1746065149.900392:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263494016:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065149.900508:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3697 00000100:00100000:1.0:1746065149.900514:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263493888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065149.901344:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263493888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 827us (2776us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065149.901349:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3697 00002000:00100000:1.0:1746065149.901355:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1638400->1642495) req@ffff88009acedc00 x1830881263493888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.901361:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acedc00 with x1830881263493888 ext(1638400->1642495) 00002000:00010000:1.0:1746065149.901365:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acedc00 00000100:00100000:0.0:1746065149.901534:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.901814:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263494272 00000100:00100000:1.0:1746065149.901818:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263494272 00002000:00100000:1.0:1746065149.901835:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097240e00 x1830881263494272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.901841:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097240e00 with x1830881263494272 ext(3145728->4194303) 00002000:00010000:1.0:1746065149.901844:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097240e00 00000100:00100000:1.0:1746065149.901854:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3698 00000100:00100000:1.0:1746065149.901859:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263494272:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:3.0:1746065149.909086:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065149.911926:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263494016:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11526us (13291us total) trans 17179873455 rc 0/0 00000100:00100000:1.0:1746065149.911945:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1293 00002000:00100000:1.0:1746065149.911956:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3608575) req@ffff88009acef480 x1830881263494016/t17179873455(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/448 e 0 to 0 dl 1746065160 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.911964:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef480 with x1830881263494016 ext(3145728->3608575) 00010000:00010000:1.0:1746065149.911973:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 17 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746065149.911986:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 17 pid: 3068 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746065149.911992:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acef480 00000100:00100000:1.0:1746065149.912711:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263494272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10850us (11176us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065149.912718:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3698 00002000:00100000:1.0:1746065149.912723:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097240e00 x1830881263494272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.912730:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097240e00 with x1830881263494272 ext(3145728->4194303) 00002000:00010000:1.0:1746065149.912733:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097240e00 00000100:00100000:0.0:1746065149.919064:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.919155:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263494400 00000100:00100000:3.0:1746065149.919163:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263494400 00010000:00010000:3.0:1746065149.919194:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 17 pid: 3068 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746065149.919232:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5898 00000100:00100000:3.0:1746065149.919240:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263494400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065149.919254:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065149.919267:0:9565:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065149 -> 1746065150 00002000:00010000:3.0:1746065149.919270:0:9565:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065149 -> 1746065150 00002000:00010000:3.0:1746065149.919271:0:9565:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065149 -> 1746065150 00010000:00010000:3.0:1746065149.919276:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 17 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.919286:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 17 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.919312:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc146f27d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335a5 expref: 17 pid: 3068 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746065149.919340:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.919342:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065149.919348:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.919356:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065149.919385:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.919396:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263326208:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065149.919463:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065149.924183:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263326208:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065149.924201:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065149.924239:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263494400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4999us (5182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065149.924248:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5898 00000100:00100000:0.0:1746065149.926467:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065149.926603:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263494528 00000100:00100000:2.0:1746065149.926611:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263494528 00000100:00100000:2.0:1746065149.926739:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13113 00000100:00100000:2.0:1746065149.926747:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+16:32197:x1830881263494528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065149.926762:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065149.926840:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335cf expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.926867:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.926869:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065149.926875:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 17 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.926887:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 17 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065149.926895:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67400, rc 0) 00000100:00100000:2.0:1746065149.926936:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+17:32197:x1830881263494528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 190us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065149.926952:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13113 00000100:00100000:0.0:1746065149.934553:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.934609:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263494784 00000100:00100000:1.0:1746065149.934618:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263494784 00002000:00100000:1.0:1746065149.934657:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097241c00 x1830881263494784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.934665:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097241c00 with x1830881263494784 ext(3145728->4194303) 00002000:00010000:1.0:1746065149.934670:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097241c00 00000100:00100000:2.0:1746065149.935886:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3699 00000100:00100000:2.0:1746065149.935898:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263494784:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065149.937200:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.937552:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263495040 00000100:00100000:1.0:1746065149.937559:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263495040 00002000:00100000:1.0:1746065149.937588:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097243b80 x1830881263495040/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.937597:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243b80 with x1830881263495040 ext(3145728->4194303) 00002000:00010000:1.0:1746065149.937601:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097243b80 00000100:00100000:1.0:1746065149.939422:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3700 00000100:00100000:1.0:1746065149.939436:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263495040:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065149.947885:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263494784:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11981us (13331us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065149.947895:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3699 00002000:00100000:2.0:1746065149.947904:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097241c00 x1830881263494784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065149.947912:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097241c00 with x1830881263494784 ext(3145728->4194303) 00002000:00010000:2.0:1746065149.947917:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097241c00 00000100:00100000:1.0:1746065149.952028:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263495040:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12587us (14822us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065149.952039:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3700 00002000:00100000:1.0:1746065149.952049:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097243b80 x1830881263495040/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.952057:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243b80 with x1830881263495040 ext(3145728->4194303) 00002000:00010000:1.0:1746065149.952063:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097243b80 00000100:00100000:0.0:1746065149.957153:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065149.957602:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263495296 00000100:00100000:1.0:1746065149.957611:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263495296 00002000:00100000:1.0:1746065149.957649:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097241500 x1830881263495296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.957658:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097241500 with x1830881263495296 ext(4194304->5021695) 00002000:00010000:1.0:1746065149.957663:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097241500 00000100:00100000:1.0:1746065149.957696:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3701 00000100:00100000:1.0:1746065149.957704:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263495296:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065149.958719:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.960044:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263495424 00000100:00100000:3.0:1746065149.960052:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263495424 00000100:00100000:3.0:1746065149.960089:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13114 00000100:00100000:3.0:1746065149.960095:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263495424:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.960112:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.960127:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f2bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335d6 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.960169:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326336:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065149.960239:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00002000:00010000:3.0:1746065149.965318:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746065148 -> 1746065150 00002000:00010000:3.0:1746065149.965323:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065148 -> 1746065150 00002000:00010000:3.0:1746065149.965325:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746065148 -> 1746065150 00000100:00100000:3.0:1746065149.965342:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326336:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065149.965367:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f2bc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335d6 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065149.965379:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f2bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335d6 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065149.966771:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263495296:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9062us (9621us total) trans 0 rc 827392/827392 00000100:00100000:0.0:1746065149.966797:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3701 00002000:00100000:0.0:1746065149.966805:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097241500 x1830881263495296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.966813:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097241500 with x1830881263495296 ext(4194304->5021695) 00002000:00010000:0.0:1746065149.966818:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097241500 00010000:00010000:3.0:1746065149.966884:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45800, rc 0) 00000100:00100000:3.0:1746065149.966909:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263495424:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6813us (8191us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065149.966915:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13114 00000100:00100000:2.0:1746065149.975000:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065149.975078:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263495680 00000100:00100000:0.0:1746065149.975086:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263495680 00002000:00100000:0.0:1746065149.975118:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012f1a5500 x1830881263495680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/0 e 0 to 0 dl 1746065160 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065149.975127:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5500 with x1830881263495680 ext(4194304->5021695) 00002000:00010000:0.0:1746065149.975131:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5500 00000100:00100000:0.0:1746065149.975147:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3702 00000100:00100000:0.0:1746065149.975153:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263495680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065149.991157:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263495680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15994us (16155us total) trans 0 rc 827392/827392 00000100:00100000:1.0:1746065149.991168:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3702 00002000:00100000:1.0:1746065149.991178:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012f1a5500 x1830881263495680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:65/0 lens 488/440 e 0 to 0 dl 1746065160 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065149.991186:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5500 with x1830881263495680 ext(4194304->5021695) 00002000:00010000:1.0:1746065149.991191:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a5500 00000100:00100000:0.0:1746065149.997267:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065149.998933:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263495808 00000100:00100000:3.0:1746065149.998951:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263495808 00000100:00100000:3.0:1746065149.999095:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13115 00000100:00100000:3.0:1746065149.999104:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263495808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065149.999119:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065149.999135:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f2c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335dd expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065149.999180:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326464:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065150.000298:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 10 seconds 00000100:00100000:3.0:1746065150.002431:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326464:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065150.002458:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f2c3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335dd expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.002470:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f2c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335dd expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.002494:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:3.0:1746065150.002546:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263495808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3441us (5284us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.002554:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13115 00000100:00100000:0.0:1746065150.007298:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.007442:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263495936 00000100:00100000:3.0:1746065150.007451:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263495936 00000100:00100000:3.0:1746065150.007502:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13116 00000100:00100000:3.0:1746065150.007509:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263495936:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.007525:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.007539:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc146f2ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335e4 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.007583:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326592:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065150.007660:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.010634:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326592:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065150.010664:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc146f2ca lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335e4 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.010676:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45400/0xad6b7ddc146f2ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335e4 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.010736:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45400, rc 0) 00000100:00100000:3.0:1746065150.010915:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263495936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3404us (3623us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.010923:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13116 00000100:00100000:0.0:1746065150.096646:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.096900:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263496192 00000100:00100000:1.0:1746065150.096908:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263496192 00002000:00100000:1.0:1746065150.096957:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097242680 x1830881263496192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 504/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.096965:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097242680 with x1830881263496192 ext(1048576->2097151) 00002000:00010000:1.0:1746065150.096969:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097242680 00000100:00100000:1.0:1746065150.097000:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3703 00000100:00100000:1.0:1746065150.097007:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263496192:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065150.110695:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263496192:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13679us (14047us total) trans 0 rc 933888/933888 00000100:00100000:1.0:1746065150.110707:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3703 00002000:00100000:1.0:1746065150.110718:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097242680 x1830881263496192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 504/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.110727:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097242680 with x1830881263496192 ext(1048576->2097151) 00002000:00010000:1.0:1746065150.110733:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097242680 00000100:00100000:0.0:1746065150.127701:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.127903:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.129162:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263496448 00000100:00100000:1.0:1746065150.129172:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263496448 00002000:00100000:1.0:1746065150.129211:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880097243800 x1830881263496448/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.129219:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243800 with x1830881263496448 ext(2097152->3145727) 00002000:00010000:1.0:1746065150.129224:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097243800 00000100:00100000:1.0:1746065150.129252:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263496704 00000100:00100000:1.0:1746065150.129255:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263496704 00002000:00100000:1.0:1746065150.129267:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880097240000 x1830881263496704/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.129274:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097240000 with x1830881263496704 ext(2097152->3145727) 00002000:00010000:1.0:1746065150.129276:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097240000 00000100:00100000:1.0:1746065150.129499:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3704 00000100:00100000:1.0:1746065150.129506:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263496448:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065150.129866:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3705 00000100:00100000:2.0:1746065150.129873:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263496704:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065150.137621:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.137716:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263496960 00000100:00100000:2.0:1746065150.137725:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263496960 00000100:00100000:2.0:1746065150.137800:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13624 00000100:00100000:2.0:1746065150.137807:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+23:32209:x1830881263496960:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065150.137828:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.137843:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146f2d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335eb expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.137925:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065150.137949:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065150.137960:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065150.137970:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065150.138043:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc146f2d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 26 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.138061:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 25 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.138067:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065150.138069:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065150.138071:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc200, rc 0) 00000100:00100000:2.0:1746065150.138126:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+25:32209:x1830881263496960:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 319us (512us total) trans 8589935956 rc 0/0 00000100:00100000:2.0:1746065150.138134:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13624 00000100:00100000:2.0:1746065150.145346:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263496448:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15832us (17644us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065150.145356:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3704 00002000:00100000:2.0:1746065150.145366:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880097243800 x1830881263496448/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.145375:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097243800 with x1830881263496448 ext(2097152->3145727) 00002000:00010000:2.0:1746065150.145380:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097243800 00000100:00100000:2.0:1746065150.148926:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263496704:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19041us (21009us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065150.148948:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3705 00002000:00100000:2.0:1746065150.148957:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880097240000 x1830881263496704/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.148965:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097240000 with x1830881263496704 ext(2097152->3145727) 00002000:00010000:2.0:1746065150.148971:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097240000 00000100:00100000:0.0:1746065150.235868:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.235930:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263497088 00000100:00100000:3.0:1746065150.235983:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263497088 00000100:00100000:3.0:1746065150.236187:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13117 00000100:00100000:3.0:1746065150.236196:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263497088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.236212:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.236225:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f2e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335f2 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.236266:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326720:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065150.236593:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.239017:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326720:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065150.239041:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f2e6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f2 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.239055:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f2e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f2 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.239081:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45e00, rc 0) 00000100:00100000:3.0:1746065150.239126:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263497088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2930us (3265us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.239134:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13117 00000100:00100000:0.0:1746065150.247131:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.247578:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263497216 00000100:00100000:3.0:1746065150.247588:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263497216 00000100:00100000:3.0:1746065150.247652:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13118 00000100:00100000:3.0:1746065150.247660:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+15:32215:x1830881263497216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.247676:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.247690:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9335f9 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.247716:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.247723:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065150.247725:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065150.247729:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.247758:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.247806:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 34 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.247823:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326848:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.254589:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.256506:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.256706:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263326848:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.256727:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.256741:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44a00, rc 0) 00000100:00100000:3.0:1746065150.256817:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+16:32215:x1830881263497216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9157us (9693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.256824:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13118 00000100:00100000:2.0:1746065150.257510:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263497344 00000100:00100000:2.0:1746065150.257600:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263497344 00002000:00100000:2.0:1746065150.257633:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1527808->1642495) req@ffff880097e54e00 x1830881263497344/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.257641:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e54e00 with x1830881263497344 ext(1527808->1642495) 00010000:00010000:2.0:1746065150.257647:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 35 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.257659:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 35 pid: 3068 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746065150.257665:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097e54e00 00000100:00100000:2.0:1746065150.257689:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1294 00000100:00100000:2.0:1746065150.257695:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263497344:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065150.268088:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263497344:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10384us (11580us total) trans 21474840904 rc 0/0 00000100:00100000:0.0:1746065150.268099:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1294 00002000:00100000:0.0:1746065150.268109:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1527808->1642495) req@ffff880097e54e00 x1830881263497344/t21474840904(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/448 e 0 to 0 dl 1746065161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.268117:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e54e00 with x1830881263497344 ext(1527808->1642495) 00010000:00010000:0.0:1746065150.268127:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 37 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.268142:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 37 pid: 3068 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746065150.268148:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097e54e00 00000100:00100000:0.0:1746065150.271693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.271801:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263497472 00000100:00100000:3.0:1746065150.271809:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263497472 00010000:00010000:3.0:1746065150.271839:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 37 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.272460:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5899 00000100:00100000:3.0:1746065150.272469:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263497472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.272480:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.272497:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 37 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.272507:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 37 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.272531:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44000/0xad6b7ddc146f2a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1642495) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ba expref: 37 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.272934:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.272944:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.272951:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.272959:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.272991:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.273001:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263326976:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065150.273258:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.275617:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263326976:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065150.275631:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.275673:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263497472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3205us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.275681:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5899 00000100:00100000:0.0:1746065150.276876:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.277002:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263497728 00000100:00100000:2.0:1746065150.277008:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263497728 00002000:00100000:2.0:1746065150.277045:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097e55880 x1830881263497728/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.277053:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e55880 with x1830881263497728 ext(1048576->2097151) 00002000:00010000:2.0:1746065150.277057:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e55880 00000100:00100000:2.0:1746065150.277073:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3706 00000100:00100000:2.0:1746065150.277079:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263497728:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065150.289046:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263497728:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11958us (12366us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065150.289055:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3706 00002000:00100000:2.0:1746065150.289064:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097e55880 x1830881263497728/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.289073:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e55880 with x1830881263497728 ext(1048576->2097151) 00002000:00010000:2.0:1746065150.289079:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e55880 00000100:00100000:0.0:1746065150.296596:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.297705:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263497984 00000100:00100000:2.0:1746065150.297713:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263497984 00002000:00100000:2.0:1746065150.297753:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880097e54700 x1830881263497984/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.297768:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e54700 with x1830881263497984 ext(2097152->3145727) 00002000:00010000:2.0:1746065150.297787:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e54700 00000100:00100000:2.0:1746065150.298016:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3707 00000100:00100000:2.0:1746065150.298023:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263497984:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065150.322149:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263497984:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24116us (25552us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065150.322164:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3707 00002000:00100000:2.0:1746065150.322174:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880097e54700 x1830881263497984/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.322182:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e54700 with x1830881263497984 ext(2097152->3145727) 00002000:00010000:2.0:1746065150.322188:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e54700 00000100:00100000:0.0:1746065150.327450:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.328104:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263498112 00000100:00100000:3.0:1746065150.328113:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263498112 00000100:00100000:3.0:1746065150.328172:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13625 00000100:00100000:3.0:1746065150.328180:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32216:x1830881263498112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065150.328206:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.328222:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45600/0xad6b7ddc146f2f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933600 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.328285:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.328297:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.328306:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.328317:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.328322:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.328327:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.328514:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.328525:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 45 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.328532:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.328538:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.328571:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.328582:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 24 pid: 13395 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.328594:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263327104:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.329291:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 45 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.329299:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 45 pid: 13395 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.329596:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263327232:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.329625:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.340596:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.340690:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263327104:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.340701:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263327232:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.340722:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065150.341302:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263498240 00000100:00100000:2.0:1746065150.341309:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263498240 00010000:00010000:2.0:1746065150.341334:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 25 pid: 13395 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.341361:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5900 00000100:00100000:2.0:1746065150.341368:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+25:2006:x1830881263498240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.341379:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.341383:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 25 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.341391:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 25 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.341412:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc200/0xad6b7ddc146f2d8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335eb expref: 25 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.341428:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065150.341432:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.341439:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.341444:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.341448:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.341478:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263498240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 110us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.341484:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5900 00000100:00100000:1.0:1746065150.341824:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.341847:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263498368 00000100:00100000:0.0:1746065150.341851:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263498368 00010000:00010000:0.0:1746065150.341866:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 46 pid: 13395 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.341893:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5901 00000100:00100000:0.0:1746065150.341898:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881263498368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.341905:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.341909:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 46 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.341917:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 46 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.341928:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc146f28b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335ac expref: 46 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.341947:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.341949:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.341956:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.341961:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.342004:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.342027:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881263498368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 127us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.342035:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5901 00010000:00010000:3.0:1746065150.342089:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342097:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065150.342140:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065150.342145:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065150.342160:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342169:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342179:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342184:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342189:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342195:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342199:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065150.342203:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342243:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342251:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065150.342254:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065150.342256:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342261:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc146f2fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342286:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342298:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342302:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342306:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065150.342308:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342313:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342318:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a400) 00010000:00010000:3.0:1746065150.342320:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065150.342322:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342326:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc146f302 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.342352:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45600/0xad6b7ddc146f2f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.342361:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 15 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.342366:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065150.342368:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065150.342370:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45400, rc 0) 00000100:00100000:3.0:1746065150.342407:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:32216:x1830881263498112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 14227us (15639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.342413:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13625 00000100:00100000:0.0:1746065150.348742:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.348843:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.348894:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.349015:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263498496 00000100:00100000:3.0:1746065150.349025:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263498496 00000100:00100000:3.0:1746065150.349066:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263498624 00000100:00100000:3.0:1746065150.349069:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263498624 00000100:00100000:3.0:1746065150.349086:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263498752 00000100:00100000:3.0:1746065150.349089:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263498752 00000100:00100000:3.0:1746065150.349118:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13119 00000100:00100000:3.0:1746065150.349127:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263498496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065150.349145:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.349163:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933607 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.349184:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.349186:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.349195:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.349209:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.349219:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:3.0:1746065150.349267:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263498496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 140us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.349274:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13119 00000100:00100000:3.0:1746065150.349293:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13120 00000100:00100000:3.0:1746065150.354052:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263498624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065150.354075:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.354092:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93360e expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.354113:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.354115:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.354122:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.354137:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.354146:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45800, rc 0) 00000100:00100000:3.0:1746065150.354193:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263498624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 163us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.354453:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13121 00000100:00100000:1.0:1746065150.354464:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263498752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065150.354474:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065150.354483:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933615 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.354494:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.354495:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.354500:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065150.354511:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065150.354517:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856400, rc 0) 00000100:00100000:1.0:1746065150.354535:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263498752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 74us (5643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.354540:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13121 00000100:00100000:3.0:1746065150.355731:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13120 00000100:00100000:0.0:1746065150.359318:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.359432:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263498880 00000100:00100000:3.0:1746065150.359443:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263498880 00000100:00100000:3.0:1746065150.359503:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13122 00000100:00100000:3.0:1746065150.359512:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:32211:x1830881263498880:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065150.359531:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.359550:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93361c expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.359582:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.359597:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.359604:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.359611:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.359617:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065150.359619:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065150.359622:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 7/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 34 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.359656:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.359668:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.359682:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263327360:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.359817:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.359826:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 8 pid: 13375 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.359835:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263327488:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.359877:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.359885:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 34 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.359893:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263327616:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.359919:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.359927:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 16 pid: 9550 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.359947:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263327744:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.359969:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.360918:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.361004:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263499136 00000100:00100000:3.0:1746065150.361009:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263499136 00000100:00100000:3.0:1746065150.361052:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13626 00000100:00100000:3.0:1746065150.361059:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:32216:x1830881263499136:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065150.361071:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.361084:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146f32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933623 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.361172:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.361184:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.361189:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.361206:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.361214:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 16 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.361221:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263327872:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.361276:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.365157:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.365540:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263327360:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.365551:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263327488:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.365559:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263327616:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.365566:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263327744:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.365602:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 34 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.365618:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45e00, rc 0) 00000100:00100000:2.0:1746065150.366430:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263499264 00000100:00100000:2.0:1746065150.366437:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263499264 00010000:00010000:2.0:1746065150.366464:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 17 pid: 9550 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.366652:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+34:32211:x1830881263498880:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7139us (7349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.366660:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13122 00000100:00100000:2.0:1746065150.366763:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5902 00000100:00100000:2.0:1746065150.366770:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263499264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.366792:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.366809:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 17 pid: 9550 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.366822:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 17 pid: 9550 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.366840:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146f299 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335b3 expref: 17 pid: 9550 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.366854:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.366866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.366873:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263499264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.366878:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5902 00000100:00100000:2.0:1746065150.366888:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263499392 00000100:00100000:2.0:1746065150.366890:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263499392 00010000:00010000:2.0:1746065150.366898:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 9 pid: 13375 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746065150.366898:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.366921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.367131:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263499648 00000100:00100000:2.0:1746065150.367134:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263499648 00010000:00010000:2.0:1746065150.367144:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.367153:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263499520 00000100:00100000:2.0:1746065150.367155:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263499520 00010000:00010000:2.0:1746065150.367161:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 34 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.367164:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.367168:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263499776 00000100:00100000:2.0:1746065150.367169:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263499776 00010000:00010000:2.0:1746065150.367178:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 17 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.367187:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5903 00000100:00100000:0.0:1746065150.367193:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263499392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065150.367194:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5904 00000100:00100000:2.0:1746065150.367198:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263499648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.367200:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.367204:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.367207:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 9 pid: 13375 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.367208:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.367215:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 9 pid: 13375 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.367325:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5905 00000100:00100000:3.0:1746065150.367330:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263499520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.367336:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065150.367417:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5906 00000100:00100000:1.0:1746065150.367424:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263499776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065150.367430:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065150.367435:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 17 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.367441:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 17 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.367454:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065150.367457:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.367465:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.367470:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.367482:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.367499:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263499776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.367504:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5906 00010000:00010000:2.0:1746065150.367639:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.367653:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc146f31e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933615 expref: 9 pid: 13375 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.367655:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc146f2b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335cf expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.367662:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065150.367665:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.367678:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263499648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 480us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.367678:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263499392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 487us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.367683:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5904 00000100:00100000:0.0:1746065150.367686:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5903 00010000:00010000:0.0:1746065150.367713:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146f309 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933600 expref: 16 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.367723:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263327872:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065150.367734:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.367740:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.367744:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065150.367763:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065150.367883:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc146f32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 17 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.367894:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.367900:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.367901:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065150.367903:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00010000:00010000:3.0:1746065150.367904:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 34 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.367912:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 34 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.367922:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32216:x1830881263499136:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6864us (7008us total) trans 8589935957 rc 0/0 00010000:00010000:3.0:1746065150.367923:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc146f2ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c8 expref: 34 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.367928:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13626 00010000:00010000:3.0:1746065150.367947:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.367949:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.367954:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.367961:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.367982:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.367992:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263328000:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065150.368051:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.368975:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.369541:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263499904 00000100:00100000:3.0:1746065150.369545:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263499904 00000100:00100000:0.0:1746065150.369862:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.369876:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263500032 00000100:00100000:0.0:1746065150.369879:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263500032 00000100:00100000:0.0:1746065150.369915:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13627 00000100:00100000:3.0:1746065150.370000:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13123 00000100:00100000:3.0:1746065150.370007:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+15:32209:x1830881263499904:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:0.0:1746065150.370009:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32216:x1830881263500032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065150.370019:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.370021:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.370031:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93362a expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.370031:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146f341 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933631 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.370051:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 33 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.370057:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.370063:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.370067:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.370069:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.370072:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.370092:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.370093:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.370102:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 7 pid: 12258 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.370103:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 17 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.370109:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065150.370117:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263328128:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065150.370122:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 17 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.370128:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 17 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.370134:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b03100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263328256:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065150.370168:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00010000:00010000:3.0:1746065150.370527:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.370535:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 16 pid: 12258 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.370542:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263328384:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.370567:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263328000:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065150.370577:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.370595:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263499520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3264us (3673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.370601:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5905 00010000:00010000:3.0:1746065150.370655:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.370663:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 32 pid: 9548 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.370670:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263328512:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.370688:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.370712:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.370945:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263500288 00000100:00100000:3.0:1746065150.370949:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263500288 00002000:00100000:3.0:1746065150.370971:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3072000->3076095) req@ffff880134b01180 x1830881263500288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.370980:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881263500288 ext(3072000->3076095) 00002000:00010000:3.0:1746065150.370984:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01180 00000100:00100000:3.0:1746065150.371009:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3708 00000100:00100000:3.0:1746065150.371016:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263500288:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065150.371115:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263500288:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 98us (402us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065150.371120:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3708 00002000:00100000:3.0:1746065150.371125:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (3072000->3076095) req@ffff880134b01180 x1830881263500288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.371131:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881263500288 ext(3072000->3076095) 00002000:00010000:3.0:1746065150.371134:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01180 00000100:00100000:2.0:1746065150.372841:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b03100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263328256:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.372858:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065150.373465:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263328128:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065150.375842:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.375870:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.375892:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.375910:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263500416 00000100:00100000:0.0:1746065150.375916:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263500416 00010000:00010000:0.0:1746065150.375954:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 18 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.375979:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263500672 00000100:00100000:0.0:1746065150.375981:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263500672 00010000:00010000:0.0:1746065150.375993:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 17 pid: 12258 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746065150.376003:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263500544 00000100:00100000:0.0:1746065150.376005:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263500544 00010000:00010000:0.0:1746065150.376012:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 8 pid: 12258 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746065150.376025:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5907 00000100:00100000:0.0:1746065150.376031:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2006:x1830881263500416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.376043:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.376049:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 18 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.376056:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 18 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.376074:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f333 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933623 expref: 18 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.376086:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.376090:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.376097:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.376103:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.376119:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.376152:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263500416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 120us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.376158:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5907 00000100:00100000:0.0:1746065150.376171:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5908 00000100:00100000:0.0:1746065150.376175:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263500672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.376183:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.376199:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 17 pid: 12258 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.376206:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 17 pid: 12258 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.376219:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.376234:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263500672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.376239:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5908 00000100:00100000:0.0:1746065150.376247:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5909 00000100:00100000:0.0:1746065150.376251:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263500544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.376257:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.376262:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 8 pid: 12258 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.376270:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 8 pid: 12258 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.376279:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3c00/0xad6b7ddc146f214 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933551 expref: 8 pid: 12258 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.376288:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.376301:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2006:x1830881263500544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.376308:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5909 00010000:00010000:3.0:1746065150.376633:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c719c00/0xad6b7ddc146f245 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93357b expref: 16 pid: 12258 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.376643:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263328384:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.376652:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263328512:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.376674:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.376683:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73800, rc 0) 00000100:00100000:3.0:1746065150.376703:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+15:32209:x1830881263499904:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6697us (7731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.376709:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13123 00010000:00010000:3.0:1746065150.376740:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.376745:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065150.376804:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065150.376808:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065150.376822:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.376846:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc146f341 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 17 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.376855:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.376861:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065150.376863:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065150.376865:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:3.0:1746065150.376886:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32216:x1830881263500032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6966us (7025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.376892:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13627 00000100:00100000:1.0:1746065150.378933:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.379053:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263500800 00000100:00100000:2.0:1746065150.379060:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263500800 00010000:00010000:2.0:1746065150.379084:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 33 pid: 9548 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.379123:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5910 00000100:00100000:2.0:1746065150.379129:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263500800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.379140:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.379154:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 33 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.379164:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 33 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.379179:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146f1ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933520 expref: 33 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.379192:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.379193:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.379198:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.379205:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.379230:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.379240:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263328640:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065150.379297:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.380282:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.380296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.380312:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.380385:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263500928 00000100:00100000:1.0:1746065150.380389:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263500928 00000100:00100000:1.0:1746065150.380410:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263501056 00000100:00100000:1.0:1746065150.380412:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263501056 00000100:00100000:1.0:1746065150.380423:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263501184 00000100:00100000:1.0:1746065150.380424:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263501184 00000100:00100000:1.0:1746065150.380435:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13124 00000100:00100000:1.0:1746065150.380439:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263500928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065150.380450:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065150.380460:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc146f356 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933638 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065150.380487:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263328768:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065150.380523:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065150.380536:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13125 00000100:00100000:1.0:1746065150.380540:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263501056:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065150.380545:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065150.380549:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146f35d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93363f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065150.380566:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263328896:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065150.380581:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065150.380589:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13126 00000100:00100000:1.0:1746065150.380593:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:32211:x1830881263501184:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065150.380597:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065150.380604:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933646 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.380615:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 37 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.380622:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065150.380628:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.380632:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.380633:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.380636:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4108287] (req 3145728->4108287) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.380652:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.380660:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 15 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746065150.380667:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263329024:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065150.380685:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065150.380691:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 11 pid: 12260 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746065150.380698:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263329152:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065150.380715:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 37 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.380722:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 37 pid: 9550 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746065150.380728:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263329280:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065150.380741:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.393713:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263328640:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065150.393731:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.393786:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263500800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 14641us (14843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.393795:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5910 00000100:00100000:2.0:1746065150.393952:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.393965:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263501312 00000100:00100000:2.0:1746065150.393970:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263501312 00010000:00010000:2.0:1746065150.393991:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 12 pid: 12260 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.394010:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5911 00000100:00100000:2.0:1746065150.394015:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263501312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.394028:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.394044:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 12 pid: 12260 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.394053:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 12 pid: 12260 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.394073:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.394091:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263501312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.394096:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5911 00000100:00100000:2.0:1746065150.394125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.394175:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.394185:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263501696 00000100:00100000:2.0:1746065150.394189:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263501696 00010000:00010000:2.0:1746065150.394200:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 38 pid: 9550 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.394220:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5912 00000100:00100000:2.0:1746065150.394224:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263501696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.394230:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.394236:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 38 pid: 9550 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.394243:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 38 pid: 9550 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.394253:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.394266:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263501696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.394271:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5912 00000100:00100000:2.0:1746065150.394304:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.394314:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263501824 00000100:00100000:2.0:1746065150.394317:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263501824 00010000:00010000:2.0:1746065150.394326:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.394337:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5913 00000100:00100000:2.0:1746065150.394342:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263501824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.394347:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.394353:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.394361:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.394371:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.394373:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.394379:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.394386:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.394409:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 37 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.394419:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263329408:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065150.394459:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.394537:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263328896:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065150.394556:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146f35d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93363f expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.394565:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc146f35d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93363f expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.394577:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:2.0:1746065150.394598:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263501056:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 14057us (14301us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.394604:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13125 00010000:00010000:2.0:1746065150.394631:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146f2a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335c1 expref: 16 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.394640:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263329024:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.394650:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f317 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93360e expref: 11 pid: 12260 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.394656:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263329152:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.394663:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc146f276 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93359e expref: 37 pid: 9550 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.394669:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263329280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.394683:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.394690:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:2.0:1746065150.394705:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:32211:x1830881263501184:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 14111us (14392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.394710:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13126 00000100:00100000:2.0:1746065150.394767:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263501568 00000100:00100000:2.0:1746065150.394770:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263501568 00002000:00100000:2.0:1746065150.394807:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1953792->1957887) req@ffff880090ddb480 x1830881263501568/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.394820:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb480 with x1830881263501568 ext(1953792->1957887) 00002000:00010000:2.0:1746065150.394824:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090ddb480 00000100:00100000:2.0:1746065150.394833:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3709 00000100:00100000:2.0:1746065150.394837:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263501568:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065150.394912:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263501568:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 74us (787us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065150.394916:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3709 00002000:00100000:2.0:1746065150.394920:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1953792->1957887) req@ffff880090ddb480 x1830881263501568/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.394926:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb480 with x1830881263501568 ext(1953792->1957887) 00002000:00010000:2.0:1746065150.394928:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090ddb480 00002000:00010000:2.0:1746065150.395148:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime: 1746065149 -> 1746065150 00002000:00010000:2.0:1746065150.395151:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime: 1746065149 -> 1746065150 00002000:00010000:2.0:1746065150.395152:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime: 1746065149 -> 1746065150 00000100:00100000:2.0:1746065150.395159:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263328768:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065150.395173:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc146f356 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933638 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.395181:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc146f356 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933638 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.395187:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856600, rc 0) 00000100:00100000:2.0:1746065150.395207:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263500928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 14767us (14927us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.395212:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13124 00000100:00100000:0.0:1746065150.398330:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.398473:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263501952 00000100:00100000:3.0:1746065150.398479:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263501952 00000100:00100000:3.0:1746065150.398523:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13127 00000100:00100000:3.0:1746065150.398529:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+16:32209:x1830881263501952:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065150.398543:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.398556:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93364d expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.398577:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 17 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.398584:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.398589:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.398590:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.398593:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1871871] (req 1048576->1871871) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.398615:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.398625:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 10 pid: 12260 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.398635:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263329536:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.398707:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 17 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.398715:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 17 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.398726:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263329664:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.398745:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.403000:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263329408:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065150.403022:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.403077:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263501824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8733us (8771us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.403087:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5913 00000100:00100000:0.0:1746065150.408002:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.410395:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263502080 00000100:00100000:2.0:1746065150.410405:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263502080 00000100:00100000:2.0:1746065150.410451:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13128 00000100:00100000:2.0:1746065150.410458:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263502080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.410472:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.410487:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146f372 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933654 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.410531:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263329792:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065150.410980:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.412218:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263502208 00000100:00100000:3.0:1746065150.412224:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263502208 00000100:00100000:3.0:1746065150.412251:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13129 00000100:00100000:3.0:1746065150.412257:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263502208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.412266:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.412277:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae1f200/0xad6b7ddc146f379 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93365b expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.412290:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.412297:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae1f200/0xad6b7ddc146f379 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93365b expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.412305:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae1f200/0xad6b7ddc146f379 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93365b expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.412315:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae1f200, rc 0) 00000100:00100000:2.0:1746065150.412336:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.412339:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263502208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (1711us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.412345:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13129 00000100:00100000:1.0:1746065150.413365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.413393:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.413467:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263502336 00000100:00100000:3.0:1746065150.413470:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263502336 00010000:00010000:3.0:1746065150.413489:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 11 pid: 12260 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.413510:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263502464 00000100:00100000:3.0:1746065150.413512:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263502464 00010000:00010000:3.0:1746065150.413519:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 17 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.413530:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5914 00000100:00100000:3.0:1746065150.413535:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263502336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.413543:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.413556:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 11 pid: 12260 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746065150.413565:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 11 pid: 12260 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746065150.413581:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.413602:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263502336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.413607:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5914 00000100:00100000:3.0:1746065150.413616:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5915 00000100:00100000:3.0:1746065150.413620:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263502464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.413624:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.413630:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 17 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.413636:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 17 pid: 3068 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.413646:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.413647:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.413652:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.413659:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.413680:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.413689:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263329920:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065150.413726:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00010000:00010000:0.0:1746065150.413824:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc146f310 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933607 expref: 10 pid: 12260 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746065150.413837:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263329536:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065150.413847:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc146f2ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9335f9 expref: 17 pid: 3068 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.413854:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263329664:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065150.413871:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 16 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.413878:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0600, rc 0) 00000100:00100000:0.0:1746065150.413895:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+16:32209:x1830881263501952:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 15367us (15571us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.413900:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13127 00000100:00100000:0.0:1746065150.416074:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.416114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.416198:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263329792:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065150.416221:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146f372 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933654 expref: 33 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.416232:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc146f372 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933654 expref: 33 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.416245:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dce00, rc 0) 00000100:00100000:2.0:1746065150.416278:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263502080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5816us (8278us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.416286:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13128 00000100:00100000:2.0:1746065150.416310:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263502976 00000100:00100000:2.0:1746065150.416316:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263502976 00002000:00100000:2.0:1746065150.416342:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (4104192->4108287) req@ffff880134b00700 x1830881263502976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.416349:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00700 with x1830881263502976 ext(4104192->4108287) 00002000:00010000:2.0:1746065150.416353:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00700 00000100:00100000:2.0:1746065150.416371:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3710 00000100:00100000:2.0:1746065150.416381:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263502976:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065150.416396:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263502720 00000100:00100000:3.0:1746065150.416400:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263502720 00000100:00100000:3.0:1746065150.416426:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13628 00000100:00100000:3.0:1746065150.416431:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32216:x1830881263502720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065150.416441:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.416454:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146f380 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933662 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.416471:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263502976:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 94us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065150.416476:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3710 00002000:00100000:2.0:1746065150.416480:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8d:0x0] (4104192->4108287) req@ffff880134b00700 x1830881263502976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.416487:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00700 with x1830881263502976 ext(4104192->4108287) 00002000:00010000:2.0:1746065150.416490:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00700 00010000:00010000:3.0:1746065150.416522:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416534:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416542:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416551:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416556:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416562:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416566:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065150.416570:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416575:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416583:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065150.416586:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065150.416588:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416593:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc146f387 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.416611:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146f380 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933662 expref: 17 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.416618:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146f380 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933662 expref: 17 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.416624:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0c00, rc 0) 00000100:00100000:3.0:1746065150.416640:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32216:x1830881263502720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 210us (572us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.416646:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13628 00000100:00100000:3.0:1746065150.420533:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263329920:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065150.420553:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.420597:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263502464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6975us (7202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.420606:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5915 00000100:00100000:2.0:1746065150.428323:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.428417:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263503232 00000100:00100000:0.0:1746065150.428425:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263503232 00002000:00100000:0.0:1746065150.428460:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1867776->1871871) req@ffff880090dd8a80 x1830881263503232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.428469:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8a80 with x1830881263503232 ext(1867776->1871871) 00002000:00010000:0.0:1746065150.428473:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd8a80 00000100:00100000:0.0:1746065150.428487:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3711 00000100:00100000:0.0:1746065150.428492:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263503232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065150.428607:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263503232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 113us (290us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065150.428613:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3711 00002000:00100000:0.0:1746065150.428617:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1867776->1871871) req@ffff880090dd8a80 x1830881263503232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.428623:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8a80 with x1830881263503232 ext(1867776->1871871) 00002000:00010000:0.0:1746065150.428626:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd8a80 00000100:00100000:0.0:1746065150.430604:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.431188:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263503488 00000100:00100000:2.0:1746065150.431195:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263503488 00000100:00100000:2.0:1746065150.431274:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4914 00000100:00100000:2.0:1746065150.431281:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+45:32211:x1830881263503488:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065150.431458:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+46:32211:x1830881263503488:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 176us (857us total) trans 8589935958 rc 0/0 00000100:00100000:2.0:1746065150.431467:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4914 00000100:00100000:0.0:1746065150.435910:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.436004:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.436245:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263503744 00000100:00100000:2.0:1746065150.436253:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263503744 00000100:00100000:2.0:1746065150.436289:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4915 00000100:00100000:2.0:1746065150.436295:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32216:x1830881263503744:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065150.436455:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:32216:x1830881263503744:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 159us (553us total) trans 8589935959 rc 0/0 00000100:00100000:2.0:1746065150.436462:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4915 00000100:00100000:2.0:1746065150.436475:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263504000 00000100:00100000:2.0:1746065150.436477:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263504000 00000100:00100000:2.0:1746065150.436487:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4916 00000100:00100000:2.0:1746065150.436491:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+24:32209:x1830881263504000:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065150.436549:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+25:32209:x1830881263504000:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 56us (545us total) trans 8589935960 rc 0/0 00000100:00100000:2.0:1746065150.436555:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4916 00000100:00100000:3.0:1746065150.438429:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.439822:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263504128 00000100:00100000:3.0:1746065150.439829:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263504128 00000100:00100000:3.0:1746065150.439867:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13130 00000100:00100000:3.0:1746065150.439874:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:32220:x1830881263504128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.439886:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.439901:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933669 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.439928:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.439947:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065150.439949:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065150.439952:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.439976:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.439991:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 14 pid: 12260 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.440002:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263330048:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.440089:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.445895:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263330048:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.445922:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.445952:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:3.0:1746065150.446007:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:32220:x1830881263504128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6132us (7580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.446015:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13130 00000100:00100000:0.0:1746065150.447041:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.447097:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263504256 00000100:00100000:2.0:1746065150.447105:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263504256 00002000:00100000:2.0:1746065150.447141:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1953792->2097151) req@ffff880134b01c00 x1830881263504256/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.447150:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01c00 with x1830881263504256 ext(1953792->2097151) 00010000:00010000:2.0:1746065150.447156:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 15 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.447168:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 15 pid: 12260 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746065150.447178:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134b01c00 00000100:00100000:2.0:1746065150.447193:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1295 00000100:00100000:2.0:1746065150.447199:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263504256:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065150.460886:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263504256:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13678us (13942us total) trans 17179873456 rc 0/0 00000100:00100000:2.0:1746065150.460898:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1295 00002000:00100000:2.0:1746065150.460910:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1953792->2097151) req@ffff880134b01c00 x1830881263504256/t17179873456(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/448 e 0 to 0 dl 1746065161 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.460918:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01c00 with x1830881263504256 ext(1953792->2097151) 00010000:00010000:2.0:1746065150.460928:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 17 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.460952:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 17 pid: 12260 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746065150.460959:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134b01c00 00000100:00100000:0.0:1746065150.466014:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.466093:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263504384 00000100:00100000:3.0:1746065150.466106:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263504384 00010000:00010000:3.0:1746065150.466147:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 17 pid: 12260 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.466191:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5916 00000100:00100000:3.0:1746065150.466200:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263504384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.466213:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.466232:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 17 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.466247:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 17 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.466270:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc146f348 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93362a expref: 17 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.466302:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.466304:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.466310:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.466316:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.466348:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.466359:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263330176:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065150.467909:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.472329:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263330176:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065150.472348:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.472394:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263504384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6194us (6391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.472403:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5916 00000100:00100000:0.0:1746065150.472946:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.473015:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263504640 00000100:00100000:2.0:1746065150.473022:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263504640 00002000:00100000:2.0:1746065150.473059:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880099cf1180 x1830881263504640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.473067:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1180 with x1830881263504640 ext(1048576->2097151) 00002000:00010000:2.0:1746065150.473071:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf1180 00000100:00100000:2.0:1746065150.473085:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3712 00000100:00100000:2.0:1746065150.473092:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263504640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065150.488103:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263504640:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15001us (15158us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065150.488123:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3712 00002000:00100000:2.0:1746065150.488134:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880099cf1180 x1830881263504640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.488144:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1180 with x1830881263504640 ext(1048576->2097151) 00002000:00010000:2.0:1746065150.488149:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf1180 00000100:00100000:0.0:1746065150.495740:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.495834:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263504768 00000100:00100000:3.0:1746065150.495841:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263504768 00000100:00100000:3.0:1746065150.495887:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13131 00000100:00100000:3.0:1746065150.495895:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+36:32220:x1830881263504768:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.495912:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.495925:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933670 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.495958:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.495966:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065150.495967:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065150.495971:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 37 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.495995:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.496005:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 14 pid: 11461 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.496015:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263330304:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.496104:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.498029:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263330304:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.498054:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 37 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.498068:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0200, rc 0) 00000100:00100000:3.0:1746065150.498373:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+37:32220:x1830881263504768:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2476us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.498380:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13131 00000100:00100000:0.0:1746065150.500160:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.500225:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263504896 00000100:00100000:2.0:1746065150.500232:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263504896 00002000:00100000:2.0:1746065150.500267:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1871871) req@ffff880099cf0700 x1830881263504896/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.500276:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0700 with x1830881263504896 ext(1048576->1871871) 00010000:00010000:2.0:1746065150.500283:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 15 pid: 11461 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.500294:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 15 pid: 11461 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746065150.500299:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf0700 00000100:00100000:2.0:1746065150.500328:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1296 00000100:00100000:2.0:1746065150.500335:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263504896:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065150.511723:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263504896:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11376us (11554us total) trans 21474840905 rc 0/0 00000100:00100000:0.0:1746065150.511738:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1296 00002000:00100000:0.0:1746065150.511750:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1871871) req@ffff880099cf0700 x1830881263504896/t21474840905(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/448 e 0 to 0 dl 1746065161 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.511760:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0700 with x1830881263504896 ext(1048576->1871871) 00010000:00010000:0.0:1746065150.511769:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.511819:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746065150.511825:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf0700 00000100:00100000:0.0:1746065150.523073:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.523164:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263505024 00000100:00100000:3.0:1746065150.523172:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263505024 00010000:00010000:3.0:1746065150.523202:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.523237:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5917 00000100:00100000:3.0:1746065150.523245:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263505024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.523258:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.523273:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.523284:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.523303:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc146f36b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1871871) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93364d expref: 17 pid: 11461 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.523331:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.523333:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.523340:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.523347:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.523380:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.523390:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263330432:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065150.524664:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.526727:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263330432:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065150.526744:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.526821:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263505024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3575us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.526830:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5917 00000100:00100000:0.0:1746065150.533414:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.533499:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263505280 00000100:00100000:2.0:1746065150.533508:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263505280 00002000:00100000:2.0:1746065150.533542:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cf0e00 x1830881263505280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.533552:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0e00 with x1830881263505280 ext(1048576->2097151) 00002000:00010000:2.0:1746065150.533556:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0e00 00000100:00100000:2.0:1746065150.533627:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3713 00000100:00100000:2.0:1746065150.533635:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263505280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065150.554202:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263505280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20560us (20788us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065150.554211:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3713 00002000:00100000:2.0:1746065150.554220:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cf0e00 x1830881263505280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.554229:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0e00 with x1830881263505280 ext(1048576->2097151) 00002000:00010000:2.0:1746065150.554234:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0e00 00000100:00100000:0.0:1746065150.573522:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.573567:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.573699:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263505536 00000100:00100000:1.0:1746065150.573708:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263505536 00002000:00100000:1.0:1746065150.573748:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099cf2680 x1830881263505536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 504/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.573757:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2680 with x1830881263505536 ext(2097152->4194303) 00002000:00010000:1.0:1746065150.573762:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf2680 00000100:00100000:1.0:1746065150.573815:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263505792 00000100:00100000:1.0:1746065150.573818:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263505792 00002000:00100000:1.0:1746065150.573831:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099cf1500 x1830881263505792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 504/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.573838:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1500 with x1830881263505792 ext(2097152->4194303) 00002000:00010000:1.0:1746065150.573841:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf1500 00000100:00100000:1.0:1746065150.573854:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3714 00000100:00100000:1.0:1746065150.573860:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263505536:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065150.574658:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3715 00000100:00100000:1.0:1746065150.574664:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263505792:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065150.580791:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.580836:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.580851:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.580868:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.580891:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.580911:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263505920 00000100:00100000:2.0:1746065150.580918:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263505920 00000100:00100000:2.0:1746065150.580957:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263506048 00000100:00100000:2.0:1746065150.580959:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263506048 00000100:00100000:2.0:1746065150.580967:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263506176 00000100:00100000:2.0:1746065150.580969:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263506176 00000100:00100000:2.0:1746065150.580976:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263506304 00000100:00100000:2.0:1746065150.580977:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263506304 00000100:00100000:2.0:1746065150.580988:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13132 00000100:00100000:2.0:1746065150.580993:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263505920:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.581009:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.581024:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933677 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.581045:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.581046:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.581053:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.581066:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.581074:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc400, rc 0) 00000100:00100000:2.0:1746065150.581106:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263505920:12345-192.168.202.27@tcp:101:cat.0 Request processed in 112us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.581111:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13132 00000100:00100000:2.0:1746065150.581125:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13133 00000100:00100000:2.0:1746065150.581129:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263506048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.581134:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.581141:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93367e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.581150:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.581151:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.581154:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.581162:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.581168:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00000100:00100000:2.0:1746065150.581179:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263506048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.581183:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13133 00000100:00100000:2.0:1746065150.581190:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13134 00000100:00100000:2.0:1746065150.581193:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263506176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.581197:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.581201:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146f3aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933685 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.581227:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263330560:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065150.581281:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.581302:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13135 00000100:00100000:2.0:1746065150.581307:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263506304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.581313:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.581321:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146f3b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93368c expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.581342:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263330688:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065150.581362:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.581427:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263506560 00000100:00100000:2.0:1746065150.581430:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263506560 00000100:00100000:2.0:1746065150.581458:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13629 00000100:00100000:2.0:1746065150.581463:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+46:32226:x1830881263506560:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065150.581474:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.581482:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146f3b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933693 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.581552:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065150.581563:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.581569:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065150.581586:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.581595:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 16 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.581602:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263330816:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.581622:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.587043:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263330816:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.587064:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065150.587277:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263330688:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065150.587301:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146f3b1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93368c expref: 18 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.587312:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc146f3b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93368c expref: 18 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.587326:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:0.0:1746065150.587361:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263506304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6052us (6467us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.587369:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13135 00002000:00010000:3.0:1746065150.588584:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065149 -> 1746065150 00000100:00100000:3.0:1746065150.588597:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263330560:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065150.588614:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146f3aa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933685 expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.588624:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc800/0xad6b7ddc146f3aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933685 expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.588645:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc800, rc 0) 00000100:00100000:3.0:1746065150.588671:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263506176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7477us (7802us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.588677:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13134 00000100:00100000:1.0:1746065150.601925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.602032:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263506688 00000100:00100000:3.0:1746065150.602040:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263506688 00010000:00010000:3.0:1746065150.602072:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 17 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.602099:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5918 00000100:00100000:3.0:1746065150.602106:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263506688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.602118:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.602123:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 17 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.602134:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 17 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.602151:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146f34f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933631 expref: 17 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.602164:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065150.602169:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065150.602178:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065150.602182:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065150.602533:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065150.603423:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065150.603432:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065150.603454:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065150.603561:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2600/0xad6b7ddc146f3b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 49 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.603580:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 48 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.603586:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065150.603588:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065150.603591:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2c00, rc 0) 00000100:00100000:3.0:1746065150.603660:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263506688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1553us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.603667:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5918 00000100:00100000:2.0:1746065150.607727:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+48:32226:x1830881263506560:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 26253us (26879us total) trans 8589935961 rc 0/0 00000100:00100000:2.0:1746065150.607736:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13629 00000100:00100000:1.0:1746065150.608288:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263505536:12345-192.168.202.27@tcp:3:cat.0 Request processed in 34425us (34772us total) trans 0 rc 1134592/1134592 00000100:00100000:1.0:1746065150.608299:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3714 00002000:00100000:1.0:1746065150.608309:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099cf2680 x1830881263505536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 504/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1134592/1134592 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.608318:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2680 with x1830881263505536 ext(2097152->4194303) 00002000:00010000:1.0:1746065150.608323:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf2680 00000100:00100000:0.0:1746065150.608729:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.608795:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263506944 00000100:00100000:0.0:1746065150.608801:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263506944 00000100:00100000:0.0:1746065150.608828:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13630 00000100:00100000:0.0:1746065150.608834:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+25:32230:x1830881263506944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065150.608851:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.608864:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc146f3cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93369a expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.608955:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065150.608967:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065150.608975:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065150.608985:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065150.609059:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc146f3cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.609072:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 27 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.609079:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.609081:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065150.609083:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be000, rc 0) 00000100:00100000:0.0:1746065150.609115:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+27:32230:x1830881263506944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 281us (387us total) trans 8589935962 rc 0/0 00000100:00100000:0.0:1746065150.609120:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13630 00000100:00100000:0.0:1746065150.614947:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.614973:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.616259:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263507200 00000100:00100000:1.0:1746065150.616269:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263507200 00002000:00100000:1.0:1746065150.616310:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880099cf2300 x1830881263507200/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.616320:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2300 with x1830881263507200 ext(1048576->2097151) 00002000:00010000:1.0:1746065150.616325:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf2300 00000100:00100000:1.0:1746065150.616395:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263507456 00000100:00100000:1.0:1746065150.616399:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263507456 00002000:00100000:1.0:1746065150.616415:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cf1880 x1830881263507456/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.616422:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1880 with x1830881263507456 ext(1048576->2097151) 00002000:00010000:1.0:1746065150.616425:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf1880 00000100:00100000:1.0:1746065150.616439:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3716 00000100:00100000:1.0:1746065150.616447:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263507200:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065150.617597:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3717 00000100:00100000:0.0:1746065150.617607:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263507456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065150.620311:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263505792:12345-192.168.202.27@tcp:3:cat.0 Request processed in 45639us (46735us total) trans 0 rc 2023424/2023424 00000100:00100000:0.0:1746065150.620322:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3715 00002000:00100000:0.0:1746065150.620332:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099cf1500 x1830881263505792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 504/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 2023424/2023424 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.620341:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1500 with x1830881263505792 ext(2097152->4194303) 00002000:00010000:0.0:1746065150.620346:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf1500 00000100:00100000:0.0:1746065150.642541:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.642606:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263507712 00000100:00100000:2.0:1746065150.642615:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263507712 00002000:00100000:2.0:1746065150.642651:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880099cf3b80 x1830881263507712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.642660:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3b80 with x1830881263507712 ext(4194304->5021695) 00002000:00010000:2.0:1746065150.642665:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3b80 00000100:00100000:2.0:1746065150.642700:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3718 00000100:00100000:2.0:1746065150.642707:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263507712:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065150.647104:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263507200:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30649us (32164us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065150.647115:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3716 00002000:00100000:1.0:1746065150.647124:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880099cf2300 x1830881263507200/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.647133:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2300 with x1830881263507200 ext(1048576->2097151) 00002000:00010000:1.0:1746065150.647138:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf2300 00000100:00100000:2.0:1746065150.655058:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.656512:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263507840 00000100:00100000:3.0:1746065150.656522:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263507840 00000100:00100000:3.0:1746065150.656571:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13136 00000100:00100000:3.0:1746065150.656577:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:32226:x1830881263507840:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065150.656593:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.656607:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336a1 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.656630:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 34 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.656638:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 6 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.656644:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 16 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.656650:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.656651:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.656654:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1470464->1814527] (req 1470464->1814527) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.656675:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 16 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.656685:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 16 pid: 12260 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.656693:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263330944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.656770:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 6 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.656790:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 6 pid: 9549 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.656797:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263331072:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.656824:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 34 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.656831:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 34 pid: 3067 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.656837:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263331200:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.656848:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.657493:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263507456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 39886us (42517us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065150.657501:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3717 00002000:00100000:0.0:1746065150.657509:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cf1880 x1830881263507456/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.657516:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1880 with x1830881263507456 ext(1048576->2097151) 00002000:00010000:0.0:1746065150.657520:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf1880 00000100:00100000:3.0:1746065150.660395:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263507712:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17681us (17856us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065150.660406:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3718 00002000:00100000:3.0:1746065150.660415:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880099cf3b80 x1830881263507712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.660424:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3b80 with x1830881263507712 ext(4194304->5021695) 00002000:00010000:3.0:1746065150.660428:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3b80 00000100:00100000:0.0:1746065150.665509:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.665597:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263507968 00000100:00100000:2.0:1746065150.665605:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263507968 00010000:00010000:2.0:1746065150.665638:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 7 pid: 9549 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.665682:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5919 00000100:00100000:2.0:1746065150.665689:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263507968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.665704:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.665719:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 7 pid: 9549 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.665729:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 7 pid: 9549 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.665747:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.665810:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263507968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 120us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.665816:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5919 00000100:00100000:3.0:1746065150.665943:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263330944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.665954:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146f206 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93354a expref: 6 pid: 9549 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.665973:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263331072:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065150.666162:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.666244:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.666258:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.666288:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.666313:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263508224 00000100:00100000:0.0:1746065150.666316:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263508224 00000100:00100000:0.0:1746065150.666341:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263508352 00000100:00100000:0.0:1746065150.666343:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263508352 00000100:00100000:0.0:1746065150.666360:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263508480 00000100:00100000:0.0:1746065150.666362:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263508480 00000100:00100000:0.0:1746065150.666374:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13137 00000100:00100000:0.0:1746065150.666378:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263508224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065150.666392:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.666401:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146f3e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336a8 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.666415:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.666421:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146f3e9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a8 expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.666430:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc146f3e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a8 expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.666440:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfe00, rc 0) 00000100:00100000:0.0:1746065150.666460:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263508224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 82us (217us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.666465:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13137 00000100:00100000:0.0:1746065150.666477:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13138 00000100:00100000:0.0:1746065150.666481:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263508352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065150.666493:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.666501:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f3f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336af expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065150.666530:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263331328:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065150.666576:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.666588:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13139 00000100:00100000:0.0:1746065150.666593:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263508480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065150.666599:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.666605:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f3f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336b6 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065150.666627:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263331456:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065150.666645:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065150.666795:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263508096 00000100:00100000:1.0:1746065150.666799:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263508096 00010000:00010000:1.0:1746065150.666812:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 19 pid: 12260 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746065150.666832:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5920 00000100:00100000:1.0:1746065150.666837:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263508096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065150.666843:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065150.666851:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 19 pid: 12260 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746065150.666859:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 19 pid: 12260 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746065150.666871:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131bee600/0xad6b7ddc146f149 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9334a2 expref: 19 pid: 12260 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746065150.666881:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.666899:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263508096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.666904:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5920 00000100:00100000:3.0:1746065150.667333:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263331200:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.667351:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1470464->1814527] (req 1470464->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.667358:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44600, rc 0) 00000100:00100000:3.0:1746065150.667872:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+34:32226:x1830881263507840:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11294us (12820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.667879:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13136 00000100:00100000:0.0:1746065150.668494:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.668526:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.668579:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263508736 00000100:00100000:2.0:1746065150.668584:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263508736 00010000:00010000:2.0:1746065150.668601:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 34 pid: 3067 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.668626:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5921 00000100:00100000:2.0:1746065150.668632:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263508736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.668640:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.668651:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 34 pid: 3067 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.668659:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 34 pid: 3067 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.668674:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc146f118 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933478 expref: 34 pid: 3067 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746065150.668686:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.668688:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.668693:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.668700:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.668723:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.668732:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263331584:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065150.668787:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.668864:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263508608 00000100:00100000:3.0:1746065150.668867:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263508608 00000100:00100000:3.0:1746065150.668890:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13140 00000100:00100000:3.0:1746065150.668895:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263508608:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.668904:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.668911:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f3fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336bd expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.668942:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263331712:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065150.668977:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.670348:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.670407:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263331328:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065150.670425:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f3f0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336af expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.670433:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f3f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336af expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.670442:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:0.0:1746065150.670472:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263508352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3991us (4213us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.670478:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13138 00000100:00100000:0.0:1746065150.670567:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263331456:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065150.670582:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f3f7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336b6 expref: 17 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.670591:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f3f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336b6 expref: 17 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.670597:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be200, rc 0) 00000100:00100000:0.0:1746065150.670613:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263508480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4020us (4324us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.670618:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13139 00000100:00100000:1.0:1746065150.670805:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263508864 00000100:00100000:1.0:1746065150.670809:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263508864 00000100:00100000:1.0:1746065150.670837:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13631 00000100:00100000:1.0:1746065150.670841:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32232:x1830881263508864:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065150.670853:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065150.670863:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146f405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336c4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.670899:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.670909:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.670915:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.670924:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.670928:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.670942:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.670989:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.670997:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 47 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.671003:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 26 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.671008:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.671025:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 26 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.671033:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 26 pid: 13395 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746065150.671045:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263331840:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065150.671091:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 47 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.671098:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 47 pid: 13395 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746065150.671104:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263331968:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065150.671120:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.673268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.673535:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263509120 00000100:00100000:3.0:1746065150.673541:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263509120 00002000:00100000:3.0:1746065150.673571:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1470464->1474559) req@ffff88008c458380 x1830881263509120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.673580:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458380 with x1830881263509120 ext(1470464->1474559) 00002000:00010000:3.0:1746065150.673585:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458380 00000100:00100000:3.0:1746065150.673600:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3719 00000100:00100000:3.0:1746065150.673605:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263509120:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065150.673701:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263509120:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 94us (438us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065150.673706:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3719 00002000:00100000:3.0:1746065150.673711:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1470464->1474559) req@ffff88008c458380 x1830881263509120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.673718:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458380 with x1830881263509120 ext(1470464->1474559) 00002000:00010000:3.0:1746065150.673721:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c458380 00002000:00010000:3.0:1746065150.673753:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065148 -> 1746065150 00002000:00010000:3.0:1746065150.673755:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065148 -> 1746065150 00002000:00010000:3.0:1746065150.673757:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065148 -> 1746065150 00000100:00100000:3.0:1746065150.673764:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263331712:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065150.673802:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f3fe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336bd expref: 35 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.673812:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f3fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336bd expref: 35 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.673824:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44200, rc 0) 00000100:00100000:3.0:1746065150.673845:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263508608:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4950us (5352us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.673851:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13140 00000100:00100000:0.0:1746065150.673967:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263331584:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065150.673978:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.673994:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263508736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5362us (5468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.674001:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5921 00000100:00100000:1.0:1746065150.674070:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263331840:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065150.674586:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263331968:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065150.674601:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065150.675581:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.675614:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.675673:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263509504 00000100:00100000:2.0:1746065150.675678:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263509504 00000100:00100000:2.0:1746065150.675704:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13141 00000100:00100000:2.0:1746065150.675709:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:32228:x1830881263509504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.675719:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.675730:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336cb expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.675748:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.675755:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065150.675756:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065150.675758:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.675793:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.675803:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 36 pid: 12258 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.675812:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263332096:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.675856:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065150.676209:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263509248 00000100:00100000:1.0:1746065150.676213:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263509248 00010000:00010000:1.0:1746065150.676228:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 27 pid: 13395 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746065150.676245:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5922 00000100:00100000:1.0:1746065150.676250:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+27:2006:x1830881263509248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065150.676258:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065150.676269:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 27 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.676281:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 27 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.676294:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f3d4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93369a expref: 27 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.676309:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065150.676313:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.676319:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.676323:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065150.676327:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.676363:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881263509248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.676368:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5922 00000100:00100000:3.0:1746065150.676511:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.676526:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263509376 00000100:00100000:0.0:1746065150.676530:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263509376 00010000:00010000:0.0:1746065150.676543:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 48 pid: 13395 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.676564:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5923 00000100:00100000:0.0:1746065150.676570:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881263509376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.676576:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.676580:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 48 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.676591:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 48 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.676602:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146f3bf lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933693 expref: 48 pid: 13395 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.676611:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.676614:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.676620:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.676626:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.676644:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.676696:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881263509376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.676701:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5923 00010000:00010000:3.0:1746065150.676717:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.676723:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065150.677044:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065150.677048:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065150.677064:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677073:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677083:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677088:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677093:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677097:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677102:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065150.677106:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677111:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677118:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065150.677121:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065150.677124:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677128:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc146f40c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677136:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677140:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677145:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677148:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065150.677150:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677154:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677160:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5d00) 00010000:00010000:3.0:1746065150.677161:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065150.677163:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677167:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4a00/0xad6b7ddc146f413 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.677191:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4c00/0xad6b7ddc146f405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.677199:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 17 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.677205:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065150.677206:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065150.677208:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:3.0:1746065150.677244:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:32232:x1830881263508864:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6401us (6898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.677249:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13631 00000100:00100000:0.0:1746065150.681280:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.682306:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263509760 00000100:00100000:3.0:1746065150.682314:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263509760 00002000:00100000:3.0:1746065150.682347:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1810432->1814527) req@ffff880097fa3800 x1830881263509760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.682356:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3800 with x1830881263509760 ext(1810432->1814527) 00002000:00010000:3.0:1746065150.682360:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa3800 00000100:00100000:3.0:1746065150.682376:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3720 00000100:00100000:3.0:1746065150.682384:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263509760:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065150.682495:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263509760:12345-192.168.202.27@tcp:3:cat.0 Request processed in 111us (1220us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065150.682500:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3720 00002000:00100000:3.0:1746065150.682505:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1810432->1814527) req@ffff880097fa3800 x1830881263509760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.682511:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3800 with x1830881263509760 ext(1810432->1814527) 00002000:00010000:3.0:1746065150.682514:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa3800 00000100:00100000:2.0:1746065150.682890:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263332096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.682914:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.682927:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:2.0:1746065150.682975:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+18:32228:x1830881263509504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7265us (7396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.682982:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13141 00000100:00100000:1.0:1746065150.683227:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.683418:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263509888 00000100:00100000:0.0:1746065150.683422:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263509888 00002000:00100000:0.0:1746065150.683443:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4108287) req@ffff8800907be300 x1830881263509888/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.683450:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907be300 with x1830881263509888 ext(3145728->4108287) 00010000:00010000:0.0:1746065150.683455:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 37 pid: 12258 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.683470:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 37 pid: 12258 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746065150.683475:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907be300 00000100:00100000:0.0:1746065150.683498:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1297 00000100:00100000:0.0:1746065150.683503:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263509888:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065150.689575:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.689608:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.689619:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.689637:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263510016 00000100:00100000:0.0:1746065150.689643:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263510016 00000100:00100000:0.0:1746065150.689669:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263510144 00000100:00100000:0.0:1746065150.689670:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263510144 00000100:00100000:0.0:1746065150.689677:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263510272 00000100:00100000:0.0:1746065150.689679:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263510272 00000100:00100000:0.0:1746065150.689690:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13142 00000100:00100000:0.0:1746065150.689697:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263510016:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065150.689710:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.689724:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146f428 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336d2 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065150.689763:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263332224:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065150.689838:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.689854:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13143 00000100:00100000:0.0:1746065150.689859:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263510144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065150.689865:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.689871:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336d9 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.689881:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.689882:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.689888:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.689899:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.689907:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be200, rc 0) 00000100:00100000:0.0:1746065150.689925:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263510144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 66us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.689942:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13143 00000100:00100000:0.0:1746065150.689956:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13144 00000100:00100000:0.0:1746065150.689960:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263510272:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065150.689966:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.689973:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336e0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.689982:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.689983:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.689987:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.689996:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.690002:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:0.0:1746065150.690014:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263510272:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 54us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.690018:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13144 00000100:00100000:0.0:1746065150.690044:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.690055:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263510400 00000100:00100000:0.0:1746065150.690058:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263510400 00000100:00100000:0.0:1746065150.690070:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13145 00000100:00100000:0.0:1746065150.690074:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263510400:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065150.690079:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.690084:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f43d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336e7 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065150.690103:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263332352:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065150.690120:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.690160:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.690171:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263510528 00000100:00100000:0.0:1746065150.690174:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263510528 00000100:00100000:0.0:1746065150.690186:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13146 00000100:00100000:0.0:1746065150.690190:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263510528:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065150.690196:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.690201:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc146f444 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336ee expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065150.690219:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263332480:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065150.690236:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.691321:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.696505:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263510784 00000100:00100000:2.0:1746065150.696517:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263510784 00000100:00100000:2.0:1746065150.696572:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4917 00000100:00100000:2.0:1746065150.696579:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+47:32226:x1830881263510784:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065150.697195:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+48:32226:x1830881263510784:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 614us (5876us total) trans 8589935963 rc 0/0 00000100:00100000:2.0:1746065150.697202:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4917 00000100:00100000:0.0:1746065150.698135:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263332352:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065150.698159:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f43d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e7 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.698172:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f43d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e7 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.698184:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf400, rc 0) 00000100:00100000:0.0:1746065150.698207:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263510400:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8131us (8161us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.698213:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13145 00000100:00100000:0.0:1746065150.698692:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263332224:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065150.698706:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146f428 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d2 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.698714:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc146f428 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d2 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.698720:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00000100:00100000:0.0:1746065150.698736:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263510016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9040us (9169us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.698741:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13142 00000100:00100000:2.0:1746065150.698816:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263332480:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065150.698830:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc146f444 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336ee expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.698837:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc146f444 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336ee expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.698844:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72400, rc 0) 00000100:00100000:2.0:1746065150.698859:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263510528:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8668us (8699us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.698864:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13146 00000100:00100000:0.0:1746065150.700554:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263509888:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17046us (17323us total) trans 21474840906 rc 0/0 00000100:00100000:0.0:1746065150.700563:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1297 00002000:00100000:0.0:1746065150.700571:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4108287) req@ffff8800907be300 x1830881263509888/t21474840906(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/448 e 0 to 0 dl 1746065161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.700580:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907be300 with x1830881263509888 ext(3145728->4108287) 00010000:00010000:0.0:1746065150.700587:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 39 pid: 12258 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.700599:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 39 pid: 12258 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746065150.700605:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907be300 00000100:00100000:3.0:1746065150.705559:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.705860:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263511040 00000100:00100000:0.0:1746065150.705868:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263511040 00000100:00100000:0.0:1746065150.705922:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13632 00000100:00100000:0.0:1746065150.705930:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:32232:x1830881263511040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065150.705955:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.705971:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc146f44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336f5 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.706054:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.706068:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.706074:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.706104:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.706112:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 18 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.706123:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263332608:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065150.710985:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.711076:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.711152:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.711174:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263511168 00000100:00100000:3.0:1746065150.711180:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263511168 00010000:00010000:3.0:1746065150.711206:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 39 pid: 12258 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.711223:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263511296 00000100:00100000:3.0:1746065150.711225:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263511296 00010000:00010000:3.0:1746065150.711234:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 19 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.711246:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5924 00000100:00100000:3.0:1746065150.711252:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263511168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.711263:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.711280:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 39 pid: 12258 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.711289:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 39 pid: 12258 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.711307:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f364 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933646 expref: 39 pid: 12258 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.711318:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.711319:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.711325:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.711331:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.711356:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065150.711366:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263332736:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065150.711420:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.711434:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5925 00000100:00100000:3.0:1746065150.711438:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2007:x1830881263511296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.711445:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.711450:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 19 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.711457:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 19 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.711469:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065150.711472:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.711480:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.711484:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065150.711493:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.711507:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2007:x1830881263511296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.711515:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5925 00010000:00010000:0.0:1746065150.711641:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc146f41a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336c4 expref: 18 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.711650:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263332608:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065150.711663:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.711669:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.711673:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065150.711686:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065150.711770:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc146f44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.711800:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.711805:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.711808:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065150.711810:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf000, rc 0) 00000100:00100000:0.0:1746065150.711829:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32232:x1830881263511040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5901us (6278us total) trans 8589935964 rc 0/0 00000100:00100000:0.0:1746065150.711834:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13632 00000100:00100000:3.0:1746065150.714602:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263332736:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065150.714617:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.714646:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263511168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3393us (3574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.714654:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5924 00000100:00100000:0.0:1746065150.717010:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.717061:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.717151:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263511680 00000100:00100000:1.0:1746065150.717159:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263511680 00002000:00100000:1.0:1746065150.717194:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880097fa2300 x1830881263511680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.717208:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2300 with x1830881263511680 ext(2097152->3145727) 00002000:00010000:1.0:1746065150.717212:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2300 00000100:00100000:1.0:1746065150.717240:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3721 00000100:00100000:1.0:1746065150.717246:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263511680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065150.720000:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263511424 00000100:00100000:2.0:1746065150.720009:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263511424 00000100:00100000:2.0:1746065150.720055:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13633 00000100:00100000:2.0:1746065150.720061:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32232:x1830881263511424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065150.720081:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.720096:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f460 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9336fc expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.720164:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.720175:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.720181:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.720207:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.720217:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 19 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.720226:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263332864:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.721261:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.726299:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263332864:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.726325:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065150.733232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.733424:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263511680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16175us (16360us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065150.733434:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3721 00002000:00100000:0.0:1746065150.733444:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880097fa2300 x1830881263511680/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.733452:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2300 with x1830881263511680 ext(2097152->3145727) 00002000:00010000:0.0:1746065150.733457:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2300 00000100:00100000:2.0:1746065150.733632:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263511808 00000100:00100000:2.0:1746065150.733638:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263511808 00010000:00010000:2.0:1746065150.733662:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 20 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.733682:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5926 00000100:00100000:2.0:1746065150.733687:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2004:x1830881263511808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.733698:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.733703:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 20 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.733710:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 20 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.733727:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f452 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336f5 expref: 20 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.737062:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065150.737072:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.737085:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.737092:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.737126:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.737186:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2004:x1830881263511808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3494us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.737195:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5926 00010000:00010000:0.0:1746065150.737275:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.737282:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065150.737324:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:0.0:1746065150.737328:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065150.737342:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.737371:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f460 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.737397:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.737404:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.737407:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065150.737408:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488800, rc 0) 00000100:00100000:0.0:1746065150.737434:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32232:x1830881263511424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 17373us (20430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.737440:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13633 00000100:00100000:0.0:1746065150.747591:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.747631:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.747660:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.747688:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.749964:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263512064 00000100:00100000:2.0:1746065150.749974:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263512064 00000100:00100000:2.0:1746065150.750005:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263511936 00000100:00100000:2.0:1746065150.750007:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263511936 00000100:00100000:2.0:1746065150.750016:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263512192 00000100:00100000:2.0:1746065150.750017:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263512192 00000100:00100000:2.0:1746065150.750024:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263512320 00000100:00100000:2.0:1746065150.750025:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263512320 00000100:00100000:2.0:1746065150.750038:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13147 00000100:00100000:2.0:1746065150.750044:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263512064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065150.750059:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.750072:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93370a expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.750091:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.750093:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.750100:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.750125:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.750133:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31a00, rc 0) 00000100:00100000:2.0:1746065150.750177:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263512064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 133us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.750183:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13147 00000100:00100000:2.0:1746065150.750196:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13148 00000100:00100000:2.0:1746065150.750201:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263511936:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065150.750207:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.750215:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f475 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933703 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.750245:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263332992:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065150.750291:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.750310:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13149 00000100:00100000:2.0:1746065150.750316:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263512192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065150.750321:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.750329:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc146f47c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933711 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.750355:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263333120:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065150.750374:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.750389:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13150 00000100:00100000:2.0:1746065150.750395:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+16:32228:x1830881263512320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.750401:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.750407:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933718 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.750420:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 32 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.750425:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065150.750426:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065150.750429:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.750444:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 32 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.750454:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 32 pid: 12260 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.750462:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263333248:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.750479:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.755970:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263332992:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065150.756005:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f475 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933703 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.756017:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146f475 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933703 expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.756050:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00000100:00100000:2.0:1746065150.756099:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263511936:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5896us (8465us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.756107:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13148 00000100:00100000:0.0:1746065150.756527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.756561:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263333248:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065150.756574:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.756585:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:0.0:1746065150.756604:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+17:32228:x1830881263512320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6209us (8916us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.756609:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13150 00000100:00100000:3.0:1746065150.756968:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263333120:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065150.756985:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc146f47c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933711 expref: 8 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.756993:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131055600/0xad6b7ddc146f47c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933711 expref: 8 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.757015:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055600, rc 0) 00000100:00100000:3.0:1746065150.757036:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263512192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6720us (9376us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.757041:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13149 00000100:00100000:1.0:1746065150.757120:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263512448 00000100:00100000:1.0:1746065150.757126:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263512448 00002000:00100000:1.0:1746065150.757157:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3072000->3145727) req@ffff880097fa3100 x1830881263512448/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.757164:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3100 with x1830881263512448 ext(3072000->3145727) 00010000:00010000:1.0:1746065150.757170:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 33 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.757179:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 33 pid: 12260 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746065150.757184:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa3100 00000100:00100000:1.0:1746065150.757197:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1298 00000100:00100000:1.0:1746065150.757202:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263512448:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065150.763137:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.763698:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263512704 00000100:00100000:2.0:1746065150.763708:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263512704 00000100:00100000:2.0:1746065150.763794:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13634 00000100:00100000:2.0:1746065150.763807:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32232:x1830881263512704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065150.763827:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.763846:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46a00/0xad6b7ddc146f48a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93371f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.763948:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.763962:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.763972:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.763985:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.763993:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.763998:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.764003:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065150.764006:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.764012:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.764022:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065150.764025:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065150.764029:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.764034:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc146f491 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.764185:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46a00/0xad6b7ddc146f48a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93371f expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.764193:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46a00/0xad6b7ddc146f48a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93371f expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.764203:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:2.0:1746065150.764254:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32232:x1830881263512704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 448us (1122us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.764260:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13634 00000100:00100000:1.0:1746065150.765214:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263512448:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8009us (8686us total) trans 17179873457 rc 0/0 00000100:00100000:1.0:1746065150.765222:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1298 00002000:00100000:1.0:1746065150.765229:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3072000->3145727) req@ffff880097fa3100 x1830881263512448/t17179873457(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/448 e 0 to 0 dl 1746065161 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.765238:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3100 with x1830881263512448 ext(3072000->3145727) 00010000:00010000:1.0:1746065150.765245:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 35 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.765262:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 35 pid: 12260 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746065150.765268:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa3100 00000100:00100000:0.0:1746065150.767196:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.767273:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263512960 00000100:00100000:2.0:1746065150.767280:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263512960 00000100:00100000:2.0:1746065150.767556:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4918 00000100:00100000:2.0:1746065150.767564:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32232:x1830881263512960:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065150.767830:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:32232:x1830881263512960:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 266us (636us total) trans 8589935965 rc 0/0 00000100:00100000:2.0:1746065150.767837:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4918 00000100:00100000:0.0:1746065150.769853:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.769923:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263513088 00000100:00100000:2.0:1746065150.769929:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263513088 00010000:00010000:2.0:1746065150.769963:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 35 pid: 12260 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.769985:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5927 00000100:00100000:2.0:1746065150.769991:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263513088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065150.770002:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065150.770017:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 35 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.770026:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 35 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.770045:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc146f325 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93361c expref: 35 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.770057:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.770058:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.770063:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.770070:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.770095:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.770106:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263333376:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065150.770177:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.774965:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263333376:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065150.774983:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065150.775022:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263513088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5029us (5172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.775031:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5927 00000100:00100000:0.0:1746065150.783811:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.783873:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.785042:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263513472 00000100:00100000:3.0:1746065150.785053:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263513472 00002000:00100000:3.0:1746065150.785100:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa0a80 x1830881263513472/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.785110:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0a80 with x1830881263513472 ext(3145728->4194303) 00002000:00010000:3.0:1746065150.785115:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0a80 00000100:00100000:1.0:1746065150.785117:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263513600 00000100:00100000:1.0:1746065150.785122:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263513600 00002000:00100000:1.0:1746065150.785141:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880097fa1180 x1830881263513600/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.785148:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881263513600 ext(2097152->4194303) 00002000:00010000:1.0:1746065150.785152:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1180 00000100:00100000:3.0:1746065150.785213:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3722 00000100:00100000:3.0:1746065150.785224:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263513472:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065150.786108:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3723 00000100:00100000:1.0:1746065150.786116:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263513600:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065150.808606:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263513472:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23376us (24824us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065150.808617:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3722 00002000:00100000:3.0:1746065150.808627:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa0a80 x1830881263513472/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.808635:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0a80 with x1830881263513472 ext(3145728->4194303) 00002000:00010000:3.0:1746065150.808640:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0a80 00000100:00100000:0.0:1746065150.818953:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.819222:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263513728 00000100:00100000:3.0:1746065150.819230:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263513728 00000100:00100000:3.0:1746065150.819280:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13151 00000100:00100000:3.0:1746065150.819287:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263513728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.819303:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.819317:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933726 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.819341:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.819343:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.819350:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 39 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.819363:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 39 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.819372:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45c00, rc 0) 00000100:00100000:3.0:1746065150.819422:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263513728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 135us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.819431:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13151 00000100:00100000:0.0:1746065150.825636:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.825742:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263513856 00000100:00100000:3.0:1746065150.825750:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263513856 00000100:00100000:3.0:1746065150.825797:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13152 00000100:00100000:3.0:1746065150.825804:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263513856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065150.825819:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.825834:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93372d expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.825853:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.825855:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.825862:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 35 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.825875:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 35 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.825884:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44800, rc 0) 00000100:00100000:3.0:1746065150.825923:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263513856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.825928:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13152 00000100:00100000:0.0:1746065150.829353:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.829407:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263514112 00000100:00100000:2.0:1746065150.829414:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263514112 00000100:00100000:2.0:1746065150.829466:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13635 00000100:00100000:2.0:1746065150.829473:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+48:32241:x1830881263514112:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065150.829492:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.829506:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc146f4a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933734 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.829587:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.829600:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.829607:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065150.829631:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.829640:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 18 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.829651:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263333504:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.829736:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.840614:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.844093:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263514368 00000100:00100000:3.0:1746065150.844103:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263514368 00000100:00100000:2.0:1746065150.844109:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263333504:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.844131:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00002000:00100000:3.0:1746065150.844139:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880129f40380 x1830881263514368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 504/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.844147:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40380 with x1830881263514368 ext(1048576->2097151) 00002000:00010000:3.0:1746065150.844152:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40380 00000100:00100000:3.0:1746065150.844173:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3724 00000100:00100000:3.0:1746065150.844180:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263514368:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065150.844343:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263513600:12345-192.168.202.27@tcp:3:cat.0 Request processed in 58226us (60469us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065150.844350:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3723 00002000:00100000:1.0:1746065150.844355:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880097fa1180 x1830881263513600/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.844361:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881263513600 ext(2097152->4194303) 00002000:00010000:1.0:1746065150.844364:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1180 00000100:00100000:0.0:1746065150.844593:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.845474:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263514496 00000100:00100000:2.0:1746065150.845479:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263514496 00010000:00010000:2.0:1746065150.845499:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 19 pid: 7203 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.846665:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5928 00000100:00100000:0.0:1746065150.846677:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263514496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.846692:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.846699:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 19 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.846710:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 19 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.846728:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc146f467 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336fc expref: 19 pid: 7203 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.846763:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.846768:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.846794:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.846800:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.846819:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.846868:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263514496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 194us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.846874:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5928 00010000:00010000:0.0:1746065150.846906:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.846912:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065150.846926:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065150.847039:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc146f4a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 51 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.847058:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 50 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.847063:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065150.847065:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065150.847067:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47e00, rc 0) 00000100:00100000:0.0:1746065150.847089:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+50:32241:x1830881263514112:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 17618us (17744us total) trans 8589935966 rc 0/0 00000100:00100000:0.0:1746065150.847095:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13635 00000100:00100000:3.0:1746065150.847970:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263514368:12345-192.168.202.27@tcp:3:cat.0 Request processed in 3788us (7363us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746065150.847977:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3724 00002000:00100000:3.0:1746065150.847984:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880129f40380 x1830881263514368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 504/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.847992:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40380 with x1830881263514368 ext(1048576->2097151) 00002000:00010000:3.0:1746065150.847996:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40380 00000100:00100000:0.0:1746065150.855808:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.855920:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263514624 00000100:00100000:2.0:1746065150.855928:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263514624 00000100:00100000:2.0:1746065150.856180:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13153 00000100:00100000:2.0:1746065150.856188:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263514624:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.856205:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.856220:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146f4bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93373b expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.856270:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263333632:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065150.856616:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.882769:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065150.883046:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065150 -> 1746065151 00000100:00100000:2.0:1746065150.883066:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263333632:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065150.883094:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146f4bb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93373b expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.883106:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146f4bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93373b expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.883122:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46000, rc 0) 00000100:00100000:2.0:1746065150.883176:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263514624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 26987us (27372us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.883184:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13153 00000100:00100000:2.0:1746065150.883204:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263514752 00000100:00100000:2.0:1746065150.883209:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263514752 00000100:00100000:2.0:1746065150.883234:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13154 00000100:00100000:2.0:1746065150.883240:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+39:32241:x1830881263514752:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065150.883252:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.883263:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933742 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.883281:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 40 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.883293:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.883299:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 17 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.883306:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.883308:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.883311:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.883331:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 17 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.883342:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 17 pid: 9550 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.883352:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263333760:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.883412:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.883420:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 11 pid: 9548 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.883426:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263333888:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.883450:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 40 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.883457:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 40 pid: 13375 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.883463:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263334016:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.883477:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.889442:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.889475:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.889561:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.889591:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263514880 00000100:00100000:0.0:1746065150.889599:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263514880 00010000:00010000:0.0:1746065150.889631:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 12 pid: 9548 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746065150.889654:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263515008 00000100:00100000:0.0:1746065150.889657:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263515008 00010000:00010000:0.0:1746065150.889666:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 18 pid: 9550 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746065150.889677:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263515136 00000100:00100000:0.0:1746065150.889678:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263515136 00010000:00010000:0.0:1746065150.889686:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 41 pid: 13375 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746065150.889699:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5929 00000100:00100000:0.0:1746065150.889706:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263514880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.889717:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.889735:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 12 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.889744:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 12 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.889767:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.889823:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263514880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.889828:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5929 00000100:00100000:0.0:1746065150.889842:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5930 00000100:00100000:0.0:1746065150.889847:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263515008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.889854:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.889860:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 18 pid: 9550 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.889871:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 18 pid: 9550 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.889880:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.889892:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263515008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.889896:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5930 00000100:00100000:0.0:1746065150.889904:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5931 00000100:00100000:0.0:1746065150.889908:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263515136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.889913:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.889919:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 41 pid: 13375 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.889927:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 41 pid: 13375 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.889948:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.889950:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.889955:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.889962:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.889990:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 41 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065150.890002:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263334144:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065150.890053:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065150.890327:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc146f3a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93367e expref: 17 pid: 9550 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.890341:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263333760:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.890353:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc146f436 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336e0 expref: 11 pid: 9548 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.890360:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263333888:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.890367:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0200/0xad6b7ddc146f395 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933670 expref: 41 pid: 13375 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.890373:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263334016:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.890390:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.890397:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47800, rc 0) 00000100:00100000:2.0:1746065150.890418:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+40:32241:x1830881263514752:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7178us (7658us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.890424:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13154 00000100:00100000:2.0:1746065150.891102:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.891127:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.891145:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.891158:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263515392 00000100:00100000:2.0:1746065150.891162:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263515392 00002000:00100000:2.0:1746065150.891184:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008c458700 x1830881263515392/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.891192:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458700 with x1830881263515392 ext(4194304->5021695) 00002000:00010000:2.0:1746065150.891195:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458700 00000100:00100000:2.0:1746065150.891205:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263515776 00000100:00100000:2.0:1746065150.891206:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263515776 00002000:00100000:2.0:1746065150.891215:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008c45b800 x1830881263515776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.891221:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45b800 with x1830881263515776 ext(2097152->4194303) 00002000:00010000:2.0:1746065150.891224:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45b800 00000100:00100000:2.0:1746065150.891231:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263515904 00000100:00100000:2.0:1746065150.891232:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263515904 00002000:00100000:2.0:1746065150.891239:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88008c45bb80 x1830881263515904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.891245:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45bb80 with x1830881263515904 ext(2097152->4194303) 00002000:00010000:2.0:1746065150.891247:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c45bb80 00000100:00100000:2.0:1746065150.891256:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3725 00000100:00100000:2.0:1746065150.891261:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263515392:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065150.892182:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3726 00000100:00100000:1.0:1746065150.892191:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263515776:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065150.892491:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3727 00000100:00100000:0.0:1746065150.892498:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263515904:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065150.896135:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263334144:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065150.896156:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.896204:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263515136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6292us (6640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.896213:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5931 00000100:00100000:2.0:1746065150.901000:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263515392:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9730us (9890us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065150.901011:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3725 00002000:00100000:2.0:1746065150.901020:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008c458700 x1830881263515392/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.901029:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458700 with x1830881263515392 ext(4194304->5021695) 00002000:00010000:2.0:1746065150.901034:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458700 00000100:00100000:2.0:1746065150.904302:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.905251:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263516032 00000100:00100000:3.0:1746065150.905259:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263516032 00000100:00100000:3.0:1746065150.905297:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13155 00000100:00100000:3.0:1746065150.905304:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+17:32230:x1830881263516032:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065150.905318:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.905332:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933749 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.905358:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 18 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.905365:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.905372:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.905374:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.905377:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->4194303] (req 3514368->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 18 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.905402:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.905412:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.905422:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263334272:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.905495:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 18 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.905503:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 18 pid: 12260 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.905510:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263334400:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.905530:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.906172:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263515904:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13673us (15023us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065150.906180:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3727 00002000:00100000:0.0:1746065150.906187:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88008c45bb80 x1830881263515904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.906194:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45bb80 with x1830881263515904 ext(2097152->4194303) 00002000:00010000:0.0:1746065150.906197:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c45bb80 00000100:00100000:3.0:1746065150.908234:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263334272:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065150.908249:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263334400:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065150.908271:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->4194303] (req 3514368->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 18 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.908285:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44200, rc 0) 00000100:00100000:3.0:1746065150.908925:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+18:32230:x1830881263516032:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3618us (4628us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.908944:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13155 00010000:00010000:2.0:1746065150.910895:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065150.914959:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.915842:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263516160 00000100:00100000:0.0:1746065150.915842:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.915851:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263516160 00000100:00100000:0.0:1746065150.915875:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065150.915887:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 18 pid: 12260 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746065150.915914:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5932 00000100:00100000:1.0:1746065150.915921:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263516160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065150.915923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065150.915940:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065150.915942:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263516288 00000100:00100000:3.0:1746065150.915946:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263516288 00010000:00010000:1.0:1746065150.915957:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 19 pid: 12260 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.915965:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263516544 00000100:00100000:3.0:1746065150.915967:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263516544 00000100:00100000:3.0:1746065150.915980:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263516416 00000100:00100000:3.0:1746065150.915982:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263516416 00000100:00100000:3.0:1746065150.915996:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13156 00000100:00100000:3.0:1746065150.916001:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263516288:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065150.916009:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13157 00010000:00010000:3.0:1746065150.916013:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065150.916016:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263516544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.916024:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.916026:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc146f4d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933750 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.916032:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146f4d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93375e expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.916044:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.916051:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146f4d7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93375e expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.916059:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab6f400/0xad6b7ddc146f4d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93375e expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065150.916066:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263334528:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065150.916071:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13158 00010000:00010000:2.0:1746065150.916074:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6f400, rc 0) 00000100:00100000:0.0:1746065150.916078:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263516416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065150.916084:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.916092:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc146f4de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933757 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.916112:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263516544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 96us (236us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.916113:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263334656:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065150.916118:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.916118:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13157 00000100:00100000:0.0:1746065150.916134:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065150.916245:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 20 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.916258:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f483 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933718 expref: 20 pid: 12260 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.916270:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.916289:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2007:x1830881263516160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 368us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.916294:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5932 00000100:00100000:0.0:1746065150.919558:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.919609:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263516800 00000100:00100000:2.0:1746065150.919617:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263516800 00000100:00100000:0.0:1746065150.919619:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.919647:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263516672 00000100:00100000:2.0:1746065150.919648:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263516672 00000100:00100000:2.0:1746065150.919675:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13159 00000100:00100000:2.0:1746065150.919682:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+39:32241:x1830881263516800:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065150.919698:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065150.919703:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13160 00000100:00100000:3.0:1746065150.919711:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+37:32239:x1830881263516672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.919712:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93376c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.919719:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065150.919727:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933765 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.919738:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.919740:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.919742:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.919745:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 40 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.919748:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 38 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.919753:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.919758:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065150.919759:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 38 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.919759:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065150.919762:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->2400255] (req 2097152->2400255) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 40 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065150.919769:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45800, rc 0) 00010000:00010000:2.0:1746065150.919802:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.919812:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 10 pid: 3068 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746065150.919819:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+38:32239:x1830881263516672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 109us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.919824:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13160 00000100:00100000:2.0:1746065150.919827:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263334784:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.919874:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 40 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.919880:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 40 pid: 9548 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.919886:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263334912:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.919906:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.919912:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 18 pid: 9550 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.919918:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263335040:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.919927:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00002000:00010000:3.0:1746065150.921673:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065150 -> 1746065151 00002000:00010000:3.0:1746065150.921678:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065150 -> 1746065151 00000100:00100000:3.0:1746065150.921695:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263334528:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065150.921718:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc146f4d0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933750 expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.921729:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc146f4d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933750 expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065150.922514:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:3.0:1746065150.922556:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263516288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6552us (6713us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065150.922563:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13156 00002000:00010000:0.0:1746065150.924301:0:1880:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746065150 -> 1746065151 00002000:00010000:0.0:1746065150.924307:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065150 -> 1746065151 00002000:00010000:0.0:1746065150.924309:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746065150 -> 1746065151 00000100:00100000:0.0:1746065150.924324:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263334656:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065150.924346:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc146f4de lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933757 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.924357:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc146f4de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933757 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.924377:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539800, rc 0) 00000100:00100000:0.0:1746065150.924403:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263516416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8326us (8479us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.924410:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13158 00000100:00100000:1.0:1746065150.924505:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.924599:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263515776:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 32410us (33470us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065150.924605:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3726 00002000:00100000:1.0:1746065150.924612:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008c45b800 x1830881263515776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.924620:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45b800 with x1830881263515776 ext(2097152->4194303) 00010000:00010000:1.0:1746065150.924626:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746065150.924635:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 846 lvb_type: 1 00002000:00010000:1.0:1746065150.924640:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c45b800 00000100:00100000:2.0:1746065150.924763:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263334784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.924790:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263334912:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065150.925925:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263516928 00000100:00100000:0.0:1746065150.925940:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263516928 00010000:00010000:0.0:1746065150.925967:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 11 pid: 3068 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746065150.926003:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5933 00000100:00100000:0.0:1746065150.926010:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263516928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.926022:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.926036:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 11 pid: 3068 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.926046:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 11 pid: 3068 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.926063:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc146f46e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93370a expref: 11 pid: 3068 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.926074:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065150.926113:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263516928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 104us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.926118:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5933 00000100:00100000:2.0:1746065150.926674:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263335040:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.926719:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->2400255] (req 2097152->2400255) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 40 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.926735:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46200, rc 0) 00000100:00100000:2.0:1746065150.926766:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+40:32241:x1830881263516800:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7085us (7218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065150.927157:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.927270:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263517056 00000100:00100000:3.0:1746065150.927275:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263517056 00010000:00010000:3.0:1746065150.927290:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 17 pid: 9550 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746065150.927307:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5934 00000100:00100000:3.0:1746065150.927312:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263517056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065150.927322:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065150.927333:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 17 pid: 9550 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.927341:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 17 pid: 9550 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.927354:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f421 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336cb expref: 17 pid: 9550 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746065150.927361:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065150.927380:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263517056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065150.927386:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5934 00000100:00100000:2.0:1746065150.927546:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13159 00000100:00100000:3.0:1746065150.933845:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.933896:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263517184 00000100:00100000:3.0:1746065150.933898:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.933905:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263517184 00010000:00010000:0.0:1746065150.933946:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 40 pid: 9548 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746065150.933972:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263517312 00000100:00100000:2.0:1746065150.933976:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263517312 00000100:00100000:0.0:1746065150.933984:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5935 00000100:00100000:0.0:1746065150.933991:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263517184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065150.934004:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065150.934019:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 40 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.934029:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 40 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.934052:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f498 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933726 expref: 40 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746065150.934064:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.934065:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065150.934071:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.934077:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.934099:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13161 00010000:00010000:0.0:1746065150.934104:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.934106:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:32228:x1830881263517312:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065150.934115:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263335168:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065150.934117:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.934127:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933773 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.934146:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.934154:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065150.934155:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065150.934159:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [5017600->5242879] (req 5017600->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.934174:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065150.934177:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfecc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065150.934183:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746065150.934196:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263335296:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065150.934217:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.940082:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.940253:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263335168:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065150.940270:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.940304:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263517184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6313us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.940313:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5935 00000100:00100000:1.0:1746065150.940336:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263517440 00000100:00100000:1.0:1746065150.940341:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263517440 00010000:00010000:1.0:1746065150.940364:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746065150.940384:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5936 00000100:00100000:1.0:1746065150.940390:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263517440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065150.940400:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065150.940415:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746065150.940424:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746065150.940440:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f49f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93372d expref: 36 pid: 9548 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746065150.940461:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.940463:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.940470:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.940477:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.940503:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065150.940514:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263335424:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065150.940558:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.940635:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263335296:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.940652:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [5017600->5242879] (req 5017600->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.940663:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47c00, rc 0) 00000100:00100000:2.0:1746065150.940682:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+17:32228:x1830881263517312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6577us (6784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.940689:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13161 00000100:00100000:2.0:1746065150.941487:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.941511:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.941570:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263517824 00000100:00100000:0.0:1746065150.941574:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263517824 00002000:00100000:0.0:1746065150.941600:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800983bb800 x1830881263517824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.941608:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bb800 with x1830881263517824 ext(3145728->4194303) 00010000:00010000:0.0:1746065150.941614:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.941624:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746065150.941631:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800983bb800 00000100:00100000:0.0:1746065150.941641:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263517952 00000100:00100000:0.0:1746065150.941643:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263517952 00002000:00100000:0.0:1746065150.941652:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800983bbb80 x1830881263517952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.941659:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bbb80 with x1830881263517952 ext(2097152->3145727) 00002000:00010000:0.0:1746065150.941661:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983bbb80 00000100:00100000:0.0:1746065150.941682:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1299 00000100:00100000:0.0:1746065150.941688:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263517824:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065150.941810:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3728 00000100:00100000:1.0:1746065150.941818:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263517952:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065150.943984:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.944182:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263518208 00000100:00100000:2.0:1746065150.944188:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263518208 00002000:00100000:2.0:1746065150.944217:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2396160->2400255) req@ffff88009acee300 x1830881263518208/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.944226:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acee300 with x1830881263518208 ext(2396160->2400255) 00010000:00010000:2.0:1746065150.944233:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 41 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.944244:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 41 pid: 9548 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746065150.944251:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009acee300 00000100:00100000:2.0:1746065150.944274:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1300 00000100:00100000:2.0:1746065150.944280:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263518208:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065150.944361:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263518208:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 81us (381us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065150.944366:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1300 00002000:00100000:2.0:1746065150.944371:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2396160->2400255) req@ffff88009acee300 x1830881263518208/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065150.944383:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acee300 with x1830881263518208 ext(2396160->2400255) 00010000:00010000:2.0:1746065150.944387:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 41 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746065150.944395:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 41 pid: 9548 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746065150.944401:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009acee300 00000100:00100000:1.0:1746065150.945339:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263335424:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065150.945352:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.945374:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263517440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4984us (5300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.945382:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5936 00000100:00100000:2.0:1746065150.949362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.949450:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263518464 00000100:00100000:3.0:1746065150.949617:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263518464 00002000:00100000:3.0:1746065150.949655:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3514368->3518463) req@ffff88008c45a300 x1830881263518464/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.949665:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45a300 with x1830881263518464 ext(3514368->3518463) 00002000:00010000:3.0:1746065150.949669:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45a300 00000100:00100000:3.0:1746065150.949703:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3729 00000100:00100000:3.0:1746065150.949710:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263518464:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065150.950015:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263517952:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8195us (8499us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065150.950023:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3728 00000100:00100000:3.0:1746065150.950054:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263518464:12345-192.168.202.27@tcp:3:cat.0 Request processed in 340us (697us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065150.950060:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3729 00002000:00100000:3.0:1746065150.950065:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3514368->3518463) req@ffff88008c45a300 x1830881263518464/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.950071:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45a300 with x1830881263518464 ext(3514368->3518463) 00002000:00010000:3.0:1746065150.950074:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45a300 00002000:00100000:1.0:1746065150.950153:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800983bbb80 x1830881263517952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065150.950161:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bbb80 with x1830881263517952 ext(2097152->3145727) 00002000:00010000:1.0:1746065150.950165:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983bbb80 00000100:00100000:0.0:1746065150.954024:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263517824:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12327us (12531us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065150.954035:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1299 00002000:00100000:0.0:1746065150.954045:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff8800983bb800 x1830881263517824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.954053:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983bb800 with x1830881263517824 ext(3145728->4194303) 00010000:00010000:0.0:1746065150.954062:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.954075:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746065150.954082:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800983bb800 00000100:00100000:3.0:1746065150.954251:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.954333:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263518720 00000100:00100000:0.0:1746065150.954339:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263518720 00002000:00100000:0.0:1746065150.954365:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2400255) req@ffff88009acef100 x1830881263518720/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.954373:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef100 with x1830881263518720 ext(2097152->2400255) 00010000:00010000:0.0:1746065150.954377:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.954385:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 39 pid: 9548 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746065150.954390:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009acef100 00000100:00100000:0.0:1746065150.954433:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1301 00000100:00100000:0.0:1746065150.954440:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263518720:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065150.959380:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.959467:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263518848 00000100:00100000:2.0:1746065150.959475:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263518848 00000100:00100000:2.0:1746065150.959523:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13162 00000100:00100000:2.0:1746065150.959530:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+41:32239:x1830881263518848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.959546:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.959560:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93377a expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.959581:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065150.959583:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065150.959588:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.959596:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.959604:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4200, rc 0) 00000100:00100000:2.0:1746065150.959653:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:32239:x1830881263518848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 123us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065150.959658:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13162 00000100:00100000:3.0:1746065150.965127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.965152:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263518976 00000100:00100000:1.0:1746065150.965160:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263518976 00000100:00100000:1.0:1746065150.965205:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13163 00000100:00100000:1.0:1746065150.965216:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+17:32230:x1830881263518976:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065150.965231:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065150.965246:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933781 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.965267:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065150.965270:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065150.965274:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 18 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.965350:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 18 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.965359:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5200, rc 0) 00000100:00100000:1.0:1746065150.965518:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+18:32230:x1830881263518976:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 306us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.965524:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13163 00000100:00100000:0.0:1746065150.965591:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263518720:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11150us (11340us total) trans 21474840907 rc 0/0 00000100:00100000:0.0:1746065150.965598:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1301 00002000:00100000:0.0:1746065150.965605:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2400255) req@ffff88009acef100 x1830881263518720/t21474840907(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/448 e 0 to 0 dl 1746065161 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.965613:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef100 with x1830881263518720 ext(2097152->2400255) 00010000:00010000:0.0:1746065150.965619:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 42 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746065150.965630:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 42 pid: 9548 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746065150.965640:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009acef100 00000100:00100000:0.0:1746065150.970909:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.971097:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263519104 00000100:00100000:1.0:1746065150.971106:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263519104 00010000:00010000:1.0:1746065150.971138:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 42 pid: 9548 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746065150.971241:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5937 00000100:00100000:1.0:1746065150.971249:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263519104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065150.971261:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065150.971274:0:9565:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065150 -> 1746065151 00002000:00010000:1.0:1746065150.971276:0:9565:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065150 -> 1746065151 00010000:00010000:1.0:1746065150.971281:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 42 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.971291:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 42 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.971311:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc146f4e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2400255) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93376c expref: 42 pid: 9548 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746065150.971338:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.971340:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.971346:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.971357:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.971364:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.971365:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.971369:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 41 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.971375:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 41 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.971380:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.971381:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065150.971384:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.971390:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065150.971414:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065150.971863:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263335552:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065150.971953:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 41 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065150.971965:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263335680:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065150.971988:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065150.971995:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263335808:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065150.972011:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065150.975445:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263335552:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065150.975458:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263335680:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065150.975465:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263335808:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065150.975482:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065150.975517:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263519104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4269us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065150.975527:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5937 00000100:00100000:0.0:1746065150.977413:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.978127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065150.979561:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263519232 00000100:00100000:1.0:1746065150.979570:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263519232 00000100:00100000:1.0:1746065150.979628:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13164 00000100:00100000:1.0:1746065150.979635:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263519232:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065150.979650:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065150.979664:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc146f508 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933788 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065150.979709:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263335936:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065150.979803:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065150.980231:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263519488 00000100:00100000:3.0:1746065150.980236:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263519488 00000100:00100000:2.0:1746065150.980401:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13165 00000100:00100000:2.0:1746065150.980408:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263519488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065150.980416:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065150.980426:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc146f50f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933796 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065150.980442:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc146f50f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933796 expref: 19 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.980451:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc146f50f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933796 expref: 19 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.980468:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4e00, rc 0) 00000100:00100000:2.0:1746065150.980496:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263519488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 88us (2369us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.980501:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13165 00000100:00100000:0.0:1746065150.980815:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.980843:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.980857:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.980882:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065150.980911:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263519872 00000100:00100000:0.0:1746065150.980914:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263519872 00002000:00100000:0.0:1746065150.980947:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88009077c000 x1830881263519872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065150.980955:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263519360 00002000:00100000:0.0:1746065150.980956:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c000 with x1830881263519872 ext(3145728->4194303) 00000100:00100000:2.0:1746065150.980959:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263519360 00002000:00010000:0.0:1746065150.980960:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077c000 00000100:00100000:0.0:1746065150.980969:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263520128 00000100:00100000:0.0:1746065150.980971:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263520128 00000100:00100000:2.0:1746065150.980974:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263519616 00000100:00100000:2.0:1746065150.980977:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263519616 00002000:00100000:0.0:1746065150.980980:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4554752->4558847) req@ffff88009077f100 x1830881263520128/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065150.980982:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3730 00002000:00100000:0.0:1746065150.980986:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f100 with x1830881263520128 ext(4554752->4558847) 00000100:00100000:2.0:1746065150.980988:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13166 00002000:00010000:0.0:1746065150.980988:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f100 00000100:00100000:3.0:1746065150.980990:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263519872:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065150.980993:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263519360:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065150.980997:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3731 00010000:00010000:2.0:1746065150.981000:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065150.981002:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263520128:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065150.981007:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146f516 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93378f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065150.981030:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263336064:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065150.981059:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065150.981072:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13167 00000100:00100000:2.0:1746065150.981077:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263519616:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065150.981078:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263520128:12345-192.168.202.27@tcp:3:cat.0 Request processed in 75us (194us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746065150.981082:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065150.981087:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3731 00010000:00010000:2.0:1746065150.981089:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146f51d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93379d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065150.981092:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4554752->4558847) req@ffff88009077f100 x1830881263520128/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065150.981098:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f100 with x1830881263520128 ext(4554752->4558847) 00002000:00010000:0.0:1746065150.981100:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f100 00000100:00100000:2.0:1746065150.981108:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263336192:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065150.981125:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065150.988472:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263335936:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065150.988501:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc146f508 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933788 expref: 20 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065150.988513:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5600/0xad6b7ddc146f508 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933788 expref: 20 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065150.988539:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5600, rc 0) 00000100:00100000:1.0:1746065150.988578:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263519232:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8942us (11168us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065150.988585:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13164 00002000:00010000:0.0:1746065150.989054:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065150 -> 1746065151 00002000:00010000:0.0:1746065150.989058:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065150 -> 1746065151 00002000:00010000:0.0:1746065150.989060:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065150 -> 1746065151 00000100:00100000:0.0:1746065150.989066:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263336192:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065150.989080:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146f51d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93379d expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065150.989088:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4c00/0xad6b7ddc146f51d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93379d expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065150.989168:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263336064:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065150.989183:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146f516 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93378f expref: 19 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.989191:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc146f516 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93378f expref: 19 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065150.989204:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5600, rc 0) 00000100:00100000:2.0:1746065150.989225:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263519360:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8231us (8410us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065150.989230:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13166 00010000:00010000:0.0:1746065150.990042:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4c00, rc 0) 00000100:00100000:0.0:1746065150.990065:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263519616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8987us (9220us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065150.990070:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13167 00000100:00100000:1.0:1746065150.990147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.990341:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263520384 00000100:00100000:3.0:1746065150.990347:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263520384 00000100:00100000:3.0:1746065150.990375:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4919 00000100:00100000:3.0:1746065150.990381:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+26:32230:x1830881263520384:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065150.991299:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+27:32230:x1830881263520384:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 916us (1151us total) trans 8589935967 rc 0/0 00000100:00100000:3.0:1746065150.991305:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4919 00000100:00100000:1.0:1746065150.991710:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.991848:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263519872:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10859us (10988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065150.991855:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3730 00002000:00100000:3.0:1746065150.991862:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88009077c000 x1830881263519872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:66/0 lens 488/440 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.991875:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c000 with x1830881263519872 ext(3145728->4194303) 00002000:00010000:3.0:1746065150.991879:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077c000 00000100:00100000:0.0:1746065150.991945:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263520512 00000100:00100000:0.0:1746065150.991948:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263520512 00000100:00100000:0.0:1746065150.991975:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13636 00000100:00100000:0.0:1746065150.991981:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32243:x1830881263520512:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065150.991992:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065150.992006:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f524 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337a4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.992043:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.992052:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.992061:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.992071:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.992075:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.992080:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.992132:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.992141:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 49 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.992147:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065150.992168:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 49 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065150.992178:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 49 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746065150.992188:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263336320:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065150.992240:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065150.992633:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065150.992957:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263520768 00000100:00100000:3.0:1746065150.992961:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263520768 00002000:00100000:3.0:1746065150.992979:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff88009077dc00 x1830881263520768/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/0 e 0 to 0 dl 1746065161 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.992986:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881263520768 ext(5017600->5021695) 00002000:00010000:3.0:1746065150.992989:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:3.0:1746065150.993039:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3732 00000100:00100000:3.0:1746065150.993045:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263520768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065150.993527:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263520768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 480us (892us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065150.993533:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3732 00002000:00100000:3.0:1746065150.993538:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff88009077dc00 x1830881263520768/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746065161 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065150.993545:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881263520768 ext(5017600->5021695) 00002000:00010000:3.0:1746065150.993547:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:0.0:1746065150.996297:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065150.997007:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263336320:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065150.997026:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065150.997056:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263521024 00000100:00100000:1.0:1746065150.997062:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263521024 00000100:00100000:1.0:1746065150.997103:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4920 00000100:00100000:1.0:1746065150.997108:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+50:30397:x1830881263521024:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065150.998142:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+51:30397:x1830881263521024:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1031us (1847us total) trans 8589935968 rc 0/0 00000100:00100000:1.0:1746065150.998148:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4920 00000100:00100000:0.0:1746065151.002557:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.002608:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.002684:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263521152 00000100:00100000:2.0:1746065151.002691:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263521152 00000100:00100000:1.0:1746065151.003174:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263521280 00000100:00100000:1.0:1746065151.003178:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263521280 00000100:00100000:2.0:1746065151.003245:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13168 00000100:00100000:2.0:1746065151.003253:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+35:32239:x1830881263521152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.003269:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.003285:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337ab expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.003310:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.003317:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065151.003319:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065151.003322:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 36 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.003346:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.003359:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 16 pid: 12260 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.003369:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263336448:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.003423:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746065151.003666:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 51 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.003694:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5938 00000100:00100000:1.0:1746065151.003700:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881263521280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065151.003711:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065151.003716:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 51 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.003724:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 51 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.003737:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc146f4ad lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933734 expref: 51 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.003750:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065151.003755:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065151.003762:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065151.003768:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065151.003797:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065151.003817:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+50:2007:x1830881263521280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.003823:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5938 00000100:00080000:3.0:1746065151.004086:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746065151.004090:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065151.004160:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004166:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065151.004210:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065151.004214:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065151.004234:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004242:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004255:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004260:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004264:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004268:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004272:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065151.004276:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004280:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004287:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065151.004289:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065151.004296:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004301:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc146f52b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004322:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004327:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004331:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004334:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065151.004336:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004340:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004346:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098ce5b00) 00010000:00010000:3.0:1746065151.004348:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065151.004349:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004354:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96600/0xad6b7ddc146f532 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.004379:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.004388:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.004393:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065151.004395:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065151.004397:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97400, rc 0) 00000100:00100000:3.0:1746065151.004422:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:32243:x1830881263520512:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 12442us (12712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.004427:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13636 00000100:00100000:0.0:1746065151.008120:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.008151:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.008165:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.008189:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.008362:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263521536 00000100:00100000:1.0:1746065151.008369:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263521536 00000100:00100000:1.0:1746065151.008412:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263521664 00000100:00100000:1.0:1746065151.008414:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263521664 00000100:00100000:1.0:1746065151.008427:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263521792 00000100:00100000:1.0:1746065151.008429:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263521792 00000100:00100000:1.0:1746065151.008439:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13169 00000100:00100000:1.0:1746065151.008446:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2006:x1830881263521536:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065151.008460:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.008475:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146f547 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337b2 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.008518:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263336576:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065151.008577:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00080000:1.0:1746065151.008590:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065151.008592:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065151.008640:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13170 00000100:00100000:3.0:1746065151.008648:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263521664:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065151.008655:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.008662:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc146f54e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337b9 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.008684:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263336704:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065151.008703:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.008717:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13171 00000100:00100000:3.0:1746065151.008722:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263521792:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065151.008727:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.008733:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc146f555 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337c0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.008747:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc146f555 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337c0 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.008756:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc146f555 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337c0 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.008768:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44e00, rc 0) 00000100:00100000:3.0:1746065151.008820:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263521792:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 97us (629us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065151.008826:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13171 00000100:00100000:3.0:1746065151.008843:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263521408 00000100:00100000:3.0:1746065151.008846:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263521408 00002000:00100000:3.0:1746065151.008867:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3514368->4194303) req@ffff88012dc3ce00 x1830881263521408/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.008874:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ce00 with x1830881263521408 ext(3514368->4194303) 00010000:00010000:3.0:1746065151.008879:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 17 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.008889:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 17 pid: 12260 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746065151.008895:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc3ce00 00000100:00100000:3.0:1746065151.008906:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1302 00000100:00100000:3.0:1746065151.008911:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263521408:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065151.009064:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.009074:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263521920 00000100:00100000:0.0:1746065151.009077:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263521920 00000100:00100000:0.0:1746065151.009092:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13172 00000100:00100000:0.0:1746065151.009096:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263521920:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065151.009101:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.009106:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc146f55c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337c7 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.009123:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263336832:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065151.009142:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.009332:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263336448:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.009347:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 36 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.009355:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0600, rc 0) 00000100:00100000:2.0:1746065151.009369:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:32239:x1830881263521152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6117us (6822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.009373:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13168 00000100:00080000:1.0:1746065151.009571:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065151.018209:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263336832:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065151.018238:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc146f55c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337c7 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.018257:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc146f55c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337c7 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.018270:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96c00, rc 0) 00000100:00100000:0.0:1746065151.018305:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263521920:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 9207us (9239us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065151.018311:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13172 00000100:00100000:3.0:1746065151.018453:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263336704:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065151.018467:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc146f54e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337b9 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.018475:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc146f54e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337b9 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.018484:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:3.0:1746065151.018503:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263521664:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 9856us (10336us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065151.018507:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13170 00000100:00100000:2.0:1746065151.019315:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263336576:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065151.019331:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146f547 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337b2 expref: 8 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.019340:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4a00/0xad6b7ddc146f547 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337b2 expref: 8 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.019351:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4a00, rc 0) 00000100:00100000:2.0:1746065151.019373:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2006:x1830881263521536:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 10927us (11220us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065151.019381:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13169 00000100:00100000:2.0:1746065151.020169:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263521408:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11255us (12054us total) trans 17179873458 rc 0/0 00000100:00100000:2.0:1746065151.020176:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1302 00002000:00100000:2.0:1746065151.020184:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3514368->4194303) req@ffff88012dc3ce00 x1830881263521408/t17179873458(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.020192:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ce00 with x1830881263521408 ext(3514368->4194303) 00010000:00010000:2.0:1746065151.020198:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 19 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.020209:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 19 pid: 12260 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.020215:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc3ce00 00000100:00100000:1.0:1746065151.022947:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.023010:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263522176 00000100:00100000:3.0:1746065151.023018:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263522176 00000100:00100000:3.0:1746065151.023059:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13637 00000100:00100000:3.0:1746065151.023065:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:32243:x1830881263522176:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065151.023080:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.023096:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45400/0xad6b7ddc146f563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337ce expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.023173:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.023186:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.023194:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065151.023217:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.023226:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 20 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.023236:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263336960:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.023288:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00080000:1.0:1746065151.023383:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065151.024426:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.024753:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263522304 00000100:00100000:2.0:1746065151.024758:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263522304 00010000:00010000:2.0:1746065151.024901:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 19 pid: 12260 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.024937:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5939 00000100:00100000:2.0:1746065151.024944:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263522304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.024952:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.024967:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 19 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.024980:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 19 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.024998:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44200/0xad6b7ddc146f4c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3514368->18446744073709551615] (req 3514368->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933749 expref: 19 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.025010:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.025011:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.025017:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.025024:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.025042:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 35 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.025049:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263337088:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065151.025101:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.025454:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263336960:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.025468:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065151.025806:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.025963:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263522432 00000100:00100000:2.0:1746065151.025967:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263522432 00010000:00010000:2.0:1746065151.025982:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 21 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.026243:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5940 00000100:00100000:2.0:1746065151.026250:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:2006:x1830881263522432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.026259:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.026264:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 21 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.026271:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 21 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.026283:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc146f539 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337a4 expref: 21 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.026293:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065151.026297:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.026304:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.026309:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.026327:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.026356:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2006:x1830881263522432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.026361:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5940 00010000:00010000:0.0:1746065151.026405:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065151.026410:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065151.026424:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065151.026509:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45400/0xad6b7ddc146f563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ce expref: 21 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.026521:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ce expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.026526:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065151.026528:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065151.026530:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45c00, rc 0) 00000100:00100000:0.0:1746065151.026548:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:32243:x1830881263522176:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3483us (3617us total) trans 8589935969 rc 0/0 00000100:00100000:0.0:1746065151.026552:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13637 00000100:00100000:0.0:1746065151.029034:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.029053:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263522688 00000100:00100000:0.0:1746065151.029059:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263522688 00000100:00100000:0.0:1746065151.029088:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13638 00000100:00100000:0.0:1746065151.029094:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:32243:x1830881263522688:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065151.029111:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.029113:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065151.029129:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45c00/0xad6b7ddc146f56a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ce expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.029139:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065151.029142:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065151.029150:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96c00/0xad6b7ddc146f578 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337d5 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.029220:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065151.029230:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065151.029237:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065151.029246:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065151.029310:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96c00/0xad6b7ddc146f578 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 22 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.029321:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 21 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.029331:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065151.029333:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065151.029335:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96200, rc 0) 00000100:00100000:0.0:1746065151.029364:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:32243:x1830881263522688:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 269us (336us total) trans 8589935970 rc 0/0 00000100:00100000:0.0:1746065151.029369:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13638 00000100:00100000:2.0:1746065151.029526:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263337088:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065151.029538:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.029558:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263522304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4614us (5135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.029564:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5939 00000100:00100000:0.0:1746065151.031696:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.032508:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.032580:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263523072 00000100:00100000:1.0:1746065151.032586:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263523072 00000100:00100000:1.0:1746065151.032619:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13639 00000100:00100000:1.0:1746065151.032627:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:32243:x1830881263523072:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065151.032646:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.032659:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146f58d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337dc expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.032702:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146f58d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337dc expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.032713:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146f58d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337dc expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.032727:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065151.032730:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065151.032732:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5600, rc 0) 00000100:00100000:1.0:1746065151.032769:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+22:32243:x1830881263523072:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 142us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.032789:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13639 00000100:00100000:2.0:1746065151.033614:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263522944 00000100:00100000:2.0:1746065151.033620:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263522944 00002000:00100000:2.0:1746065151.033647:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88012dc3c000 x1830881263522944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.033655:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3c000 with x1830881263522944 ext(3145728->4194303) 00002000:00010000:2.0:1746065151.033659:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3c000 00000100:00100000:2.0:1746065151.034233:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3733 00000100:00100000:2.0:1746065151.034241:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263522944:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065151.034847:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.034879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.034901:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.035019:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263523328 00000100:00100000:3.0:1746065151.035023:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263523328 00000100:00100000:3.0:1746065151.035058:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263523584 00000100:00100000:3.0:1746065151.035061:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263523584 00000100:00100000:3.0:1746065151.035072:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263523840 00000100:00100000:3.0:1746065151.035074:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263523840 00000100:00100000:3.0:1746065151.035088:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13173 00000100:00100000:3.0:1746065151.035094:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263523328:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065151.035115:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.035130:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 37 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.035136:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.035138:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.035140:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.035163:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 37 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.035172:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 37 pid: 9550 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.035184:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263337216:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.035237:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.035252:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13174 00000100:00100000:3.0:1746065151.035258:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263523584:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065151.035276:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.035285:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.035290:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.035291:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.035293:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.035307:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.035314:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 40 pid: 12260 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.035322:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263337344:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.035342:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.035400:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13175 00000100:00100000:1.0:1746065151.035407:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263523840:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065151.035424:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.035432:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 37 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.035438:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 37 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.035444:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065151.035445:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065151.035447:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.035460:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 37 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.035466:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 37 pid: 9550 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.035472:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263337472:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.035497:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 37 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.035504:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 37 pid: 3068 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.035511:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263337600:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.035526:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ab1eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.036752:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.036767:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.036799:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.036812:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263523200 00000100:00100000:1.0:1746065151.036815:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263523200 00000100:00100000:1.0:1746065151.036834:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263523456 00000100:00100000:1.0:1746065151.036836:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263523456 00000100:00100000:1.0:1746065151.036848:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263523712 00000100:00100000:1.0:1746065151.036850:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263523712 00000100:00100000:1.0:1746065151.036869:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13176 00000100:00100000:1.0:1746065151.036874:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263523200:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065151.036894:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.036904:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 40 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.036911:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.036921:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.036926:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.036927:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.036939:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.036956:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.036963:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 17 pid: 3067 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.036970:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263337728:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.037012:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.037018:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 12 pid: 9550 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.037024:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263337856:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.037042:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 40 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.037052:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 40 pid: 12260 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.037058:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263337984:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.037069:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.037079:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13177 00000100:00100000:1.0:1746065151.037084:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263523456:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065151.037099:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.037108:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 37 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.037114:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.037120:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 17 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.037124:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.037125:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.037127:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.037142:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 17 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.037150:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 17 pid: 9550 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.037158:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263338112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.037183:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.037190:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 9 pid: 9548 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.037197:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263338240:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.037220:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 37 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.037227:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 37 pid: 13375 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.037234:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263338368:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.037250:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.037516:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13178 00000100:00100000:2.0:1746065151.037523:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263523712:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065151.037539:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.037548:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.037554:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 40 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.037559:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.037564:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746065151.037565:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746065151.037566:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.037583:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.037590:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 17 pid: 9548 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.037596:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263338496:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.037630:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 40 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.037636:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 40 pid: 9548 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.037643:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263338624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.037660:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.037667:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 17 pid: 1880 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.037673:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263338752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.037688:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.048189:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.048215:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.048234:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263523968 00000100:00100000:0.0:1746065151.048241:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263523968 00002000:00100000:0.0:1746065151.048279:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (2007040->2097151) req@ffff88012dc3f480 x1830881263523968/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.048288:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f480 with x1830881263523968 ext(2007040->2097151) 00010000:00010000:0.0:1746065151.048296:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 41 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.048306:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 41 pid: 12260 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746065151.048312:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3f480 00000100:00100000:0.0:1746065151.048328:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263524096 00000100:00100000:0.0:1746065151.048330:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263524096 00002000:00100000:0.0:1746065151.048342:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1470464->1814527) req@ffff880099bd6d80 x1830881263524096/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.048349:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd6d80 with x1830881263524096 ext(1470464->1814527) 00010000:00010000:0.0:1746065151.048354:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 38 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.048361:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 38 pid: 9550 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746065151.048366:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd6d80 00000100:00100000:0.0:1746065151.048377:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1303 00000100:00100000:0.0:1746065151.048383:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263523968:12345-192.168.202.27@tcp:4:multiop.0 00000100:00080000:1.0:1746065151.048392:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065151.048421:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263337472:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.048429:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263337600:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.048445:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.048498:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263337216:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.048509:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.048530:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1304 00000100:00100000:3.0:1746065151.048535:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263524096:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065151.048643:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263337344:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.048654:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.048817:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263337728:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.048825:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263337856:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.048843:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263337984:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.048856:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.048857:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.048872:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263338112:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065151.048876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.048887:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.048903:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263338240:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.048910:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263338368:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.048922:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.048923:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.048944:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263524352 00000100:00100000:0.0:1746065151.048947:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263524352 00000100:00100000:2.0:1746065151.048987:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263524224 00000100:00100000:2.0:1746065151.048989:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263524224 00010000:00010000:2.0:1746065151.049003:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 40 pid: 3068 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.049025:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263524480 00000100:00100000:2.0:1746065151.049028:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263524480 00010000:00010000:2.0:1746065151.049036:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 43 pid: 12260 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746065151.049048:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263524736 00000100:00100000:2.0:1746065151.049049:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263524736 00010000:00010000:2.0:1746065151.049057:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 18 pid: 9550 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746065151.049066:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5941 00000100:00100000:2.0:1746065151.049070:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263524224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.049078:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.049089:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 40 pid: 3068 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.049097:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 40 pid: 3068 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.049114:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45800/0xad6b7ddc146f4ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933765 expref: 40 pid: 3068 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.049132:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.049152:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263524224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.049158:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5941 00000100:00100000:2.0:1746065151.049171:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5942 00000100:00100000:2.0:1746065151.049175:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881263524480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.049182:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.049191:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 43 pid: 12260 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746065151.049198:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 43 pid: 12260 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746065151.049211:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc146f111 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933471 expref: 43 pid: 12260 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746065151.049220:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.049231:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263524480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 56us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.049236:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5942 00000100:00100000:2.0:1746065151.049244:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5943 00000100:00100000:2.0:1746065151.049248:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263524736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.049253:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.049259:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 18 pid: 9550 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746065151.049267:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 18 pid: 9550 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746065151.049277:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc146f39c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933677 expref: 18 pid: 9550 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746065151.049284:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.053105:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263524736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.053126:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5943 00000100:00100000:2.0:1746065151.053201:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263338496:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.053211:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263338624:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.053299:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263522944:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 19058us (21607us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065151.053306:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3733 00002000:00100000:2.0:1746065151.053314:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88012dc3c000 x1830881263522944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.053322:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3c000 with x1830881263522944 ext(3145728->4194303) 00010000:00010000:2.0:1746065151.053331:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 37 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.053343:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 37 pid: 9550 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.053354:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc3c000 00010000:00010000:0.0:1746065151.053449:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 13 pid: 9550 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746065151.053472:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5944 00000100:00100000:0.0:1746065151.053479:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263524352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.053490:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.053504:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 13 pid: 9550 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.053510:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 13 pid: 9550 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.053529:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc146f20d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933543 expref: 13 pid: 9550 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.053544:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.053560:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263524352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (4703us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.053564:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5944 00000100:00100000:0.0:1746065151.053647:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.053665:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263524992 00000100:00100000:0.0:1746065151.053669:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263524992 00010000:00010000:0.0:1746065151.053681:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 37 pid: 13375 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746065151.053694:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5945 00000100:00100000:0.0:1746065151.053698:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263524992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.053704:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.053713:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 37 pid: 13375 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.053720:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 37 pid: 13375 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.053736:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc146f38e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933669 expref: 37 pid: 13375 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.053744:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.053756:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263524992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.053761:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5945 00000100:00100000:0.0:1746065151.053817:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.053827:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263524608 00000100:00100000:0.0:1746065151.053829:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263524608 00010000:00010000:0.0:1746065151.053838:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 10 pid: 9548 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746065151.053850:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5946 00000100:00100000:0.0:1746065151.053854:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263524608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.053859:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.053865:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 10 pid: 9548 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.053872:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 10 pid: 9548 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.053882:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc146f42f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336d9 expref: 10 pid: 9548 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.053895:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.053897:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.053901:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.053908:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.053925:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.053948:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263524608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.053953:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5946 00000100:00100000:0.0:1746065151.053985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.053994:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263524864 00000100:00100000:0.0:1746065151.053996:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263524864 00010000:00010000:0.0:1746065151.054015:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 18 pid: 9548 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746065151.054027:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5947 00000100:00100000:0.0:1746065151.054031:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263524864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.054036:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.054043:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 18 pid: 9548 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.054050:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 18 pid: 9548 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.054064:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc146f4f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [4558848->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933773 expref: 18 pid: 9548 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.054073:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.054086:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263524864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.054091:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5947 00000100:00100000:0.0:1746065151.054142:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.054178:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.054187:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263525120 00000100:00100000:0.0:1746065151.054189:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263525120 00010000:00010000:0.0:1746065151.054197:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 17 pid: 3067 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746065151.054209:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5948 00000100:00100000:0.0:1746065151.054213:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263525120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.054219:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.054225:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 17 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.054231:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 17 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.054239:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8000/0xad6b7ddc146f13b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93349b expref: 17 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.054249:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.054250:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.054252:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054257:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054269:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.054282:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263525120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.054287:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5948 00000100:00080000:0.0:1746065151.054373:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746065151.054383:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054390:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054403:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054410:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054415:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054425:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a656ec00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065151.054428:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054434:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054442:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054447:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc146f5a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.054480:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263523200:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 17606us (17730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.054486:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13176 00010000:00010000:0.0:1746065151.054531:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054538:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054548:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054554:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054560:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054565:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800906d0a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065151.054567:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054574:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054582:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.054588:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc146f5b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.054620:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263523456:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 17535us (17852us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.054625:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13177 00000100:00100000:2.0:1746065151.054924:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263338752:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.054953:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.054972:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263525248 00000100:00100000:2.0:1746065151.054975:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263525248 00002000:00100000:2.0:1746065151.054993:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4558847) req@ffff880099bd5880 x1830881263525248/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.055000:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5880 with x1830881263525248 ext(4194304->4558847) 00010000:00010000:2.0:1746065151.055005:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 16 pid: 1880 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.055014:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 16 pid: 1880 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.055019:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099bd5880 00000100:00100000:2.0:1746065151.055031:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1305 00000100:00100000:2.0:1746065151.055036:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263525248:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065151.055954:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.056037:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263525376 00000100:00100000:3.0:1746065151.056041:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263525376 00010000:00010000:3.0:1746065151.056057:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 42 pid: 9548 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.056083:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5949 00000100:00100000:3.0:1746065151.056089:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263525376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.056095:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.056104:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 42 pid: 9548 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.056112:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 42 pid: 9548 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.056126:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc146f4fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93377a expref: 42 pid: 9548 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.056139:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.056316:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263525376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 227us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.056322:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5949 00000100:00100000:3.0:1746065151.059999:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263524096:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11454us (11774us total) trans 17179873459 rc 0/0 00000100:00100000:3.0:1746065151.060014:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1304 00002000:00100000:3.0:1746065151.060023:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1470464->1814527) req@ffff880099bd6d80 x1830881263524096/t17179873459(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.060031:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd6d80 with x1830881263524096 ext(1470464->1814527) 00010000:00010000:3.0:1746065151.060041:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 36 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.060053:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 36 pid: 9550 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746065151.060060:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd6d80 00000100:00100000:0.0:1746065151.067730:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.067753:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263525632 00000100:00100000:0.0:1746065151.067760:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263525632 00000100:00100000:0.0:1746065151.067810:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13179 00000100:00100000:0.0:1746065151.067818:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263525632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065151.067834:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.067847:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3400/0xad6b7ddc146f5be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337ea expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.067888:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263338880:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065151.067957:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.071213:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263525248:12345-192.168.202.27@tcp:4:cat.0 Request processed in 16169us (17063us total) trans 21474840909 rc 0/0 00000100:00100000:2.0:1746065151.071213:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263523968:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 22823us (23024us total) trans 21474840908 rc 0/0 00000100:00100000:3.0:1746065151.071223:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1305 00002000:00100000:3.0:1746065151.071233:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->4558847) req@ffff880099bd5880 x1830881263525248/t21474840909(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.071240:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5880 with x1830881263525248 ext(4194304->4558847) 00010000:00010000:3.0:1746065151.071249:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 18 pid: 1880 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.071254:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065151.071260:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 18 pid: 1880 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746065151.071265:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099bd5880 00000100:00100000:1.0:1746065151.071295:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.071365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.071377:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.071389:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.071402:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263525888 00000100:00100000:1.0:1746065151.071408:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263525888 00000100:00100000:1.0:1746065151.071428:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263526144 00000100:00100000:1.0:1746065151.071430:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263526144 00000100:00100000:1.0:1746065151.071439:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263525504 00000100:00100000:1.0:1746065151.071440:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263525504 00000100:00100000:1.0:1746065151.071446:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263525760 00000100:00100000:1.0:1746065151.071448:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263525760 00000100:00100000:1.0:1746065151.071453:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263526016 00000100:00100000:1.0:1746065151.071454:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263526016 00000100:00100000:1.0:1746065151.071461:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13180 00000100:00100000:1.0:1746065151.071467:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263525888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.071479:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.071489:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc146f5c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337f8 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.071526:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263339008:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065151.071563:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.071584:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13181 00000100:00100000:1.0:1746065151.071589:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263526144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.071596:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.071605:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f5cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933806 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.071615:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.071623:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f5cc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933806 expref: 40 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.071631:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f5cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933806 expref: 40 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.071642:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a1e200, rc 0) 00000100:00100000:1.0:1746065151.071657:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263526144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (361us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065151.071665:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13181 00000100:00100000:1.0:1746065151.071677:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13182 00000100:00100000:1.0:1746065151.071682:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263525504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.071687:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.071693:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337e3 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065151.071706:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d6fc, atime: 0x6812d6fc, ctime: 0x6812d6fc, blocks: 0x7f8 00010000:00010000:1.0:1746065151.071713:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.071715:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.071721:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 46 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.071732:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 46 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.071740:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a1e800, rc 0) 00000100:00100000:1.0:1746065151.071753:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881263525504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.071757:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13182 00000100:00100000:1.0:1746065151.071767:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13183 00000100:00100000:1.0:1746065151.071770:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263525760:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.071792:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.071800:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337f1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065151.071814:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6fe, atime: 0x6812d6fd, ctime: 0x6812d6fe, blocks: 0x800 00010000:00010000:1.0:1746065151.071821:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.071822:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.071826:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 39 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.071834:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 39 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.071840:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:1.0:1746065151.071853:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263525760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 82us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.071857:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13183 00000100:00100000:1.0:1746065151.071865:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13184 00000100:00100000:1.0:1746065151.071869:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263526016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.071874:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.071878:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00a00/0xad6b7ddc146f5e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9337ff expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.071890:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f00a00/0xad6b7ddc146f5e1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ff expref: 46 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.071897:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00a00/0xad6b7ddc146f5e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ff expref: 46 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.071907:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00a00, rc 0) 00000100:00100000:1.0:1746065151.071921:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263526016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 52us (531us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065151.071926:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13184 00000100:00100000:1.0:1746065151.071978:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.071997:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263526272 00000100:00100000:1.0:1746065151.072000:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263526272 00010000:00010000:1.0:1746065151.072012:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 39 pid: 9550 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.072029:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5950 00000100:00100000:1.0:1746065151.072034:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263526272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065151.072042:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065151.072051:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 39 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.072059:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 39 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.072070:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc146f540 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ab expref: 39 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.072077:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.072079:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.072082:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072092:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072106:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065151.072115:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072120:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072132:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072138:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072145:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072149:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065151.072152:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072159:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072165:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.072171:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4400/0xad6b7ddc146f5a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.072197:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263523840:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 36790us (37295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.072201:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13175 00000100:00100000:1.0:1746065151.072217:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263526272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 184us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.072222:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5950 00000100:00100000:2.0:1746065151.072531:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1303 00002000:00100000:2.0:1746065151.072538:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (2007040->2097151) req@ffff88012dc3f480 x1830881263523968/t21474840908(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.072550:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f480 with x1830881263523968 ext(2007040->2097151) 00010000:00010000:2.0:1746065151.072555:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 44 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.072562:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 44 pid: 12260 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.072567:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3f480 00000100:00100000:0.0:1746065151.077371:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263338880:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065151.077397:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3400/0xad6b7ddc146f5be lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ea expref: 37 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.077408:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3400/0xad6b7ddc146f5be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337ea expref: 37 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.077419:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3400, rc 0) 00000100:00100000:0.0:1746065151.079031:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263525632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11208us (11302us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065151.079040:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13179 00000100:00100000:0.0:1746065151.079630:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.079688:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263526400 00000100:00100000:3.0:1746065151.079695:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263526400 00010000:00010000:3.0:1746065151.079721:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 36 pid: 9550 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.079745:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5951 00000100:00100000:3.0:1746065151.079752:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263526400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.079763:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.079806:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 36 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.079815:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 36 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.079832:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc146f3e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->1814527) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9336a1 expref: 36 pid: 9550 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.079858:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.079860:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.079864:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.079871:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.079895:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065151.079915:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.079920:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263526400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 170us (291us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065151.079922:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.079925:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5951 00010000:00010000:0.0:1746065151.079945:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.079957:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.079963:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.079969:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065151.079972:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.079979:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.079988:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.079993:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc146f594 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.080028:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2004:x1830881263523328:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 44934us (45182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.080034:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13173 00000100:00100000:0.0:1746065151.081447:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.083968:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.087459:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263526656 00000100:00100000:3.0:1746065151.087470:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263526656 00010000:00010000:3.0:1746065151.087509:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 44 pid: 12260 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.087548:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5952 00000100:00100000:3.0:1746065151.087554:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881263526656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.087566:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.087582:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 44 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.087592:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 44 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.087614:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.087616:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.087620:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.087628:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.087664:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.087707:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881263526656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 153us (6264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.087713:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5952 00010000:00010000:1.0:1746065151.088705:0:9549:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880091a90000 x1830881263339008) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 43 pid: 12260 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.088724:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc146f4c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933742 expref: 43 pid: 12260 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.088737:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263339008:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065151.088757:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc146f5c5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f8 expref: 42 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.088767:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc146f5c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f8 expref: 42 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.088794:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01c00, rc 0) 00000100:00100000:1.0:1746065151.088818:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263525888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 17351us (17563us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065151.088825:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13180 00000100:00100000:1.0:1746065151.088852:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263526528 00000100:00100000:1.0:1746065151.088855:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263526528 00010000:00010000:1.0:1746065151.088868:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 18 pid: 1880 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.088884:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5953 00000100:00100000:1.0:1746065151.088888:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263526528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065151.088896:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065151.088902:0:7191:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065150 -> 1746065151 00010000:00010000:1.0:1746065151.088906:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 18 pid: 1880 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.088914:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 18 pid: 1880 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.088925:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5200/0xad6b7ddc146f501 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4194304->4558847] (req 4194304->4558847) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933781 expref: 18 pid: 1880 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.088947:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.088949:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.088952:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.088957:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.088975:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065151.088988:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263526528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (5026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.088993:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5953 00010000:00010000:2.0:1746065151.092250:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092263:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092286:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092293:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092299:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092305:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065151.092308:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092318:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092332:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092337:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f5b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.092530:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263523712:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 55002us (55724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.092540:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13178 00010000:00010000:2.0:1746065151.092570:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092577:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092590:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092595:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092600:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092607:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065151.092610:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092614:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092622:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.092627:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc146f59b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.092656:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263523584:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 57398us (57776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.092661:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13174 00000100:00100000:2.0:1746065151.093438:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.093589:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263526912 00000100:00100000:0.0:1746065151.093595:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263526912 00000100:00100000:0.0:1746065151.093634:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13640 00000100:00100000:0.0:1746065151.093640:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+50:32247:x1830881263526912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065151.093658:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.093670:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc146f5e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93380d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.093742:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065151.093754:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 21 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.093760:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065151.093800:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 21 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.093810:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 21 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746065151.093820:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263339136:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065151.093889:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.101653:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.102568:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.102695:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263527040 00000100:00100000:1.0:1746065151.102705:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263527040 00010000:00010000:1.0:1746065151.102742:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 22 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.103625:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263527168 00000100:00100000:3.0:1746065151.103629:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263527168 00000100:00100000:3.0:1746065151.103655:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13185 00000100:00100000:3.0:1746065151.103661:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:32239:x1830881263527168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.103676:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.103691:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933814 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065151.103710:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d6ff, atime: 0x6812d6ff, ctime: 0x6812d6ff, blocks: 0x1650 00010000:00010000:3.0:1746065151.103728:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.103730:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.103735:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.103748:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.103757:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:3.0:1746065151.103806:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+42:32239:x1830881263527168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 144us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.103812:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13185 00000100:00100000:2.0:1746065151.105006:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263339136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.105025:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065151.105119:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.105149:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263527424 00000100:00100000:0.0:1746065151.105153:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263527424 00000100:00100000:0.0:1746065151.105178:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13641 00000100:00100000:0.0:1746065151.105183:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+23:32243:x1830881263527424:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:0.0:1746065151.105212:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.105228:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5600/0xad6b7ddc146f58d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337dc expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.105241:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065151.105245:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065151.105252:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065151.105257:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.105279:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+22:32243:x1830881263527424:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 96us (161us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746065151.105284:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13641 00000100:00100000:1.0:1746065151.105760:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5954 00000100:00100000:1.0:1746065151.105768:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:2007:x1830881263527040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065151.105799:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065151.105804:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 21 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.105813:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 21 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.105823:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc146f57f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337d5 expref: 21 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.105838:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065151.105841:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065151.105847:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065151.105856:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065151.105868:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065151.105884:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:2007:x1830881263527040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 118us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.105889:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5954 00010000:00010000:2.0:1746065151.106920:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.106937:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065151.106954:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065151.107051:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc146f5e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 53 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.107067:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 52 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.107073:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065151.107075:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065151.107077:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:2.0:1746065151.107104:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+52:32247:x1830881263526912:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 13464us (13667us total) trans 8589935971 rc 0/0 00000100:00100000:2.0:1746065151.107110:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13640 00000100:00100000:0.0:1746065151.111626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.112396:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263527680 00000100:00100000:3.0:1746065151.112404:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263527680 00002000:00100000:3.0:1746065151.112442:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880099bd4380 x1830881263527680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.112451:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4380 with x1830881263527680 ext(4194304->5021695) 00002000:00010000:3.0:1746065151.112455:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4380 00000100:00100000:3.0:1746065151.112474:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3734 00000100:00100000:3.0:1746065151.112481:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263527680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.122892:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.123332:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263527936 00000100:00100000:1.0:1746065151.123340:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263527936 00000100:00100000:1.0:1746065151.123866:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4921 00000100:00100000:1.0:1746065151.123874:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:32243:x1830881263527936:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065151.124039:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:32243:x1830881263527936:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 165us (1154us total) trans 8589935972 rc 0/0 00000100:00100000:1.0:1746065151.124437:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4921 00000100:00100000:3.0:1746065151.125377:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263527680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12895us (13756us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065151.125384:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3734 00002000:00100000:3.0:1746065151.125391:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880099bd4380 x1830881263527680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.125399:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4380 with x1830881263527680 ext(4194304->5021695) 00002000:00010000:3.0:1746065151.125404:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4380 00000100:00100000:0.0:1746065151.133054:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.133092:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.133142:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263528192 00000100:00100000:1.0:1746065151.133149:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263528192 00000100:00100000:1.0:1746065151.133193:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4922 00000100:00100000:1.0:1746065151.133200:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+21:32243:x1830881263528192:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065151.133239:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.133264:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.133276:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.133288:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263528320 00000100:00100000:0.0:1746065151.133291:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263528320 00000100:00100000:0.0:1746065151.133308:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263528448 00000100:00100000:0.0:1746065151.133310:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263528448 00000100:00100000:1.0:1746065151.133351:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+22:32243:x1830881263528192:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 151us (308us total) trans 8589935973 rc 0/0 00000100:00100000:1.0:1746065151.133357:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4922 00000100:00100000:0.0:1746065151.133504:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263528704 00000100:00100000:0.0:1746065151.133507:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263528704 00000100:00100000:2.0:1746065151.133531:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263528832 00000100:00100000:2.0:1746065151.133534:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263528832 00000100:00100000:2.0:1746065151.133549:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13186 00000100:00100000:2.0:1746065151.133553:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881263528320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.133560:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.133576:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93381b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065151.133591:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d6ff, atime: 0x6812d6ff, ctime: 0x6812d6fe, blocks: 0x808 00010000:00010000:2.0:1746065151.133602:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133604:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133610:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 36 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.133626:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 36 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.133633:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683b800, rc 0) 00000100:00100000:2.0:1746065151.133647:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881263528320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 94us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.133651:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13186 00000100:00100000:2.0:1746065151.133660:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13187 00000100:00100000:2.0:1746065151.133663:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263528448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.133668:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.133676:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933822 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065151.133685:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d6ff, atime: 0x6812d6fe, ctime: 0x6812d6ff, blocks: 0x808 00010000:00010000:2.0:1746065151.133690:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133691:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133694:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 43 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.133702:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 43 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.133707:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a200, rc 0) 00000100:00100000:2.0:1746065151.133716:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881263528448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.133724:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13187 00000100:00100000:2.0:1746065151.133730:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13188 00000100:00100000:2.0:1746065151.133733:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263528704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.133737:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.133741:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933830 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.133749:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133750:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133753:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.133759:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.133764:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a000, rc 0) 00000100:00100000:2.0:1746065151.133791:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263528704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 39us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.133794:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13188 00000100:00100000:2.0:1746065151.133802:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13189 00000100:00100000:2.0:1746065151.133806:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263528832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.133810:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.133814:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933837 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.133821:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133822:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133825:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.133831:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.133836:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683be00, rc 0) 00000100:00100000:2.0:1746065151.133847:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263528832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 41us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.133850:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13189 00000100:00100000:2.0:1746065151.133912:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.133925:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263529472 00000100:00100000:2.0:1746065151.133936:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263529472 00000100:00100000:2.0:1746065151.133957:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13190 00000100:00100000:2.0:1746065151.133962:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+43:32247:x1830881263529472:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065151.133967:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.133974:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93385a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.133987:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.133993:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133994:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.133997:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 44 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.134010:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065151.134021:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.134022:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263528576 00000100:00100000:1.0:1746065151.134024:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263528576 00010000:00010000:2.0:1746065151.134031:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 44 pid: 1880 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.134104:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13191 00000100:00100000:1.0:1746065151.134110:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881263528576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.134116:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.134123:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933829 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065151.134132:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d6ff, atime: 0x6812d6ff, ctime: 0x6812d6ff, blocks: 0x1000 00010000:00010000:1.0:1746065151.134138:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.134139:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.134143:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.134150:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.134156:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00a00, rc 0) 00000100:00100000:2.0:1746065151.134158:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263339264:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.134170:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263528576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.134174:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13191 00000100:00100000:1.0:1746065151.134196:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.134210:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.134221:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.134229:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263528960 00000100:00100000:1.0:1746065151.134232:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263528960 00000100:00100000:3.0:1746065151.134262:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263529088 00000100:00100000:3.0:1746065151.134264:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263529088 00000100:00100000:3.0:1746065151.134279:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263529216 00000100:00100000:3.0:1746065151.134281:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263529216 00000100:00100000:3.0:1746065151.134290:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13192 00000100:00100000:3.0:1746065151.134294:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263528960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.134300:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.134306:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93383e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.134315:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.134316:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.134320:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.134326:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.134332:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a1e200, rc 0) 00000100:00100000:3.0:1746065151.134348:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263528960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.134352:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13192 00000100:00100000:3.0:1746065151.134361:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13193 00000100:00100000:3.0:1746065151.134365:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263529088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.134369:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.134375:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933845 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.134382:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.134384:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.134387:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.134395:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.134401:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae22600, rc 0) 00000100:00100000:3.0:1746065151.134411:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263529088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 46us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.134415:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13193 00000100:00100000:3.0:1746065151.134424:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13194 00000100:00100000:3.0:1746065151.134428:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263529216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.134432:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.134437:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146f63c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93384c expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.134448:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.134454:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146f63c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93384c expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.134460:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc146f63c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93384c expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.134470:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae23c00, rc 0) 00000100:00100000:3.0:1746065151.134480:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263529216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 52us (258us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065151.134484:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13194 00000100:00100000:1.0:1746065151.134615:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.134626:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263529344 00000100:00100000:1.0:1746065151.134629:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263529344 00000100:00100000:1.0:1746065151.134642:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13195 00000100:00100000:1.0:1746065151.134646:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263529344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.134654:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.134659:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933853 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.134667:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.134668:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.134671:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 20 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.134679:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 20 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.134684:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00c00, rc 0) 00000100:00100000:1.0:1746065151.134694:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263529344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 48us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.134698:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13195 00000100:00100000:2.0:1746065151.135155:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.142338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.142399:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.142504:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263529728 00000100:00100000:1.0:1746065151.142511:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263529728 00000100:00100000:1.0:1746065151.142546:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13196 00000100:00100000:1.0:1746065151.142553:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+45:32239:x1830881263529728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.142569:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.142584:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933861 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.142602:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.142604:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.142611:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 46 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.142626:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 46 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.142634:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:1.0:1746065151.142672:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+46:32239:x1830881263529728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 119us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.142677:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13196 00000100:00100000:2.0:1746065151.142809:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263339264:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.142832:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 45 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.142840:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a800, rc 0) 00000100:00100000:2.0:1746065151.142860:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+45:32247:x1830881263529472:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8898us (8948us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.142865:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13190 00000100:00100000:3.0:1746065151.143324:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263529600 00000100:00100000:3.0:1746065151.143329:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263529600 00010000:00010000:3.0:1746065151.143345:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 45 pid: 1880 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.143363:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5955 00000100:00100000:3.0:1746065151.143368:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263529600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.143375:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.143390:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 45 pid: 1880 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.143399:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 45 pid: 1880 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.143413:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc146f5f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5021695) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933814 expref: 45 pid: 1880 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.143425:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.143427:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.143430:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 44 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.143436:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 44 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.143457:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 44 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.143466:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263339392:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065151.143506:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.148376:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.148538:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263529856 00000100:00100000:3.0:1746065151.148545:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263529856 00000100:00100000:3.0:1746065151.148593:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13197 00000100:00100000:3.0:1746065151.148600:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881263529856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.148616:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.148630:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc146f651 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933868 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.148655:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc146f651 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933868 expref: 46 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.148663:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc146f651 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933868 expref: 46 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.148681:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44e00, rc 0) 00000100:00100000:3.0:1746065151.148723:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881263529856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 123us (354us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065151.148729:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13197 00000100:00100000:3.0:1746065151.150488:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263339392:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065151.150506:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.150534:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263529600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7165us (8203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.150542:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5955 00000100:00100000:0.0:1746065151.151825:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.151873:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.152049:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263530112 00000100:00100000:1.0:1746065151.152055:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263530112 00002000:00100000:1.0:1746065151.152090:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3022848->3026943) req@ffff88009077ed80 x1830881263530112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.152098:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ed80 with x1830881263530112 ext(3022848->3026943) 00002000:00010000:1.0:1746065151.152102:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ed80 00000100:00100000:1.0:1746065151.152126:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263530368 00000100:00100000:1.0:1746065151.152128:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263530368 00002000:00100000:1.0:1746065151.152140:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff88009077f800 x1830881263530368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.152146:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881263530368 ext(5017600->5021695) 00002000:00010000:1.0:1746065151.152149:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f800 00000100:00100000:1.0:1746065151.152160:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3735 00000100:00100000:1.0:1746065151.152166:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263530112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065151.152264:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881263530112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 97us (440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065151.152269:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3735 00002000:00100000:1.0:1746065151.152275:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3022848->3026943) req@ffff88009077ed80 x1830881263530112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.152281:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ed80 with x1830881263530112 ext(3022848->3026943) 00002000:00010000:1.0:1746065151.152283:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ed80 00000100:00100000:1.0:1746065151.152296:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3736 00000100:00100000:1.0:1746065151.152301:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881263530368:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065151.152344:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881263530368:12345-192.168.202.27@tcp:3:cat.0 Request processed in 42us (469us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065151.152354:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3736 00002000:00100000:1.0:1746065151.152358:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff88009077f800 x1830881263530368/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.152364:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881263530368 ext(5017600->5021695) 00002000:00010000:1.0:1746065151.152367:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f800 00000100:00100000:0.0:1746065151.154681:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.158018:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.158044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.158061:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.158083:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.158100:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263530880 00000100:00100000:0.0:1746065151.158106:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263530880 00002000:00100000:0.0:1746065151.158139:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3035136->3039231) req@ffff88009077d180 x1830881263530880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.158148:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d180 with x1830881263530880 ext(3035136->3039231) 00002000:00010000:0.0:1746065151.158152:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077d180 00000100:00100000:0.0:1746065151.158165:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263530624 00000100:00100000:0.0:1746065151.158166:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263530624 00002000:00100000:0.0:1746065151.158175:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009077ea00 x1830881263530624/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.158181:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ea00 with x1830881263530624 ext(0->1048575) 00002000:00010000:0.0:1746065151.158183:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ea00 00000100:00100000:0.0:1746065151.158189:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263531136 00000100:00100000:0.0:1746065151.158190:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263531136 00002000:00100000:0.0:1746065151.158198:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009077d880 x1830881263531136/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.158204:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881263531136 ext(1048576->2097151) 00002000:00010000:0.0:1746065151.158207:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077d880 00000100:00100000:0.0:1746065151.158212:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263531264 00000100:00100000:0.0:1746065151.158214:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263531264 00002000:00100000:0.0:1746065151.158221:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009077ca80 x1830881263531264/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.158227:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ca80 with x1830881263531264 ext(1048576->2097151) 00002000:00010000:0.0:1746065151.158229:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ca80 00000100:00100000:0.0:1746065151.158235:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263531648 00000100:00100000:0.0:1746065151.158236:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263531648 00002000:00100000:0.0:1746065151.158244:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009077f480 x1830881263531648/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.158249:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f480 with x1830881263531648 ext(1048576->2097151) 00002000:00010000:0.0:1746065151.158252:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f480 00000100:00100000:0.0:1746065151.158260:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3737 00000100:00100000:0.0:1746065151.158265:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263530880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.158366:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263530880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 100us (3691us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065151.158372:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3737 00002000:00100000:0.0:1746065151.158376:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3035136->3039231) req@ffff88009077d180 x1830881263530880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.158383:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d180 with x1830881263530880 ext(3035136->3039231) 00002000:00010000:0.0:1746065151.158385:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077d180 00000100:00100000:0.0:1746065151.158397:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3738 00000100:00100000:0.0:1746065151.158401:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263530624:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.158954:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3739 00000100:00100000:0.0:1746065151.158960:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263531136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065151.160629:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3740 00000100:00100000:3.0:1746065151.160638:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263531264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065151.165557:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3741 00000100:00100000:1.0:1746065151.165578:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263531648:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065151.173432:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263530624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15021us (15413us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065151.173442:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3738 00002000:00100000:1.0:1746065151.173451:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009077ea00 x1830881263530624/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.173461:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ea00 with x1830881263530624 ext(0->1048575) 00002000:00010000:1.0:1746065151.173467:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ea00 00000100:00100000:2.0:1746065151.181657:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263531136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22687us (23602us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065151.181668:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3739 00002000:00100000:2.0:1746065151.181678:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009077d880 x1830881263531136/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.181687:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881263531136 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.181692:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077d880 00000100:00100000:3.0:1746065151.188445:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263531264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27800us (30374us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065151.188455:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3740 00002000:00100000:3.0:1746065151.188465:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009077ca80 x1830881263531264/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.188474:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ca80 with x1830881263531264 ext(1048576->2097151) 00002000:00010000:3.0:1746065151.188479:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ca80 00000100:00100000:1.0:1746065151.193310:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263531648:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27734us (35218us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065151.193319:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3741 00002000:00100000:1.0:1746065151.193328:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009077f480 x1830881263531648/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.193336:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f480 with x1830881263531648 ext(1048576->2097151) 00002000:00010000:1.0:1746065151.193341:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f480 00000100:00100000:0.0:1746065151.203611:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.203709:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263531776 00000100:00100000:2.0:1746065151.203717:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263531776 00000100:00100000:3.0:1746065151.203883:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13198 00000100:00100000:3.0:1746065151.203893:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:32250:x1830881263531776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.203910:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.203924:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93386f expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.203959:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 43 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.203967:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.203968:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.203971:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.203997:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 43 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.204008:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 43 pid: 13375 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.204020:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263339520:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.206039:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.207279:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263339520:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.207303:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.207317:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad800, rc 0) 00000100:00100000:3.0:1746065151.207355:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+20:32250:x1830881263531776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3463us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.207362:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13198 00000100:00100000:0.0:1746065151.208548:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.209298:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263531904 00000100:00100000:1.0:1746065151.209304:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263531904 00002000:00100000:1.0:1746065151.209418:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3022848->3039231) req@ffff88012dc3ed80 x1830881263531904/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 16872/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.209427:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ed80 with x1830881263531904 ext(3022848->3039231) 00010000:00010000:1.0:1746065151.209434:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 44 pid: 13375 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.209446:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 44 pid: 13375 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746065151.209452:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3ed80 00000100:00100000:1.0:1746065151.209850:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1306 00000100:00100000:1.0:1746065151.209856:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881263531904:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065151.212430:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881263531904:12345-192.168.202.27@tcp:4:cat.0 Request processed in 2565us (3877us total) trans 21474840910 rc 0/0 00000100:00100000:1.0:1746065151.212440:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1306 00002000:00100000:1.0:1746065151.212449:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3022848->3039231) req@ffff88012dc3ed80 x1830881263531904/t21474840910(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 16872/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.212464:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ed80 with x1830881263531904 ext(3022848->3039231) 00010000:00010000:1.0:1746065151.212473:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 46 pid: 13375 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.212486:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 46 pid: 13375 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746065151.212492:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3ed80 00000100:00100000:0.0:1746065151.215751:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.215806:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263532160 00000100:00100000:2.0:1746065151.215816:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263532160 00000100:00100000:2.0:1746065151.215993:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13642 00000100:00100000:2.0:1746065151.216001:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+27:32255:x1830881263532160:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065151.216024:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.216040:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146f65f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933876 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.216125:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.216138:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.216147:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065151.216156:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065151.216234:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc146f65f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746065151.216466:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065151.217269:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.217278:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065151.217280:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065151.217282:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00000100:00100000:2.0:1746065151.217336:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+29:32255:x1830881263532160:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1335us (1591us total) trans 8589935974 rc 0/0 00000100:00100000:2.0:1746065151.217346:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13642 00000100:00100000:0.0:1746065151.222404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.222459:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263532288 00000100:00100000:3.0:1746065151.222468:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263532288 00010000:00010000:3.0:1746065151.222498:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 46 pid: 13375 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.222532:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5956 00000100:00100000:3.0:1746065151.222539:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+46:2007:x1830881263532288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.222552:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.222568:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 46 pid: 13375 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.222579:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 46 pid: 13375 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.222596:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc146f620 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93385a expref: 46 pid: 13375 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.222617:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.222619:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.222625:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.222632:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.222659:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.222673:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263339648:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065151.222973:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.229749:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263339648:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065151.229768:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.229830:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881263532288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7290us (7432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.229839:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5956 00000100:00100000:0.0:1746065151.241455:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.241538:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263532416 00000100:00100000:3.0:1746065151.241545:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263532416 00000100:00100000:3.0:1746065151.241597:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13199 00000100:00100000:3.0:1746065151.241604:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+20:32255:x1830881263532416:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065151.241619:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.241633:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93387d expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.241659:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 36 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.241666:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 21 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.241672:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.241673:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.241676:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1642496->1953791] (req 1642496->1953791) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.241705:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 21 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.241714:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 21 pid: 1880 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.241725:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263339776:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.241821:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 36 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.241828:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 36 pid: 1880 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.241835:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263339904:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.241855:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.245615:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263339776:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.245625:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263339904:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.245646:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1642496->1953791] (req 1642496->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.245660:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ada00, rc 0) 00000100:00100000:3.0:1746065151.245698:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:32255:x1830881263532416:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4094us (4250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.245708:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13199 00000100:00100000:0.0:1746065151.246606:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.246701:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.246948:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263532672 00000100:00100000:1.0:1746065151.246956:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263532672 00000100:00100000:3.0:1746065151.246970:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263532544 00000100:00100000:3.0:1746065151.246974:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263532544 00010000:00010000:1.0:1746065151.246986:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 37 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.246988:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 21 pid: 1880 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.247106:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5957 00000100:00100000:3.0:1746065151.247113:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263532544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.247124:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.247300:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 21 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.247310:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 21 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.247328:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc146f619 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933837 expref: 21 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.247344:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.247382:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263532544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 269us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.247387:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5957 00000100:00100000:3.0:1746065151.247399:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5958 00000100:00100000:3.0:1746065151.247404:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263532672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.247410:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.247417:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 37 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.247426:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 37 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.247437:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683b800/0xad6b7ddc146f604 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93381b expref: 37 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.247445:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.247447:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.247453:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.247459:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.247482:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.248574:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263340032:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065151.248649:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.248801:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.248843:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263533056 00000100:00100000:1.0:1746065151.248848:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263533056 00000100:00100000:0.0:1746065151.248873:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:1.0:1746065151.248878:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88012dc3e680 x1830881263533056/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.248887:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3e680 with x1830881263533056 ext(2097152->4194303) 00002000:00010000:1.0:1746065151.248890:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3e680 00000100:00100000:1.0:1746065151.248902:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263533184 00000100:00100000:1.0:1746065151.248904:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263533184 00002000:00100000:1.0:1746065151.248913:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88012dc3ea00 x1830881263533184/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.248920:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ea00 with x1830881263533184 ext(2097152->4194303) 00002000:00010000:1.0:1746065151.248923:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3ea00 00000100:00100000:1.0:1746065151.248943:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3742 00000100:00100000:1.0:1746065151.248949:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263533056:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065151.249023:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3743 00000100:00100000:2.0:1746065151.249031:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263533184:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065151.259112:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.259746:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263533440 00000100:00100000:1.0:1746065151.259754:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263533440 00002000:00100000:1.0:1746065151.259820:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1642496->1646591) req@ffff88012dc3ca80 x1830881263533440/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.259829:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ca80 with x1830881263533440 ext(1642496->1646591) 00002000:00010000:1.0:1746065151.259833:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3ca80 00000100:00100000:1.0:1746065151.259856:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3744 00000100:00100000:1.0:1746065151.259863:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263533440:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065151.259984:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263533440:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 121us (879us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065151.259990:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3744 00002000:00100000:1.0:1746065151.259995:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1642496->1646591) req@ffff88012dc3ca80 x1830881263533440/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.260002:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ca80 with x1830881263533440 ext(1642496->1646591) 00002000:00010000:1.0:1746065151.260005:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3ca80 00000100:00100000:3.0:1746065151.260420:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263340032:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065151.260434:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.260464:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263532672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 13059us (13860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.260472:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5958 00000100:00100000:3.0:1746065151.276256:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263533184:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 27217us (27373us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065151.276265:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3743 00002000:00100000:3.0:1746065151.276275:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88012dc3ea00 x1830881263533184/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.276284:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ea00 with x1830881263533184 ext(2097152->4194303) 00002000:00010000:3.0:1746065151.276288:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3ea00 00000100:00100000:1.0:1746065151.294535:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263533056:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 45574us (45723us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065151.294546:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3742 00002000:00100000:1.0:1746065151.294557:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88012dc3e680 x1830881263533056/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.294565:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3e680 with x1830881263533056 ext(2097152->4194303) 00002000:00010000:1.0:1746065151.294570:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3e680 00000100:00100000:0.0:1746065151.299241:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.299297:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.299745:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263533824 00000100:00100000:3.0:1746065151.299757:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263533824 00000100:00100000:3.0:1746065151.300682:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13200 00000100:00100000:3.0:1746065151.300693:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263533824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.300711:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.300727:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146f67b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933884 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.300795:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263340160:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065151.300879:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.301125:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263533696 00000100:00100000:1.0:1746065151.301136:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263533696 00002000:00100000:1.0:1746065151.301178:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1949696->1953791) req@ffff88009c5f3480 x1830881263533696/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.301187:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3480 with x1830881263533696 ext(1949696->1953791) 00002000:00010000:1.0:1746065151.301192:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3480 00000100:00100000:3.0:1746065151.302343:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3745 00000100:00100000:3.0:1746065151.302357:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263533696:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065151.302493:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263533696:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 141us (3263us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065151.302499:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3745 00002000:00100000:3.0:1746065151.302506:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1949696->1953791) req@ffff88009c5f3480 x1830881263533696/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.302520:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3480 with x1830881263533696 ext(1949696->1953791) 00002000:00010000:3.0:1746065151.302525:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3480 00000100:00100000:0.0:1746065151.305920:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.306037:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263533952 00000100:00100000:2.0:1746065151.306051:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263533952 00000100:00100000:2.0:1746065151.306142:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13201 00000100:00100000:2.0:1746065151.306153:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881263533952:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.306172:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.306190:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93388b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.306212:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.306214:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.306224:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 46 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.306239:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 46 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.306250:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ac00, rc 0) 00000100:00100000:2.0:1746065151.306324:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881263533952:12345-192.168.202.27@tcp:101:cat.0 Request processed in 171us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.306330:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13201 00000100:00100000:2.0:1746065151.317364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.317565:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263534208 00000100:00100000:1.0:1746065151.317572:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263534208 00002000:00100000:1.0:1746065151.317607:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008f3e5500 x1830881263534208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.317615:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881263534208 ext(4194304->5021695) 00002000:00010000:1.0:1746065151.317619:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e5500 00000100:00100000:1.0:1746065151.317642:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3746 00000100:00100000:1.0:1746065151.317648:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263534208:12345-192.168.202.27@tcp:3:cat.0 00002000:00010000:3.0:1746065151.318996:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065150 -> 1746065151 00000100:00100000:3.0:1746065151.319014:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263340160:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065151.319039:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146f67b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933884 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.319049:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac200/0xad6b7ddc146f67b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933884 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.319070:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:3.0:1746065151.320112:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263533824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 19417us (20810us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065151.320121:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13200 00000100:00100000:0.0:1746065151.328989:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.329038:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263534464 00000100:00100000:2.0:1746065151.329045:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263534464 00002000:00100000:2.0:1746065151.329077:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009c5f2d80 x1830881263534464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.329085:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881263534464 ext(0->1048575) 00002000:00010000:2.0:1746065151.329089:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f2d80 00000100:00100000:2.0:1746065151.329114:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3747 00000100:00100000:2.0:1746065151.329120:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2007:x1830881263534464:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065151.329866:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263534208:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12215us (12506us total) trans 0 rc 827392/827392 00000100:00100000:1.0:1746065151.329873:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3746 00002000:00100000:1.0:1746065151.329878:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88008f3e5500 x1830881263534208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.329885:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881263534208 ext(4194304->5021695) 00002000:00010000:1.0:1746065151.329889:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e5500 00000100:00100000:2.0:1746065151.338458:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2007:x1830881263534464:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9330us (9468us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065151.338467:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3747 00002000:00100000:2.0:1746065151.338475:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009c5f2d80 x1830881263534464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.338483:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881263534464 ext(0->1048575) 00002000:00010000:2.0:1746065151.338488:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f2d80 00000100:00100000:0.0:1746065151.355541:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.355807:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263534592 00000100:00100000:3.0:1746065151.355814:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263534592 00000100:00100000:3.0:1746065151.355859:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13202 00000100:00100000:3.0:1746065151.355866:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:32260:x1830881263534592:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.355881:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.355895:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933892 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.355918:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.355938:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.355939:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.355942:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 37 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.355965:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.355975:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 19 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.355986:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263340288:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.356061:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.360032:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263340288:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.360060:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 37 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.360075:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad400, rc 0) 00000100:00100000:3.0:1746065151.360363:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+37:32260:x1830881263534592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4494us (4827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.360371:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13202 00000100:00100000:0.0:1746065151.363070:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.364096:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263534720 00000100:00100000:2.0:1746065151.364109:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263534720 00002000:00100000:2.0:1746065151.364160:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1642496->1953791) req@ffff88009c5f3100 x1830881263534720/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.364171:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3100 with x1830881263534720 ext(1642496->1953791) 00010000:00010000:2.0:1746065151.364181:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 20 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.364195:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 20 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.364202:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f3100 00000100:00100000:2.0:1746065151.364245:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1307 00000100:00100000:2.0:1746065151.364252:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263534720:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065151.382153:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263534720:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17892us (19081us total) trans 17179873460 rc 0/0 00000100:00100000:2.0:1746065151.382163:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1307 00002000:00100000:2.0:1746065151.382172:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1642496->1953791) req@ffff88009c5f3100 x1830881263534720/t17179873460(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.382181:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3100 with x1830881263534720 ext(1642496->1953791) 00010000:00010000:2.0:1746065151.382189:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 22 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.382202:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 22 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.382208:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f3100 00000100:00100000:2.0:1746065151.387453:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.387525:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263534848 00000100:00100000:3.0:1746065151.387533:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263534848 00010000:00010000:3.0:1746065151.387563:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 22 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.387602:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5959 00000100:00100000:3.0:1746065151.387609:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263534848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.387621:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.387639:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 22 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.387648:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 22 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.387666:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc146f674 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->1953791) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93387d expref: 22 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.387692:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.387694:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.387700:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 36 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.387707:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 36 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.387736:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 36 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.387746:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263340416:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065151.387839:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.389425:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263340416:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065151.389441:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.390359:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263534848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2746us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.390367:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5959 00000100:00100000:0.0:1746065151.397700:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.397740:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.397816:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.397851:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263535360 00000100:00100000:0.0:1746065151.397857:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263535360 00002000:00100000:0.0:1746065151.397894:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009c5f0e00 x1830881263535360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.397902:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0e00 with x1830881263535360 ext(1048576->2097151) 00002000:00010000:0.0:1746065151.397907:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f0e00 00000100:00100000:0.0:1746065151.397935:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263535232 00000100:00100000:0.0:1746065151.397937:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263535232 00002000:00100000:0.0:1746065151.397949:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009c5f2680 x1830881263535232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.397954:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2680 with x1830881263535232 ext(1048576->2097151) 00002000:00010000:0.0:1746065151.397957:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f2680 00000100:00100000:0.0:1746065151.397969:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3748 00000100:00100000:0.0:1746065151.397975:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263535360:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065151.398694:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.399375:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263535744 00000100:00100000:0.0:1746065151.399380:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263535744 00002000:00100000:0.0:1746065151.399403:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c5f0700 x1830881263535744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.399410:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0700 with x1830881263535744 ext(1048576->2097151) 00002000:00010000:0.0:1746065151.399414:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0700 00000100:00100000:0.0:1746065151.399427:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3749 00000100:00100000:0.0:1746065151.399434:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263535232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065151.399675:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3750 00000100:00100000:2.0:1746065151.399681:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881263535744:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065151.400816:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263534976 00000100:00100000:3.0:1746065151.400821:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263534976 00000100:00100000:3.0:1746065151.400845:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13203 00000100:00100000:3.0:1746065151.400850:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+41:32259:x1830881263534976:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065151.400858:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.400872:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933899 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.400891:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 42 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.400899:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.400905:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.400906:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.400909:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 42 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.400939:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.400950:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 20 pid: 11461 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.400960:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263340544:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.401019:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 42 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.401026:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 42 pid: 3067 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.401033:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263340672:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.401048:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.407627:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263340544:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.407639:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263340672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.407663:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 42 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.407678:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad000, rc 0) 00000100:00100000:3.0:1746065151.407715:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+42:32259:x1830881263534976:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6863us (10021us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.407723:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13203 00000100:00100000:0.0:1746065151.412241:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.414121:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263535872 00000100:00100000:3.0:1746065151.414131:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263535872 00010000:00010000:3.0:1746065151.414166:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 21 pid: 11461 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.414194:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5960 00000100:00100000:3.0:1746065151.414201:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263535872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.414212:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.414228:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 21 pid: 11461 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.414238:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 21 pid: 11461 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.414256:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a1e200/0xad6b7ddc146f62e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93383e expref: 21 pid: 11461 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.414470:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.414510:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263535872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 309us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.414517:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5960 00000100:00100000:0.0:1746065151.414829:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263535360:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 16853us (17088us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065151.414836:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3748 00002000:00100000:0.0:1746065151.414844:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009c5f0e00 x1830881263535360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.414853:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0e00 with x1830881263535360 ext(1048576->2097151) 00010000:00010000:0.0:1746065151.414859:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 40 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.414873:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 40 pid: 3067 timeout: 847 lvb_type: 1 00002000:00010000:0.0:1746065151.414878:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f0e00 00000100:00100000:2.0:1746065151.420071:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881263535744:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 20377us (21365us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065151.420081:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3750 00002000:00100000:2.0:1746065151.420091:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009c5f0700 x1830881263535744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.420099:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0700 with x1830881263535744 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.420105:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0700 00000100:00100000:0.0:1746065151.423529:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.423806:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263536000 00000100:00100000:3.0:1746065151.423813:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263536000 00010000:00010000:3.0:1746065151.423843:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 40 pid: 3067 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.423871:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5961 00000100:00100000:3.0:1746065151.423877:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263536000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.423888:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.423904:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 40 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.423919:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 40 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.423950:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146f5da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337f1 expref: 40 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.423979:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.423982:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.423987:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.423994:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.424021:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.424031:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263340800:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065151.424107:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.425090:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263535232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 25655us (27272us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065151.425099:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3749 00002000:00100000:2.0:1746065151.425106:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009c5f2680 x1830881263535232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.425114:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2680 with x1830881263535232 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.425117:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f2680 00000100:00100000:3.0:1746065151.428522:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263340800:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065151.428541:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.428588:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263536000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4709us (5064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.428597:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5961 00000100:00100000:0.0:1746065151.430581:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.430869:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263536256 00000100:00100000:2.0:1746065151.430879:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263536256 00002000:00100000:2.0:1746065151.430963:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (2002944->2007039) req@ffff88009c5f0a80 x1830881263536256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.430980:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0a80 with x1830881263536256 ext(2002944->2007039) 00002000:00010000:2.0:1746065151.431049:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f0a80 00000100:00100000:2.0:1746065151.431069:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3751 00000100:00100000:2.0:1746065151.431076:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263536256:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065151.431198:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263536256:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 121us (621us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065151.431204:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3751 00002000:00100000:2.0:1746065151.431209:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (2002944->2007039) req@ffff88009c5f0a80 x1830881263536256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.431215:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0a80 with x1830881263536256 ext(2002944->2007039) 00002000:00010000:2.0:1746065151.431218:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f0a80 00000100:00100000:0.0:1746065151.435445:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.440093:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263536512 00000100:00100000:2.0:1746065151.440104:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263536512 00002000:00100000:2.0:1746065151.440145:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009c5f0380 x1830881263536512/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 504/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.440154:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881263536512 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.440159:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f0380 00000100:00100000:2.0:1746065151.440180:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3752 00000100:00100000:2.0:1746065151.440187:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263536512:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065151.448633:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263536512:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8438us (13187us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746065151.448642:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3752 00002000:00100000:2.0:1746065151.448653:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009c5f0380 x1830881263536512/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 504/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.448662:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881263536512 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.448667:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f0380 00000100:00100000:0.0:1746065151.453291:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.457609:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263536640 00000100:00100000:3.0:1746065151.457622:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263536640 00000100:00100000:3.0:1746065151.457692:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13204 00000100:00100000:3.0:1746065151.457700:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+46:32259:x1830881263536640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065151.457717:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.457732:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338a0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.457756:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 47 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.457763:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.457769:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.457770:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.457810:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1646591] (req 1048576->1646591) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.457837:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.457846:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 19 pid: 11461 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.457857:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263340928:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.457970:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 47 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.457981:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 47 pid: 1880 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.457988:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263341056:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.460082:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.464181:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263340928:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065151.467182:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.469215:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263537280 00000100:00100000:2.0:1746065151.469226:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263537280 00002000:00100000:2.0:1746065151.469266:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009c5f1880 x1830881263537280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.469274:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1880 with x1830881263537280 ext(2097152->4194303) 00002000:00010000:2.0:1746065151.469280:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f1880 00000100:00100000:2.0:1746065151.469309:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3753 00000100:00100000:2.0:1746065151.469316:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881263537280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065151.470371:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.471133:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.471260:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263537152 00000100:00100000:1.0:1746065151.471266:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263537152 00002000:00100000:1.0:1746065151.471295:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008f3e7800 x1830881263537152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.471309:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881263537152 ext(2097152->4194303) 00002000:00010000:1.0:1746065151.471313:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e7800 00000100:00100000:1.0:1746065151.471329:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3754 00000100:00100000:1.0:1746065151.471336:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263537152:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065151.482310:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263341056:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.482340:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->1646591] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.482353:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856800, rc 0) 00000100:00100000:2.0:1746065151.482402:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+49:32259:x1830881263536640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 24702us (29117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.482409:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13204 00000100:00100000:3.0:1746065151.483654:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263536768 00000100:00100000:3.0:1746065151.483660:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263536768 00010000:00010000:3.0:1746065151.483683:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 20 pid: 11461 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.483704:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5962 00000100:00100000:3.0:1746065151.483710:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263536768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.483719:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.483732:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 20 pid: 11461 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.483741:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 20 pid: 11461 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.483758:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146f635 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933845 expref: 20 pid: 11461 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.483770:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.483902:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263536768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 191us (12769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.483908:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5962 00000100:00100000:0.0:1746065151.484693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.484829:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263537408 00000100:00100000:3.0:1746065151.484833:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263537408 00010000:00010000:3.0:1746065151.484849:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 49 pid: 1880 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.484865:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5963 00000100:00100000:3.0:1746065151.484869:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263537408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.484874:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.484884:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 49 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.484891:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 49 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.484902:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc146f60b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933822 expref: 49 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.484913:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.484915:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.484920:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.484938:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.484967:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.484976:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263341184:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065151.486501:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.500378:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263341184:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065151.500398:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.500460:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263537408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15588us (15767us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.500469:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5963 00000100:00100000:1.0:1746065151.500875:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.501503:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881263537280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32186us (34325us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065151.501510:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3753 00002000:00100000:3.0:1746065151.501518:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009c5f1880 x1830881263537280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.501527:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1880 with x1830881263537280 ext(2097152->4194303) 00002000:00010000:3.0:1746065151.501531:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f1880 00000100:00100000:3.0:1746065151.501544:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263537664 00000100:00100000:3.0:1746065151.501549:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263537664 00002000:00100000:3.0:1746065151.501569:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1642496->1646591) req@ffff880091a92300 x1830881263537664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.501575:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92300 with x1830881263537664 ext(1642496->1646591) 00002000:00010000:3.0:1746065151.501577:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a92300 00000100:00100000:3.0:1746065151.501589:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3755 00000100:00100000:3.0:1746065151.501595:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881263537664:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065151.501670:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881263537664:12345-192.168.202.27@tcp:3:cat.0 Request processed in 74us (796us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065151.501675:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3755 00002000:00100000:3.0:1746065151.501679:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1642496->1646591) req@ffff880091a92300 x1830881263537664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.501684:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92300 with x1830881263537664 ext(1642496->1646591) 00002000:00010000:3.0:1746065151.501686:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a92300 00000100:00100000:2.0:1746065151.513993:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263537152:12345-192.168.202.27@tcp:3:cat.0 Request processed in 42649us (43616us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065151.514004:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3754 00002000:00100000:2.0:1746065151.514014:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88008f3e7800 x1830881263537152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.514023:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881263537152 ext(2097152->4194303) 00002000:00010000:2.0:1746065151.514028:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e7800 00000100:00100000:0.0:1746065151.526012:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.526111:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263537920 00000100:00100000:2.0:1746065151.526120:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263537920 00002000:00100000:2.0:1746065151.526155:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5017599) req@ffff88009c5f3800 x1830881263537920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.526163:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3800 with x1830881263537920 ext(4194304->5017599) 00002000:00010000:2.0:1746065151.526168:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f3800 00000100:00100000:2.0:1746065151.526199:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3756 00000100:00100000:2.0:1746065151.526206:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881263537920:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065151.543884:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881263537920:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17670us (17872us total) trans 0 rc 823296/823296 00000100:00100000:2.0:1746065151.543894:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3756 00002000:00100000:2.0:1746065151.543903:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5017599) req@ffff88009c5f3800 x1830881263537920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.543911:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3800 with x1830881263537920 ext(4194304->5017599) 00002000:00010000:2.0:1746065151.543916:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f3800 00000100:00100000:0.0:1746065151.576901:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.577013:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263538048 00000100:00100000:2.0:1746065151.577021:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263538048 00000100:00100000:2.0:1746065151.577066:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13205 00000100:00100000:2.0:1746065151.577073:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:32265:x1830881263538048:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065151.577088:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.577101:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338a7 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.577125:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 45 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.577761:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065151.577764:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065151.577768:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1257472->1708031] (req 1257472->1708031) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.577825:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 45 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.577836:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 45 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.577852:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263341312:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.577954:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.579371:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263341312:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.579390:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1257472->1708031] (req 1257472->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.579407:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835de00, rc 0) 00000100:00100000:2.0:1746065151.579443:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+20:32265:x1830881263538048:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2370us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.579450:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13205 00000100:00100000:0.0:1746065151.581125:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.581293:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263538176 00000100:00100000:2.0:1746065151.581299:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263538176 00002000:00100000:2.0:1746065151.581334:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1646591) req@ffff88008c52b800 x1830881263538176/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.581342:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52b800 with x1830881263538176 ext(1048576->1646591) 00010000:00010000:2.0:1746065151.581350:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 46 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.581361:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 46 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.581366:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c52b800 00000100:00100000:2.0:1746065151.581679:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1308 00000100:00100000:2.0:1746065151.581686:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881263538176:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065151.583235:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.583646:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263538304 00000100:00100000:2.0:1746065151.583652:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263538304 00000100:00100000:2.0:1746065151.583684:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13206 00000100:00100000:2.0:1746065151.583690:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263538304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.583702:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.583715:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338ae expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.583733:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.583735:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.583742:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.583754:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.583763:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ce00, rc 0) 00000100:00100000:2.0:1746065151.583828:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263538304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 137us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.583834:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13206 00000100:00100000:0.0:1746065151.587212:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.587562:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.587596:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263538432 00000100:00100000:0.0:1746065151.587603:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263538432 00000100:00100000:0.0:1746065151.587631:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263538560 00000100:00100000:0.0:1746065151.587633:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263538560 00000100:00100000:0.0:1746065151.587646:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13207 00000100:00100000:0.0:1746065151.587652:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263538432:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065151.587668:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.587681:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9c600/0xad6b7ddc146f6ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338b5 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.587729:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263341440:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065151.587814:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.587842:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13208 00000100:00100000:0.0:1746065151.587848:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263538560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065151.587855:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.587863:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f6b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338bc expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.587882:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263341568:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065151.587901:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.590644:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881263538176:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8950us (9517us total) trans 21474840911 rc 0/0 00000100:00100000:3.0:1746065151.590654:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1308 00002000:00100000:3.0:1746065151.590664:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1646591) req@ffff88008c52b800 x1830881263538176/t21474840911(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.590671:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52b800 with x1830881263538176 ext(1048576->1646591) 00010000:00010000:3.0:1746065151.590679:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.590691:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746065151.590697:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c52b800 00002000:00010000:1.0:1746065151.591908:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime: 1746065150 -> 1746065151 00002000:00010000:1.0:1746065151.591912:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime: 1746065149 -> 1746065151 00002000:00010000:1.0:1746065151.591914:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime: 1746065150 -> 1746065151 00000100:00100000:1.0:1746065151.591935:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263341440:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065151.591959:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c600/0xad6b7ddc146f6ac lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338b5 expref: 22 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.591970:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c600/0xad6b7ddc146f6ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338b5 expref: 22 pid: 9549 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746065151.592443:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065150 -> 1746065151 00000100:00100000:0.0:1746065151.592454:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263341568:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065151.592468:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f6b3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338bc expref: 21 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.592477:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f6b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338bc expref: 21 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.592490:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9ce00, rc 0) 00000100:00100000:0.0:1746065151.592516:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263538560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4668us (4954us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065151.592523:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13208 00010000:00010000:1.0:1746065151.592645:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c600, rc 0) 00000100:00100000:1.0:1746065151.592668:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263538432:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5016us (5463us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065151.592673:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13207 00000100:00100000:3.0:1746065151.598578:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.598631:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263538944 00000100:00100000:0.0:1746065151.598640:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263538944 00002000:00100000:0.0:1746065151.598674:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009acefb80 x1830881263538944/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.598683:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acefb80 with x1830881263538944 ext(1048576->2097151) 00002000:00010000:0.0:1746065151.598687:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acefb80 00000100:00100000:0.0:1746065151.598715:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3757 00000100:00100000:0.0:1746065151.598722:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263538944:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.612612:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.613355:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263538688 00000100:00100000:0.0:1746065151.613364:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263538688 00010000:00010000:0.0:1746065151.613393:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746065151.613415:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5964 00000100:00100000:0.0:1746065151.613421:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881263538688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.613432:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.613447:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.613458:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.613476:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856800/0xad6b7ddc146f697 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1646591) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a0 expref: 48 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.613492:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.613493:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.613501:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.613508:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.613535:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.613545:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263341696:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065151.620576:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263538944:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21846us (21998us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065151.620586:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3757 00002000:00100000:0.0:1746065151.620596:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009acefb80 x1830881263538944/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.620605:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acefb80 with x1830881263538944 ext(1048576->2097151) 00002000:00010000:0.0:1746065151.620610:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acefb80 00000100:00100000:0.0:1746065151.624201:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.624236:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263341696:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065151.624256:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.624303:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881263538688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10880us (11696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.624313:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5964 00000100:00100000:2.0:1746065151.624423:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.624525:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263539200 00000100:00100000:0.0:1746065151.624530:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263539200 00002000:00100000:0.0:1746065151.624559:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1257472->1261567) req@ffff88008f3e4000 x1830881263539200/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.624569:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4000 with x1830881263539200 ext(1257472->1261567) 00002000:00010000:0.0:1746065151.624572:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4000 00000100:00100000:0.0:1746065151.624598:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3758 00000100:00100000:0.0:1746065151.624604:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263539200:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.624696:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263539200:12345-192.168.202.27@tcp:3:cat.0 Request processed in 92us (274us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065151.624701:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3758 00002000:00100000:0.0:1746065151.624706:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1257472->1261567) req@ffff88008f3e4000 x1830881263539200/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.624712:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4000 with x1830881263539200 ext(1257472->1261567) 00002000:00010000:0.0:1746065151.624715:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4000 00000100:00100000:0.0:1746065151.634107:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.634197:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263539456 00000100:00100000:1.0:1746065151.634204:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263539456 00000100:00100000:1.0:1746065151.634239:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13209 00000100:00100000:1.0:1746065151.634245:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:32269:x1830881263539456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.634259:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.634274:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338c3 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.634297:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 36 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.634302:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065151.634304:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065151.634307:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.634329:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 36 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.634339:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 36 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.634348:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263341824:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.634424:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.635196:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.635269:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263539584 00000100:00100000:2.0:1746065151.635273:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263539584 00002000:00100000:2.0:1746065151.635295:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1703936->1708031) req@ffff88008c528380 x1830881263539584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.635304:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528380 with x1830881263539584 ext(1703936->1708031) 00002000:00010000:2.0:1746065151.635307:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528380 00000100:00100000:2.0:1746065151.635578:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3759 00000100:00100000:2.0:1746065151.635585:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263539584:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065151.635698:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263539584:12345-192.168.202.27@tcp:3:cat.0 Request processed in 112us (501us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065151.635704:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3759 00002000:00100000:2.0:1746065151.635710:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1703936->1708031) req@ffff88008c528380 x1830881263539584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.635716:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528380 with x1830881263539584 ext(1703936->1708031) 00002000:00010000:2.0:1746065151.635719:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528380 00000100:00100000:0.0:1746065151.647601:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.647816:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263539712 00000100:00100000:2.0:1746065151.647824:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263539712 00002000:00100000:2.0:1746065151.647860:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (2002944->2097151) req@ffff88008c529180 x1830881263539712/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.647869:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529180 with x1830881263539712 ext(2002944->2097151) 00010000:00010000:2.0:1746065151.647877:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 37 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.647890:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 37 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.647896:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c529180 00000100:00100000:2.0:1746065151.647931:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1309 00000100:00100000:2.0:1746065151.647939:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263539712:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065151.648123:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263341824:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.648143:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.648154:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd600, rc 0) 00000100:00100000:1.0:1746065151.648174:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:32269:x1830881263539456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 13929us (14075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.648181:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13209 00000100:00100000:2.0:1746065151.655438:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263539712:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7491us (7835us total) trans 17179873461 rc 0/0 00000100:00100000:2.0:1746065151.655452:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1309 00002000:00100000:2.0:1746065151.655461:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (2002944->2097151) req@ffff88008c529180 x1830881263539712/t17179873461(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.655471:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529180 with x1830881263539712 ext(2002944->2097151) 00010000:00010000:2.0:1746065151.655480:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.655494:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.655500:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c529180 00000100:00100000:0.0:1746065151.662595:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.665311:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263539840 00000100:00100000:2.0:1746065151.665323:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263539840 00010000:00010000:2.0:1746065151.665357:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.665383:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5965 00000100:00100000:2.0:1746065151.665389:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263539840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.665401:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.665417:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.665426:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.665450:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc146f690 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933899 expref: 39 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.665477:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.665478:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.665484:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.665490:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.665519:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.665530:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263341952:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065151.667082:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.673374:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.673458:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263341952:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065151.673475:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.673513:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263539840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8123us (10925us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.673522:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5965 00000100:00100000:3.0:1746065151.673764:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263540096 00000100:00100000:3.0:1746065151.673770:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263540096 00002000:00100000:3.0:1746065151.673815:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800983ba680 x1830881263540096/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.673824:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983ba680 with x1830881263540096 ext(1048576->2097151) 00002000:00010000:3.0:1746065151.673828:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983ba680 00000100:00100000:3.0:1746065151.674108:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3760 00000100:00100000:3.0:1746065151.674116:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263540096:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.681727:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.682067:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263540352 00000100:00100000:2.0:1746065151.682076:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263540352 00002000:00100000:2.0:1746065151.682109:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88008c529880 x1830881263540352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 504/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.682118:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529880 with x1830881263540352 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.682122:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c529880 00000100:00100000:2.0:1746065151.682198:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3761 00000100:00100000:2.0:1746065151.682205:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263540352:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.695089:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.695641:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263540352:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13434us (13918us total) trans 0 rc 598016/598016 00000100:00100000:2.0:1746065151.695650:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3761 00002000:00100000:2.0:1746065151.695660:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88008c529880 x1830881263540352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 504/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 598016/598016 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.695669:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529880 with x1830881263540352 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.695674:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c529880 00000100:00100000:1.0:1746065151.695864:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263540480 00000100:00100000:1.0:1746065151.695870:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263540480 00000100:00100000:1.0:1746065151.695899:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13210 00000100:00100000:1.0:1746065151.695905:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+47:32272:x1830881263540480:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065151.695918:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.695946:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338ca expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.695967:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 48 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.695974:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 19 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.695980:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.695981:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.695984:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [819200->1048575] (req 819200->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.696005:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 19 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.696015:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 19 pid: 1880 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.696025:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342080:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.696093:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 48 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.696105:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 48 pid: 3067 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.696113:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342208:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065151.696131:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.696480:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263540096:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22364us (23113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065151.696487:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3760 00002000:00100000:3.0:1746065151.696492:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800983ba680 x1830881263540096/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.696499:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983ba680 with x1830881263540096 ext(1048576->2097151) 00002000:00010000:3.0:1746065151.696503:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800983ba680 00000100:00100000:0.0:1746065151.706394:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.706436:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.706460:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263540608 00000100:00100000:0.0:1746065151.706467:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263540608 00010000:00010000:0.0:1746065151.706500:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 20 pid: 1880 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746065151.706520:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263540736 00000100:00100000:0.0:1746065151.706522:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263540736 00010000:00010000:0.0:1746065151.706530:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 49 pid: 3067 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746065151.706544:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5966 00000100:00100000:0.0:1746065151.706551:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263540608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.706562:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.706578:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 20 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.706588:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 20 pid: 1880 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.706610:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.706643:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263540608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.706649:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5966 00000100:00100000:0.0:1746065151.706663:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5967 00000100:00100000:0.0:1746065151.706668:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881263540736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.706674:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065151.706680:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 49 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.706688:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 49 pid: 3067 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746065151.706698:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.706700:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.706706:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.706712:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.706737:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.706748:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263342336:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065151.706834:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065151.707078:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc146f612 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933830 expref: 19 pid: 1880 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.707103:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342080:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.707113:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a1e800/0xad6b7ddc146f5d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9337e3 expref: 49 pid: 3067 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746065151.707120:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342208:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065151.707141:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.707148:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130113600, rc 0) 00000100:00100000:1.0:1746065151.707171:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+48:32272:x1830881263540480:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11266us (12091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.707178:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13210 00000100:00100000:0.0:1746065151.710762:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.711122:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263342336:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065151.711141:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.711181:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881263540736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4511us (4744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.711193:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5967 00000100:00100000:3.0:1746065151.711432:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263540992 00000100:00100000:3.0:1746065151.711438:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263540992 00002000:00100000:3.0:1746065151.711469:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (819200->823295) req@ffff880097f53800 x1830881263540992/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.711477:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53800 with x1830881263540992 ext(819200->823295) 00002000:00010000:3.0:1746065151.711481:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53800 00000100:00100000:3.0:1746065151.711507:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3762 00000100:00100000:3.0:1746065151.711513:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881263540992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065151.711625:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881263540992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 111us (870us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065151.711630:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3762 00002000:00100000:3.0:1746065151.711635:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (819200->823295) req@ffff880097f53800 x1830881263540992/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.711641:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53800 with x1830881263540992 ext(819200->823295) 00002000:00010000:3.0:1746065151.711643:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53800 00000100:00100000:0.0:1746065151.714026:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.714082:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263541120 00000100:00100000:1.0:1746065151.714089:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263541120 00000100:00100000:1.0:1746065151.714135:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13211 00000100:00100000:1.0:1746065151.714143:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263541120:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.714158:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.714172:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2b8400/0xad6b7ddc146f6c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338d1 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.714215:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342464:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065151.714288:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.715524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065151.715596:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065148 -> 1746065151 00002000:00010000:1.0:1746065151.715599:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065148 -> 1746065151 00002000:00010000:1.0:1746065151.715601:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065148 -> 1746065151 00000100:00100000:1.0:1746065151.715613:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342464:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065151.715633:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2b8400/0xad6b7ddc146f6c8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338d1 expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.715643:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2b8400/0xad6b7ddc146f6c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338d1 expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.715665:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8400, rc 0) 00000100:00100000:1.0:1746065151.715692:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263541120:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1550us (1671us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065151.715698:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13211 00000100:00100000:2.0:1746065151.715759:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263541376 00000100:00100000:2.0:1746065151.715763:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263541376 00002000:00100000:2.0:1746065151.715813:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (1044480->1048575) req@ffff880097f50000 x1830881263541376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.715821:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50000 with x1830881263541376 ext(1044480->1048575) 00002000:00010000:2.0:1746065151.715824:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f50000 00000100:00100000:2.0:1746065151.715837:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3763 00000100:00100000:2.0:1746065151.715842:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881263541376:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065151.716028:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881263541376:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 186us (507us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065151.716034:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3763 00002000:00100000:2.0:1746065151.716039:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (1044480->1048575) req@ffff880097f50000 x1830881263541376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.716046:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50000 with x1830881263541376 ext(1044480->1048575) 00002000:00010000:2.0:1746065151.716048:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f50000 00000100:00100000:0.0:1746065151.719522:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.719806:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263541504 00000100:00100000:1.0:1746065151.719813:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263541504 00000100:00100000:1.0:1746065151.719850:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13212 00000100:00100000:1.0:1746065151.719857:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263541504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.719872:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.719886:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f6cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338d8 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.719941:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342592:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065151.720018:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.723915:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342592:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065151.723954:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f6cf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338d8 expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.723966:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f6cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338d8 expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.723985:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112600, rc 0) 00000100:00100000:1.0:1746065151.724018:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263541504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4162us (4503us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065151.724026:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13212 00000100:00100000:0.0:1746065151.729468:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.729631:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263541632 00000100:00100000:1.0:1746065151.729638:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263541632 00000100:00100000:1.0:1746065151.729671:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13213 00000100:00100000:1.0:1746065151.729678:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2007:x1830881263541632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.729692:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.729705:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130112800/0xad6b7ddc146f6d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338df expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.729751:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342720:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065151.730506:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.732332:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263342720:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065151.732357:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130112800/0xad6b7ddc146f6d6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338df expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.732368:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130112800/0xad6b7ddc146f6d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338df expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.732634:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112800, rc 0) 00000100:00100000:1.0:1746065151.732885:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2007:x1830881263541632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3204us (3421us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065151.732893:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13213 00000100:00100000:0.0:1746065151.780525:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.780574:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.780659:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263541760 00000100:00100000:1.0:1746065151.780667:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263541760 00000100:00100000:2.0:1746065151.780889:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263541888 00000100:00100000:2.0:1746065151.780892:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263541888 00000100:00100000:2.0:1746065151.780913:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13214 00000100:00100000:2.0:1746065151.780920:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881263541760:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.780945:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.780959:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338e6 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.780979:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.780981:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.780988:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 39 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.781001:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 39 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.781009:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:2.0:1746065151.781048:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263541760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 128us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.781053:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13214 00000100:00100000:2.0:1746065151.781069:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13215 00000100:00100000:2.0:1746065151.781074:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881263541888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.781080:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.781088:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc146f6e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338ed expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.781119:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263342848:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065151.781161:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.786859:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263342848:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065151.786895:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc146f6e4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ed expref: 48 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.786909:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc146f6e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ed expref: 48 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.787008:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:2.0:1746065151.787649:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881263541888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6569us (7069us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065151.787658:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13215 00000100:00100000:0.0:1746065151.799051:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.799099:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.799602:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263542144 00000100:00100000:1.0:1746065151.799610:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263542144 00002000:00100000:1.0:1746065151.799646:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->819199) req@ffff880097f53b80 x1830881263542144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.799654:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53b80 with x1830881263542144 ext(0->819199) 00002000:00010000:1.0:1746065151.799658:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53b80 00000100:00100000:1.0:1746065151.799671:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263542400 00000100:00100000:1.0:1746065151.799674:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263542400 00002000:00100000:1.0:1746065151.799684:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097f52d80 x1830881263542400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.799690:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52d80 with x1830881263542400 ext(1048576->2097151) 00002000:00010000:1.0:1746065151.799693:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f52d80 00000100:00100000:1.0:1746065151.799713:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3764 00000100:00100000:1.0:1746065151.799718:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881263542144:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065151.800256:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3765 00000100:00100000:2.0:1746065151.800263:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263542400:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065151.805659:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881263542144:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5931us (6606us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065151.805668:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3764 00002000:00100000:1.0:1746065151.805679:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->819199) req@ffff880097f53b80 x1830881263542144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.805688:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53b80 with x1830881263542144 ext(0->819199) 00002000:00010000:1.0:1746065151.805694:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53b80 00000100:00100000:2.0:1746065151.823086:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263542400:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22554us (23718us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065151.823099:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3765 00002000:00100000:2.0:1746065151.823109:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097f52d80 x1830881263542400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.823118:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52d80 with x1830881263542400 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.823123:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f52d80 00000100:00100000:0.0:1746065151.839766:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.839880:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263542528 00000100:00100000:2.0:1746065151.839888:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263542528 00000100:00100000:2.0:1746065151.839966:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13216 00000100:00100000:2.0:1746065151.839974:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+47:32280:x1830881263542528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.840144:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.840161:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338f4 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.840185:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.840192:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065151.840194:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065151.840197:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 48 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.840221:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.840230:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 18 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.840239:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263342976:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.840945:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.848557:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.849254:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263342976:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.849282:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 48 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.849304:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06800, rc 0) 00000100:00100000:2.0:1746065151.850092:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+48:32280:x1830881263542528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10116us (10331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.850101:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13216 00000100:00100000:3.0:1746065151.850657:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263542784 00000100:00100000:3.0:1746065151.850664:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263542784 00000100:00100000:3.0:1746065151.850705:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13217 00000100:00100000:3.0:1746065151.850712:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+19:32277:x1830881263542784:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065151.850727:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.850741:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9338fb expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.851561:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.851569:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 47 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.851574:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.851575:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.851578:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->2228223] (req 2097152->2228223) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 20 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.851604:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 47 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065151.851613:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 47 pid: 13375 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.851625:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263343104:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.851696:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.851704:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 20 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.851711:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263343232:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.851729:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.851811:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.851912:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263542912 00000100:00100000:2.0:1746065151.851916:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263542912 00002000:00100000:2.0:1746065151.851951:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1257472->2097151) req@ffff880091a92a00 x1830881263542912/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.851959:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92a00 with x1830881263542912 ext(1257472->2097151) 00010000:00010000:2.0:1746065151.851965:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 21 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.851973:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 21 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746065151.851979:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a92a00 00000100:00100000:2.0:1746065151.851991:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1310 00000100:00100000:2.0:1746065151.851996:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263542912:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065151.858098:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263343104:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.858110:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263343232:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.858136:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->2228223] (req 2097152->2228223) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 22 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.858150:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3c00, rc 0) 00000100:00100000:3.0:1746065151.858198:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+22:32277:x1830881263542784:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7485us (9647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.858208:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13217 00000100:00100000:2.0:1746065151.858268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.858319:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263543040 00000100:00100000:3.0:1746065151.858324:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263543040 00010000:00010000:3.0:1746065151.858345:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 48 pid: 13375 timeout: 847 lvb_type: 1 00000100:00100000:3.0:1746065151.858409:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5968 00000100:00100000:3.0:1746065151.858414:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881263543040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065151.858422:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065151.858433:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 48 pid: 13375 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.858439:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 48 pid: 13375 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.858453:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f682 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93388b expref: 48 pid: 13375 timeout: 847 lvb_type: 1 00010000:00010000:3.0:1746065151.858462:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065151.858484:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881263543040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.858489:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5968 00000100:00100000:0.0:1746065151.863335:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.863355:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.863373:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.863829:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263543168 00000100:00100000:0.0:1746065151.863836:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263543168 00000100:00100000:0.0:1746065151.863865:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263543296 00000100:00100000:0.0:1746065151.863867:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263543296 00000100:00100000:1.0:1746065151.863871:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263543424 00000100:00100000:1.0:1746065151.863875:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263543424 00000100:00100000:0.0:1746065151.864635:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13218 00000100:00100000:0.0:1746065151.864656:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881263543168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065151.864671:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.864684:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc146f6f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933902 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.864729:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263343360:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065151.864763:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13219 00000100:00100000:0.0:1746065151.864810:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.864883:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263543296:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065151.864891:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065151.864899:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f700 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933909 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.864937:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263343488:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065151.864964:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.865044:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.865063:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263543552 00000100:00100000:0.0:1746065151.865066:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263543552 00000100:00100000:2.0:1746065151.865078:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13220 00010000:00010000:0.0:1746065151.865079:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 29 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.865084:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263543424:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.865091:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065151.865100:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5969 00000100:00100000:0.0:1746065151.865104:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+29:2007:x1830881263543552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.865108:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07400/0xad6b7ddc146f707 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933910 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.865111:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.865119:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.865124:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 30 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.865127:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07400/0xad6b7ddc146f707 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933910 expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.865136:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07400/0xad6b7ddc146f707 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933910 expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.865136:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 30 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.865146:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07400, rc 0) 00010000:00010000:0.0:1746065151.865150:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0xad6b7ddc146f658 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93386f expref: 29 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.865166:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.865167:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.865173:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.865180:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.865182:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263543424:12345-192.168.202.27@tcp:101:cat.0 Request processed in 98us (1807us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065151.865188:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13220 00010000:00010000:0.0:1746065151.865198:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.865205:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263343616:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065151.865224:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.866971:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263542912:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 14968us (15154us total) trans 21474840912 rc 0/0 00000100:00100000:3.0:1746065151.866982:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1310 00002000:00100000:3.0:1746065151.866991:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1257472->2097151) req@ffff880091a92a00 x1830881263542912/t21474840912(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.866999:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92a00 with x1830881263542912 ext(1257472->2097151) 00010000:00010000:3.0:1746065151.867007:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 26 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.867019:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 26 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746065151.867029:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a92a00 00000100:00100000:0.0:1746065151.869341:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263343616:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065151.869360:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065151.869405:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263543552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4299us (4360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.869414:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5969 00002000:00010000:0.0:1746065151.869483:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746065151 -> 1746065152 00002000:00010000:0.0:1746065151.869487:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746065151 -> 1746065152 00000100:00100000:0.0:1746065151.869499:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263343488:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065151.869517:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f700 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933909 expref: 24 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.869527:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f700 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933909 expref: 24 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.869536:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130113e00, rc 0) 00002000:00010000:1.0:1746065151.869796:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065151 -> 1746065152 00000100:00100000:1.0:1746065151.869806:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263343360:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065151.869820:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc146f6f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933902 expref: 23 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.869828:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc146f6f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933902 expref: 23 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065151.869842:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c800, rc 0) 00000100:00100000:1.0:1746065151.869864:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263543168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5211us (6535us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065151.869870:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13218 00000100:00100000:3.0:1746065151.870826:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263543296:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5943us (7466us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065151.870833:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13219 00000100:00100000:2.0:1746065151.871611:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.871879:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263543808 00000100:00100000:3.0:1746065151.871886:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263543808 00002000:00100000:3.0:1746065151.871916:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2224128->2228223) req@ffff8800983b8e00 x1830881263543808/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.871934:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8e00 with x1830881263543808 ext(2224128->2228223) 00002000:00010000:3.0:1746065151.871938:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b8e00 00000100:00100000:3.0:1746065151.871953:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3766 00000100:00100000:3.0:1746065151.871959:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263543808:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065151.872361:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263543808:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 401us (750us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065151.872367:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3766 00002000:00100000:3.0:1746065151.872372:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2224128->2228223) req@ffff8800983b8e00 x1830881263543808/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.872378:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800983b8e00 with x1830881263543808 ext(2224128->2228223) 00002000:00010000:3.0:1746065151.872381:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800983b8e00 00000100:00100000:0.0:1746065151.876559:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.876690:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263543936 00000100:00100000:1.0:1746065151.876697:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263543936 00010000:00010000:1.0:1746065151.876725:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 21 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.876746:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5970 00000100:00100000:1.0:1746065151.876752:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263543936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065151.876762:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065151.876809:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 21 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.876819:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 21 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.876837:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc146f69e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1708031) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338a7 expref: 21 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.876849:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.876851:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.876857:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 46 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.876868:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 46 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.876894:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 46 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.876904:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263343744:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065151.876970:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.885122:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.885186:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263544064 00000100:00100000:3.0:1746065151.885194:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263544064 00000100:00100000:3.0:1746065151.885233:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13221 00000100:00100000:3.0:1746065151.885240:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+21:32283:x1830881263544064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.885257:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.885274:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933917 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.885298:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.885306:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.885307:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.885310:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.885336:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.885346:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 46 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.885355:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263343872:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065151.885364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.885438:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263343744:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065151.885452:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.885501:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263544320 00000100:00100000:2.0:1746065151.885505:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263544320 00002000:00100000:2.0:1746065151.885527:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097a6f100 x1830881263544320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.885534:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f100 with x1830881263544320 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.885538:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6f100 00000100:00100000:2.0:1746065151.885553:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3767 00000100:00100000:2.0:1746065151.885559:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881263544320:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065151.885701:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065151.886047:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263543936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9293us (9494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.886055:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5970 00000100:00100000:3.0:1746065151.893662:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263343872:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.893690:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.893705:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:3.0:1746065151.893757:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+21:32283:x1830881263544064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8516us (8641us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.893768:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13221 00000100:00100000:0.0:1746065151.894799:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.894858:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263544448 00000100:00100000:3.0:1746065151.894864:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263544448 00002000:00100000:3.0:1746065151.894892:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (819200->1048575) req@ffff880097a6e680 x1830881263544448/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.894900:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6e680 with x1830881263544448 ext(819200->1048575) 00010000:00010000:3.0:1746065151.894906:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 49 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746065151.894916:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 49 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746065151.894934:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6e680 00000100:00100000:3.0:1746065151.894950:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1311 00000100:00100000:3.0:1746065151.894956:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881263544448:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065151.895552:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881263544320:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9991us (10186us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065151.895559:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3767 00002000:00100000:2.0:1746065151.895566:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097a6f100 x1830881263544320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.895572:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f100 with x1830881263544320 ext(1048576->2097151) 00002000:00010000:2.0:1746065151.895575:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6f100 00000100:00100000:0.0:1746065151.900649:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.900704:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263544576 00000100:00100000:3.0:1746065151.900711:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263544576 00000100:00100000:3.0:1746065151.900739:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13222 00000100:00100000:3.0:1746065151.900744:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+51:32280:x1830881263544576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.900755:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.900767:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93391e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.900803:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 20 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.900815:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.900817:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065151.900820:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 52 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.900844:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 20 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.900852:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 20 pid: 3068 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.900862:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263344000:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065151.900912:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.903115:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881263544448:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8151us (8339us total) trans 21474840913 rc 0/0 00000100:00100000:0.0:1746065151.903123:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1311 00002000:00100000:0.0:1746065151.903132:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (819200->1048575) req@ffff880097a6e680 x1830881263544448/t21474840913(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.903141:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6e680 with x1830881263544448 ext(819200->1048575) 00010000:00010000:0.0:1746065151.903148:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 51 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.903158:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 51 pid: 9549 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746065151.903167:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6e680 00000100:00100000:0.0:1746065151.908250:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.908445:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263344000:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.908473:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 50 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.908487:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2000, rc 0) 00000100:00100000:1.0:1746065151.908797:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263544704 00000100:00100000:1.0:1746065151.908803:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263544704 00002000:00100000:1.0:1746065151.908836:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2228223) req@ffff880097a6d180 x1830881263544704/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065151.908845:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d180 with x1830881263544704 ext(2097152->2228223) 00010000:00010000:1.0:1746065151.908851:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 21 pid: 3068 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.908860:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 21 pid: 3068 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746065151.908866:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6d180 00000100:00100000:1.0:1746065151.908898:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1312 00000100:00100000:1.0:1746065151.908905:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263544704:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065151.909129:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+50:32280:x1830881263544576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8382us (8485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.909135:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13222 00000100:00100000:1.0:1746065151.911083:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.911105:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263544832 00000100:00100000:1.0:1746065151.911110:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263544832 00010000:00010000:1.0:1746065151.911130:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 50 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.911159:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5971 00000100:00100000:1.0:1746065151.911164:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263544832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065151.911173:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065151.911187:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 50 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.911195:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 50 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.911213:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130113600/0xad6b7ddc146f6c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 819200->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ca expref: 50 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.911228:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.911230:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.911235:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.911242:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.911272:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065151.911282:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263344128:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065151.911328:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065151.912938:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065151.919078:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263544704:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10166us (10826us total) trans 21474840914 rc 0/0 00000100:00100000:0.0:1746065151.919089:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1312 00002000:00100000:0.0:1746065151.919099:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2228223) req@ffff880097a6d180 x1830881263544704/t21474840914(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/448 e 0 to 0 dl 1746065162 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065151.919107:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d180 with x1830881263544704 ext(2097152->2228223) 00010000:00010000:0.0:1746065151.919116:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 23 pid: 3068 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.919128:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 23 pid: 3068 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746065151.919134:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6d180 00000100:00100000:1.0:1746065151.919151:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263344128:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065151.919164:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065151.919182:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263544832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8018us (8103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.919189:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5971 00000100:00100000:0.0:1746065151.924956:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.926296:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.926501:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263545216 00000100:00100000:0.0:1746065151.926510:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263545216 00000100:00100000:2.0:1746065151.926540:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263545088 00010000:00010000:0.0:1746065151.926540:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 23 pid: 3068 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.926545:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263545088 00002000:00100000:2.0:1746065151.926572:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097a6dc00 x1830881263545088/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.926580:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6dc00 with x1830881263545088 ext(0->1048575) 00002000:00010000:2.0:1746065151.926584:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6dc00 00000100:00100000:2.0:1746065151.926602:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3768 00000100:00100000:2.0:1746065151.926609:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263545088:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.927225:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5972 00000100:00100000:0.0:1746065151.927232:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263545216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065151.927240:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065151.927250:0:7190:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065151 -> 1746065152 00002000:00010000:0.0:1746065151.927253:0:7190:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065151 -> 1746065152 00010000:00010000:0.0:1746065151.927258:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 25 pid: 3068 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.927267:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 25 pid: 3068 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.927285:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146f6f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3014655] (req 2097152->2228223) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338fb expref: 25 pid: 3068 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746065151.927451:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.927454:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.927460:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 48 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.927467:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 48 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.927493:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 48 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.927502:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263344256:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065151.927793:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.935835:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263344256:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065151.935855:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.935913:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263545216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8681us (9619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.935931:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5972 00000100:00100000:0.0:1746065151.936886:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.937326:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263545472 00000100:00100000:3.0:1746065151.937334:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263545472 00002000:00100000:3.0:1746065151.937369:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3039231) req@ffff880097a6ed80 x1830881263545472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.937382:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ed80 with x1830881263545472 ext(2097152->3039231) 00002000:00010000:3.0:1746065151.937387:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6ed80 00000100:00100000:3.0:1746065151.937414:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3769 00000100:00100000:3.0:1746065151.937421:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263545472:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065151.938842:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263545088:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12230us (13889us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065151.938850:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3768 00002000:00100000:2.0:1746065151.938857:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097a6dc00 x1830881263545088/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065151.938864:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6dc00 with x1830881263545088 ext(0->1048575) 00002000:00010000:2.0:1746065151.938867:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6dc00 00000100:00100000:3.0:1746065151.949818:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263545472:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12387us (12924us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746065151.949829:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3769 00002000:00100000:3.0:1746065151.949838:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3039231) req@ffff880097a6ed80 x1830881263545472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.949846:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ed80 with x1830881263545472 ext(2097152->3039231) 00002000:00010000:3.0:1746065151.949851:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6ed80 00000100:00100000:0.0:1746065151.956861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.956959:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263545600 00000100:00100000:3.0:1746065151.956967:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263545600 00000100:00100000:3.0:1746065151.957007:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13223 00000100:00100000:3.0:1746065151.957014:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+22:32283:x1830881263545600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065151.957030:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065151.957044:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933925 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.957064:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.957066:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065151.957073:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.957085:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.957094:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130113e00, rc 0) 00000100:00100000:3.0:1746065151.958170:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+23:32283:x1830881263545600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1151us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.958176:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13223 00000100:00100000:0.0:1746065151.958904:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.958943:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263545728 00000100:00100000:2.0:1746065151.958949:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263545728 00000100:00100000:2.0:1746065151.958985:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13224 00000100:00100000:2.0:1746065151.958991:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881263545728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065151.959001:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.959011:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93392c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.959024:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.959026:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.959031:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 50 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.959042:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 50 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.959049:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06e00, rc 0) 00000100:00100000:2.0:1746065151.959075:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881263545728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.959080:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13224 00000100:00100000:0.0:1746065151.965370:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.965456:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.965666:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263546112 00000100:00100000:3.0:1746065151.965674:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263546112 00002000:00100000:3.0:1746065151.965712:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097a6c380 x1830881263546112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.965721:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c380 with x1830881263546112 ext(1048576->2097151) 00002000:00010000:3.0:1746065151.965725:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6c380 00000100:00100000:3.0:1746065151.965743:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3770 00000100:00100000:3.0:1746065151.965749:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263546112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065151.966857:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263545856 00000100:00100000:2.0:1746065151.966862:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263545856 00000100:00100000:2.0:1746065151.967834:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13643 00000100:00100000:2.0:1746065151.967841:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+22:32288:x1830881263545856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065151.967856:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065151.967870:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc146f72a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933933 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.967914:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.967934:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.967942:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.967952:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.967956:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.967960:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.968011:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.968019:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 51 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.968025:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 28 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.968030:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.968053:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 28 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.968066:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 28 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.968077:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263344384:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.969375:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 51 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.969386:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 51 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.969394:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263344512:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.969520:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065151.973457:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.973771:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263546240 00000100:00100000:2.0:1746065151.973804:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263546240 00000100:00100000:2.0:1746065151.973847:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13225 00000100:00100000:2.0:1746065151.973854:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+39:32287:x1830881263546240:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065151.973870:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065151.973881:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263546112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8130us (8423us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746065151.973885:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93393a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065151.973889:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3770 00002000:00100000:3.0:1746065151.973897:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097a6c380 x1830881263546112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.973905:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c380 with x1830881263546112 ext(1048576->2097151) 00002000:00010000:3.0:1746065151.973909:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6c380 00010000:00010000:2.0:1746065151.973910:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.973929:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.973941:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.973943:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065151.973946:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1409024->1708031] (req 1409024->1708031) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 40 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.973975:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065151.973985:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 21 pid: 9549 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746065151.973996:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263344640:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.974048:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.974055:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 40 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.974062:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263344768:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.974087:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065151.975147:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263344384:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065151.977944:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065151.978129:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263546496 00000100:00100000:1.0:1746065151.978136:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263546496 00000100:00100000:1.0:1746065151.978194:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4923 00000100:00100000:1.0:1746065151.978202:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+29:31232:x1830881263546496:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065151.978338:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065151.978997:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263344512:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065151.979022:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065151.979401:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263546624 00000100:00100000:2.0:1746065151.979405:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263546624 00000100:00100000:1.0:1746065151.979412:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+30:31232:x1830881263546496:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1210us (1473us total) trans 8589935975 rc 0/0 00000100:00100000:1.0:1746065151.979419:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4923 00010000:00010000:2.0:1746065151.979422:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 52 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746065151.979505:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263344640:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065151.979750:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5973 00000100:00100000:2.0:1746065151.979757:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+52:2007:x1830881263546624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.979768:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.979788:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 52 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.979797:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 52 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.979815:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146f5ef lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93380d expref: 52 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.979829:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065151.979833:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.979840:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.979845:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.979850:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.979865:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881263546624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 110us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.979871:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5973 00000100:00100000:3.0:1746065151.981335:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263344768:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065151.981360:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1409024->1708031] (req 1409024->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 40 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065151.981375:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30000, rc 0) 00000100:00100000:3.0:1746065151.981414:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+40:32287:x1830881263546240:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7560us (7966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065151.981421:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13225 00000100:00100000:3.0:1746065151.982907:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.982941:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.982966:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065151.983011:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.983928:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263546752 00000100:00100000:0.0:1746065151.983936:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263546752 00000100:00100000:0.0:1746065151.983974:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13226 00000100:00100000:0.0:1746065151.983981:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+23:32283:x1830881263546752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065151.983995:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.984010:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933941 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.984029:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.984030:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.984037:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 24 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.984051:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 24 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.984058:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c600, rc 0) 00000100:00100000:2.0:1746065151.984529:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263546880 00000100:00100000:2.0:1746065151.984533:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263546880 00010000:00010000:2.0:1746065151.984550:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 40 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746065151.984568:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263547008 00000100:00100000:2.0:1746065151.984570:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263547008 00010000:00010000:2.0:1746065151.984579:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 22 pid: 9549 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746065151.984591:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263547136 00000100:00100000:2.0:1746065151.984592:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263547136 00010000:00010000:2.0:1746065151.984601:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 30 pid: 7203 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746065151.985057:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+24:32283:x1830881263546752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1075us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.985064:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13226 00000100:00100000:2.0:1746065151.985065:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5974 00000100:00100000:2.0:1746065151.985071:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263546880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065151.985081:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.985097:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 40 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.985099:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5975 00010000:00010000:2.0:1746065151.985106:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 40 pid: 9549 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746065151.985106:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263547008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065151.985112:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.985121:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc146f689 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933892 expref: 40 pid: 9549 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746065151.985125:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 22 pid: 9549 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746065151.985136:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065151.985138:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 22 pid: 9549 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746065151.985149:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146f6a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338ae expref: 22 pid: 9549 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746065151.985158:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.985159:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065151.985164:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 39 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065151.985171:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 39 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.985180:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263546880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.985185:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5974 00010000:00010000:1.0:1746065151.985196:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 38 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065151.985197:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5976 00000100:00100000:2.0:1746065151.985202:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+30:2004:x1830881263547136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065151.985206:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263344896:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065151.985208:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065151.985213:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 30 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.985221:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 30 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.985233:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72200/0xad6b7ddc146f666 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933876 expref: 30 pid: 7203 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746065151.985241:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065151.985245:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065151.985248:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846240 going to sleep for 11 seconds 00010000:00010000:2.0:1746065151.985252:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985258:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985271:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065151.985301:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+29:2004:x1830881263547136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.985306:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5976 00010000:00010000:2.0:1746065151.985323:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985329:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065151.985367:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065151.985371:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065151.985386:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985395:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985404:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985409:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985414:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985419:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985424:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065151.985426:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985432:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985442:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065151.985444:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065151.985447:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985451:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc146f731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985458:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985463:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985466:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985470:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065151.985472:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985477:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985482:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d56c600) 00010000:00010000:2.0:1746065151.985484:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065151.985486:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985490:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc146f738 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065151.985511:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc146f72a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 24 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.985520:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 23 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065151.985526:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065151.985528:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065151.985529:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07e00, rc 0) 00000100:00100000:2.0:1746065151.985558:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+23:32288:x1830881263545856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 17717us (20195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065151.985563:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13643 00000100:00100000:0.0:1746065151.994461:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.994548:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.994571:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263547520 00000100:00100000:0.0:1746065151.994578:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263547520 00000100:00100000:0.0:1746065151.994617:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13227 00000100:00100000:0.0:1746065151.994624:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263547520:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065151.994639:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.994653:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933948 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.994672:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.994674:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.994681:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.994695:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.994703:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d400, rc 0) 00000100:00100000:0.0:1746065151.994741:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263547520:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 117us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.994747:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13227 00000100:00100000:0.0:1746065151.994956:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.994968:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263547648 00000100:00100000:0.0:1746065151.994971:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263547648 00000100:00100000:0.0:1746065151.994987:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13228 00000100:00100000:0.0:1746065151.994991:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2006:x1830881263547648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065151.994998:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.995007:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9d200/0xad6b7ddc146f75b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93394f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065151.995038:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263345024:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065151.995089:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065151.995090:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263547392 00000100:00100000:3.0:1746065151.995095:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263547392 00002000:00100000:3.0:1746065151.995118:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097a6d880 x1830881263547392/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/0 e 0 to 0 dl 1746065162 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065151.995126:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d880 with x1830881263547392 ext(2097152->4194303) 00000100:00100000:0.0:1746065151.995129:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:3.0:1746065151.995130:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6d880 00000100:00100000:0.0:1746065151.995140:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263547776 00000100:00100000:0.0:1746065151.995143:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263547776 00000100:00100000:3.0:1746065151.995144:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3771 00000100:00100000:3.0:1746065151.995149:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263547392:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065151.995158:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13229 00000100:00100000:0.0:1746065151.995162:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263547776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065151.995168:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.995174:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933956 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.995183:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.995184:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.995188:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.995197:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.995203:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d800, rc 0) 00000100:00100000:0.0:1746065151.995217:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263547776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 55us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.995221:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13229 00000100:00100000:0.0:1746065151.995252:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.995263:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263547904 00000100:00100000:0.0:1746065151.995265:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263547904 00000100:00100000:0.0:1746065151.995279:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13230 00000100:00100000:0.0:1746065151.995283:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263547904:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065151.995291:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.995296:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93395d expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.995305:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.995306:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.995310:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.995318:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.995325:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9ce00, rc 0) 00000100:00100000:0.0:1746065151.995337:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263547904:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 54us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.995342:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13230 00000100:00100000:0.0:1746065151.995370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.995380:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263548032 00000100:00100000:0.0:1746065151.995382:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263548032 00000100:00100000:0.0:1746065151.995395:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13231 00000100:00100000:0.0:1746065151.995400:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263548032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065151.995405:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.995411:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933964 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.995419:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.995420:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.995425:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.995433:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.995440:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d000, rc 0) 00000100:00100000:0.0:1746065151.995454:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263548032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 53us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.995458:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13231 00000100:00100000:0.0:1746065151.995495:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065151.995506:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263548160 00000100:00100000:0.0:1746065151.995508:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263548160 00000100:00100000:0.0:1746065151.995521:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13232 00000100:00100000:0.0:1746065151.995525:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263548160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065151.995531:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065151.995537:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93396b expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065151.995546:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.995547:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065151.995551:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.995559:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065151.995565:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130105000, rc 0) 00000100:00100000:0.0:1746065151.995578:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263548160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 53us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065151.995583:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13232 00000100:00100000:1.0:1746065151.995740:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263344896:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065151.995753:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065151.995793:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263547008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10688us (12826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065151.995801:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5975 00002000:00010000:2.0:1746065152.004195:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065151 -> 1746065152 00002000:00010000:2.0:1746065152.004202:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065151 -> 1746065152 00002000:00010000:2.0:1746065152.004204:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065151 -> 1746065152 00000100:00100000:2.0:1746065152.004223:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263345024:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065152.004252:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d200/0xad6b7ddc146f75b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93394f expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.004265:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d200/0xad6b7ddc146f75b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93394f expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.004280:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d200, rc 0) 00000100:00100000:2.0:1746065152.004335:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263547648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9341us (9377us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065152.004341:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13228 00000100:00100000:0.0:1746065152.006176:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.006259:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263548416 00000100:00100000:2.0:1746065152.006266:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263548416 00002000:00100000:2.0:1746065152.006294:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1703936->1708031) req@ffff880097a6d500 x1830881263548416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.006303:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d500 with x1830881263548416 ext(1703936->1708031) 00002000:00010000:2.0:1746065152.006307:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6d500 00000100:00100000:2.0:1746065152.006322:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3772 00000100:00100000:2.0:1746065152.006328:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263548416:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065152.006429:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263548416:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 101us (256us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065152.006435:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3772 00002000:00100000:2.0:1746065152.006439:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1703936->1708031) req@ffff880097a6d500 x1830881263548416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.006444:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d500 with x1830881263548416 ext(1703936->1708031) 00002000:00010000:2.0:1746065152.006447:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6d500 00000100:00100000:0.0:1746065152.015819:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.015982:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263548672 00000100:00100000:0.0:1746065152.015992:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263547392:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20840us (21539us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065152.016001:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3771 00002000:00100000:0.0:1746065152.016010:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097a6d880 x1830881263547392/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:67/0 lens 488/440 e 0 to 0 dl 1746065162 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.016019:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d880 with x1830881263547392 ext(2097152->4194303) 00002000:00010000:0.0:1746065152.016025:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6d880 00000100:00100000:3.0:1746065152.016042:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263548672 00000100:00100000:3.0:1746065152.016078:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13644 00000100:00100000:3.0:1746065152.016085:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+23:32288:x1830881263548672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065152.016099:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.016115:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130112800/0xad6b7ddc146f77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933972 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.016198:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065152.016210:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 24 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.016215:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065152.016237:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 24 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.016246:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 24 pid: 7203 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.016256:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263345152:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.016323:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.021584:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.021629:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.021721:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263548800 00000100:00100000:0.0:1746065152.021721:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263549056 00000100:00100000:0.0:1746065152.021728:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263549056 00000100:00100000:1.0:1746065152.021729:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263548800 00010000:00010000:1.0:1746065152.021759:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 25 pid: 7203 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.021795:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4924 00000100:00100000:1.0:1746065152.021798:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5977 00000100:00100000:0.0:1746065152.021803:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+51:32287:x1830881263549056:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065152.021804:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+25:2004:x1830881263548800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.021817:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.021822:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 25 pid: 7203 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.021833:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 25 pid: 7203 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.021852:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.021856:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065152.021864:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065152.021870:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065152.021889:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.021934:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+25:2004:x1830881263548800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.021940:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5977 00000100:00100000:0.0:1746065152.021972:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+52:32287:x1830881263549056:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 170us (342us total) trans 8589935976 rc 0/0 00000100:00100000:0.0:1746065152.021978:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4924 00000100:00100000:1.0:1746065152.022057:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065152.022085:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc146f73f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933933 expref: 24 pid: 7203 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.022101:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263345152:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.022116:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065152.022123:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065152.022132:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065152.022147:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065152.022200:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130112800/0xad6b7ddc146f77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 25 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.022211:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 24 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.022216:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.022218:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065152.022220:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112400, rc 0) 00000100:00100000:2.0:1746065152.022324:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263549312 00000100:00100000:2.0:1746065152.022328:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263549312 00000100:00100000:3.0:1746065152.022332:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+24:32288:x1830881263548672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6246us (6520us total) trans 8589935977 rc 0/0 00000100:00100000:3.0:1746065152.022338:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13644 00000100:00100000:2.0:1746065152.022350:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13645 00000100:00100000:2.0:1746065152.022355:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+29:32291:x1830881263549312:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065152.022365:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.022374:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146f793 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933979 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.022424:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.022432:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.022442:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065152.022448:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065152.022486:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc146f793 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.022500:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.022505:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065152.022507:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065152.022508:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31c00, rc 0) 00000100:00100000:2.0:1746065152.022523:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+31:32291:x1830881263549312:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 168us (467us total) trans 8589935978 rc 0/0 00000100:00100000:2.0:1746065152.022528:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13645 00000100:00100000:0.0:1746065152.024657:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.024813:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263549440 00000100:00100000:2.0:1746065152.024820:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263549440 00000100:00100000:2.0:1746065152.024858:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13233 00000100:00100000:2.0:1746065152.024865:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263549440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065152.024878:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.024891:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146f7a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933980 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.024943:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263345280:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065152.025017:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.031402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.031467:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263549568 00000100:00100000:1.0:1746065152.031475:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263549568 00000100:00100000:1.0:1746065152.031564:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13646 00000100:00100000:1.0:1746065152.031571:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+24:32288:x1830881263549568:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065152.031595:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.031611:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146f7af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933987 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.031682:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.031693:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 25 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.031699:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.031704:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.031729:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.031739:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 30 pid: 7231 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.031750:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263345408:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065152.031837:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 25 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.031843:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 25 pid: 7203 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.031850:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263345536:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.031863:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.031942:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263345280:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065152.031964:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146f7a8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933980 expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.031973:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146f7a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933980 expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.031981:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30400, rc 0) 00000100:00100000:2.0:1746065152.031999:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263549440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7135us (7349us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065152.032006:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13233 00000100:00100000:0.0:1746065152.035432:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.035797:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263345408:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.035807:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263345536:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065152.035827:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:2.0:1746065152.036808:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263549696 00000100:00100000:2.0:1746065152.036816:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263549696 00010000:00010000:2.0:1746065152.036844:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 31 pid: 7231 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.036880:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5978 00000100:00100000:2.0:1746065152.036886:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+31:2007:x1830881263549696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.036896:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.036901:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 31 pid: 7231 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.036909:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 31 pid: 7231 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.036936:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc146f79a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933979 expref: 31 pid: 7231 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.036952:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065152.036956:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.036963:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.036967:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.036972:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.037012:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+30:2007:x1830881263549696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.037018:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5978 00000100:00100000:3.0:1746065152.039107:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.039126:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.039155:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.039231:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263550208 00000100:00100000:0.0:1746065152.039239:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263550208 00002000:00100000:0.0:1746065152.039272:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88009acec700 x1830881263550208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.039281:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec700 with x1830881263550208 ext(4194304->5021695) 00002000:00010000:0.0:1746065152.039286:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acec700 00000100:00100000:0.0:1746065152.039300:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3773 00000100:00100000:0.0:1746065152.039306:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263550208:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065152.041307:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263549824 00000100:00100000:1.0:1746065152.041316:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263549824 00010000:00010000:1.0:1746065152.041347:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 26 pid: 7203 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.041375:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5979 00000100:00100000:1.0:1746065152.041381:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+26:2007:x1830881263549824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.041391:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.041396:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 26 pid: 7203 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.041405:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 26 pid: 7203 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.041422:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130112400/0xad6b7ddc146f785 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933972 expref: 26 pid: 7203 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.041437:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.041441:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.041450:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.041455:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.041472:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.041506:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+25:2007:x1830881263549824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.041511:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5979 00010000:00010000:1.0:1746065152.041533:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.041538:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065152.041581:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065152.041585:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065152.041598:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.041622:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc146f7af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 25 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.041632:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.041638:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.041640:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065152.041642:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bef400, rc 0) 00000100:00100000:1.0:1746065152.041662:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+24:32288:x1830881263549568:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 10091us (10267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.041668:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13646 00000100:00100000:3.0:1746065152.044830:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263549952 00000100:00100000:3.0:1746065152.044840:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263549952 00000100:00100000:3.0:1746065152.044879:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13234 00000100:00100000:3.0:1746065152.044886:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+26:32291:x1830881263549952:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065152.044900:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.044914:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93398e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.044950:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 27 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.044961:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.044968:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 49 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.044973:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.044975:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.044978:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [331776->425983] (req 331776->425983) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 27 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.045005:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 49 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.045015:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 49 pid: 9550 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065152.045025:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263345664:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.045097:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.045104:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065152.045111:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263345792:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.045135:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 27 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.045141:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 27 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.045148:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263345920:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.045161:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.050676:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263550208:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11363us (11512us total) trans 0 rc 827392/827392 00000100:00100000:0.0:1746065152.050686:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3773 00002000:00100000:0.0:1746065152.050694:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88009acec700 x1830881263550208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 827392/827392 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.050703:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec700 with x1830881263550208 ext(4194304->5021695) 00002000:00010000:0.0:1746065152.050708:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acec700 00000100:00100000:0.0:1746065152.051386:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.051462:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263550336 00000100:00100000:1.0:1746065152.051468:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263550336 00000100:00100000:1.0:1746065152.051495:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13235 00000100:00100000:1.0:1746065152.051501:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263550336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065152.051513:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.051525:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc146f7c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933995 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.051562:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263346048:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065152.053557:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.056336:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.056582:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263550464 00000100:00100000:1.0:1746065152.056591:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263550464 00010000:00010000:1.0:1746065152.056625:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 12 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746065152.056653:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5980 00000100:00100000:1.0:1746065152.056659:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263550464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.056669:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.056689:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 12 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.056698:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 12 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.056717:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.056756:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263550464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.056762:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5980 00000100:00100000:0.0:1746065152.056877:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.057005:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263345664:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.057014:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d400/0xad6b7ddc146f754 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933948 expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065152.057028:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263345792:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.057035:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263345920:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.057058:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [331776->425983] (req 331776->425983) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.057066:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112600, rc 0) 00000100:00100000:3.0:1746065152.057084:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+25:32291:x1830881263549952:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12199us (17957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.057090:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13234 00000100:00100000:1.0:1746065152.057443:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263550720 00000100:00100000:1.0:1746065152.057447:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263550720 00010000:00010000:1.0:1746065152.057459:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 25 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.057483:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5981 00000100:00100000:1.0:1746065152.057488:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2007:x1830881263550720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.057494:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.057502:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 25 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.057509:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 25 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.057522:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146f70e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933917 expref: 25 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.057540:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.057566:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263550720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.057575:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5981 00000100:00100000:0.0:1746065152.058906:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.058937:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.058963:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.058982:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263550976 00000100:00100000:3.0:1746065152.058984:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263550848 00000100:00100000:3.0:1746065152.058986:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263550848 00000100:00100000:0.0:1746065152.058986:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263550976 00000100:00100000:0.0:1746065152.059011:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13236 00000100:00100000:0.0:1746065152.059016:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263550976:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065152.059027:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13237 00010000:00010000:0.0:1746065152.059030:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065152.059031:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263550848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065152.059037:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.059045:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146f7d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93399c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.059045:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46800/0xad6b7ddc146f7cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339a3 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.059059:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.059065:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146f7d2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93399c expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.059071:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad200/0xad6b7ddc146f7d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93399c expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.059080:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:0.0:1746065152.059081:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263346176:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065152.059104:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263550848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065152.059108:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13237 00000100:00100000:0.0:1746065152.059121:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065152.059557:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263550592 00000100:00100000:1.0:1746065152.059561:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263550592 00010000:00010000:1.0:1746065152.059577:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 50 pid: 9550 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746065152.059610:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5982 00000100:00100000:1.0:1746065152.059616:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263550592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.059623:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.059639:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 50 pid: 9550 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.059648:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 50 pid: 9550 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.059661:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06e00/0xad6b7ddc146f723 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93392c expref: 50 pid: 9550 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.059669:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.059670:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.059676:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.059682:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.059703:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.059711:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263346304:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065152.059733:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065152.059767:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263346048:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065152.059801:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc146f7c4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933995 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.059810:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc146f7c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933995 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.059817:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04b600, rc 0) 00000100:00100000:1.0:1746065152.059838:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263550336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8336us (8453us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065152.059843:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13235 00000100:00100000:0.0:1746065152.064116:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263346176:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065152.064145:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46800/0xad6b7ddc146f7cb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339a3 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.064157:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46800/0xad6b7ddc146f7cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339a3 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.064166:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46800, rc 0) 00000100:00100000:0.0:1746065152.064220:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263550976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5201us (5279us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065152.064227:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13236 00000100:00100000:2.0:1746065152.066360:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.066408:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263346304:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065152.066425:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.066452:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.066941:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263551488 00000100:00100000:0.0:1746065152.066947:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263551488 00002000:00100000:0.0:1746065152.066979:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (331776->335871) req@ffff880097fa0e00 x1830881263551488/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.066986:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0e00 with x1830881263551488 ext(331776->335871) 00002000:00010000:0.0:1746065152.066990:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0e00 00000100:00100000:0.0:1746065152.067004:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3774 00000100:00100000:0.0:1746065152.067010:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881263551488:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065152.067128:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881263550592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7510us (8225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.067136:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5982 00000100:00100000:0.0:1746065152.068640:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881263551488:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1625us (2182us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065152.068651:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3774 00002000:00100000:0.0:1746065152.068660:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (331776->335871) req@ffff880097fa0e00 x1830881263551488/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.068668:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0e00 with x1830881263551488 ext(331776->335871) 00002000:00010000:0.0:1746065152.068672:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0e00 00000100:00100000:0.0:1746065152.068699:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263551232 00000100:00100000:0.0:1746065152.068702:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263551232 00000100:00100000:0.0:1746065152.068736:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13647 00000100:00100000:0.0:1746065152.068742:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+24:32288:x1830881263551232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065152.068754:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.068768:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146f7d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339aa expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.069222:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069235:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069243:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069252:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069257:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069263:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069267:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996be000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065152.069270:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069275:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069282:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.069284:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065152.069287:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069290:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc146f7e0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.069312:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146f7d9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339aa expref: 25 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.069319:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc146f7d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339aa expref: 25 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.069326:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47200, rc 0) 00000100:00100000:1.0:1746065152.069370:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+24:32288:x1830881263551232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 627us (3014us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065152.069375:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13647 00000100:00100000:1.0:1746065152.072623:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.072736:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263551616 00000100:00100000:0.0:1746065152.072749:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263551616 00000100:00100000:0.0:1746065152.072807:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13238 00000100:00100000:0.0:1746065152.072816:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263551616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065152.072833:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.072849:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f7e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339b1 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.072892:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263346432:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065152.073110:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.073128:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263551872 00000100:00100000:0.0:1746065152.073130:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263551872 00002000:00100000:0.0:1746065152.073152:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (421888->425983) req@ffff88008f3e6a00 x1830881263551872/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.073160:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6a00 with x1830881263551872 ext(421888->425983) 00002000:00010000:0.0:1746065152.073164:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6a00 00000100:00100000:0.0:1746065152.073174:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3775 00000100:00100000:0.0:1746065152.073178:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263551872:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065152.073260:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263551872:12345-192.168.202.27@tcp:3:cat.0 Request processed in 81us (150us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065152.073266:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3775 00002000:00100000:0.0:1746065152.073270:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (421888->425983) req@ffff88008f3e6a00 x1830881263551872/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.073276:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6a00 with x1830881263551872 ext(421888->425983) 00002000:00010000:0.0:1746065152.073279:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6a00 00000100:00100000:1.0:1746065152.075806:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.076055:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.076384:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263552128 00000100:00100000:2.0:1746065152.076391:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263552128 00000100:00100000:2.0:1746065152.076429:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4925 00000100:00100000:2.0:1746065152.076436:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+24:32288:x1830881263552128:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065152.076593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.076605:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263552384 00000100:00100000:0.0:1746065152.076607:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263552384 00000100:00100000:0.0:1746065152.076622:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4926 00000100:00100000:0.0:1746065152.076626:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+30:32291:x1830881263552384:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065152.077013:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263346432:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065152.077038:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f7e7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b1 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.077048:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc146f7e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b1 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.077056:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:0.0:1746065152.077569:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+31:32291:x1830881263552384:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 939us (973us total) trans 8589935979 rc 0/0 00000100:00100000:0.0:1746065152.077577:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4926 00000100:00100000:2.0:1746065152.077640:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+25:32288:x1830881263552128:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1204us (1588us total) trans 8589935980 rc 0/0 00000100:00100000:2.0:1746065152.077646:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4925 00000100:00100000:1.0:1746065152.077838:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263551616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5023us (5223us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065152.077843:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13238 00000100:00100000:0.0:1746065152.156396:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.157988:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263552640 00000100:00100000:1.0:1746065152.157998:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263552640 00000100:00100000:1.0:1746065152.158055:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13648 00000100:00100000:1.0:1746065152.158062:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+52:32297:x1830881263552640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065152.158083:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.158098:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f7ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339b8 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.158170:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.158182:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.158188:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.158210:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.158220:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 24 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.158229:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263346560:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.158308:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.160768:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.160875:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263552768 00000100:00100000:2.0:1746065152.160881:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263552768 00010000:00010000:2.0:1746065152.160908:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 25 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.160974:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5983 00000100:00100000:2.0:1746065152.160980:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+25:2005:x1830881263552768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.160990:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.160995:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 25 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.161004:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 25 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.161020:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065152.161024:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.161032:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.161037:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.161049:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.161076:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+25:2005:x1830881263552768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.161082:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5983 00010000:00010000:1.0:1746065152.161152:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc146f7b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933987 expref: 24 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.161169:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263346560:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065152.161181:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.161188:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.161192:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065152.161205:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065152.161292:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f7ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 55 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.161302:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 54 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.161307:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.161309:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065152.161312:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be600, rc 0) 00000100:00100000:1.0:1746065152.161334:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+54:32297:x1830881263552640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3272us (4945us total) trans 8589935981 rc 0/0 00000100:00100000:1.0:1746065152.161339:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13648 00000100:00100000:0.0:1746065152.196359:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.196453:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263552896 00000100:00100000:1.0:1746065152.196461:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263552896 00000100:00100000:1.0:1746065152.196559:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13239 00000100:00100000:1.0:1746065152.196567:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881263552896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065152.196583:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.196597:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f803 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339bf expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.196639:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263346688:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065152.197314:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23c00c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065152.199819:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065151 -> 1746065152 00002000:00010000:1.0:1746065152.199825:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065151 -> 1746065152 00000100:00100000:1.0:1746065152.199843:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263346688:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065152.199866:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f803 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339bf expref: 50 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.199877:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc146f803 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339bf expref: 50 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.199890:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:1.0:1746065152.199950:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881263552896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3382us (3596us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065152.199958:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13239 00000100:00100000:0.0:1746065152.213381:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.213484:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263553152 00000100:00100000:1.0:1746065152.213493:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263553152 00000100:00100000:1.0:1746065152.213533:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13649 00000100:00100000:1.0:1746065152.213540:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+31:32304:x1830881263553152:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065152.213561:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.213577:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f80a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339c6 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.213673:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.213688:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065152.213698:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065152.213710:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065152.213850:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc146f80a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 34 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.213874:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 33 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.213882:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.213884:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065152.213887:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf400, rc 0) 00000100:00100000:1.0:1746065152.213948:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+33:32304:x1830881263553152:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 406us (573us total) trans 8589935982 rc 0/0 00000100:00100000:1.0:1746065152.213955:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13649 00000100:00100000:2.0:1746065152.216041:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.216136:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.216219:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263553280 00000100:00100000:3.0:1746065152.216225:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263553280 00000100:00100000:3.0:1746065152.216269:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263553408 00000100:00100000:3.0:1746065152.216272:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263553408 00000100:00100000:3.0:1746065152.216286:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13240 00000100:00100000:3.0:1746065152.216292:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+49:32300:x1830881263553280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065152.216303:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.216315:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339cd expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.216335:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.216346:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065152.216348:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065152.216351:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 50 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.216374:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.216383:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 23 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.216393:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263346816:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.216452:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065152.216611:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13241 00000100:00100000:1.0:1746065152.216623:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263553408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065152.216633:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.216644:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996be000/0xad6b7ddc146f826 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339d4 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.216681:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263346944:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065152.216721:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.218959:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.218978:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263553536 00000100:00100000:0.0:1746065152.218983:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263553536 00002000:00100000:0.0:1746065152.219011:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (331776->425983) req@ffff88009c5f1f80 x1830881263553536/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.219019:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1f80 with x1830881263553536 ext(331776->425983) 00010000:00010000:0.0:1746065152.219025:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 24 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.219035:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 24 pid: 9550 timeout: 848 lvb_type: 0 00002000:00010000:0.0:1746065152.219041:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c5f1f80 00000100:00100000:0.0:1746065152.219056:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1313 00000100:00100000:0.0:1746065152.219062:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263553536:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065152.219340:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263346944:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065152.219367:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996be000/0xad6b7ddc146f826 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339d4 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.219379:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996be000/0xad6b7ddc146f826 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339d4 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.219389:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be000, rc 0) 00000100:00100000:1.0:1746065152.219425:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263553408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2804us (3289us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065152.219432:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13241 00000100:00100000:3.0:1746065152.219822:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263346816:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.219843:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 50 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.219855:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:3.0:1746065152.219883:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+50:32300:x1830881263553280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3589us (3846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.219890:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13240 00000100:00100000:2.0:1746065152.225058:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.225104:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263553664 00000100:00100000:3.0:1746065152.225114:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263553664 00000100:00100000:3.0:1746065152.225160:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13242 00000100:00100000:3.0:1746065152.225169:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+26:32305:x1830881263553664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065152.225189:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.225211:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339db expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.225236:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065152.225243:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.225254:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.225264:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:3.0:1746065152.225305:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+27:32305:x1830881263553664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.225310:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13242 00000100:00100000:1.0:1746065152.226482:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263553536:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7415us (7520us total) trans 21474840915 rc 0/0 00000100:00100000:1.0:1746065152.226491:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1313 00002000:00100000:1.0:1746065152.226501:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (331776->425983) req@ffff88009c5f1f80 x1830881263553536/t21474840915(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/448 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.226509:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1f80 with x1830881263553536 ext(331776->425983) 00010000:00010000:1.0:1746065152.226517:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 27 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.226530:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 27 pid: 9550 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746065152.226536:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c5f1f80 00000100:00100000:3.0:1746065152.230745:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.230822:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263553792 00000100:00100000:0.0:1746065152.230832:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263553792 00010000:00010000:0.0:1746065152.230869:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 27 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.230913:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5984 00000100:00100000:0.0:1746065152.230935:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263553792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065152.230949:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065152.230968:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 27 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.230984:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 27 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.231006:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130112600/0xad6b7ddc146f7bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 331776->425983) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93398e expref: 27 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.231045:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.231048:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.231056:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.231064:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.231073:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.231074:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.231077:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.231083:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.231116:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.231130:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263347072:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065152.231244:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 49 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.231255:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263347200:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065152.231283:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.241892:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263347072:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065152.241911:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263347200:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065152.241942:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.242012:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263553792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11088us (11270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.242022:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5984 00000100:00100000:0.0:1746065152.242153:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.242802:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263554048 00000100:00100000:1.0:1746065152.242810:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263554048 00002000:00100000:1.0:1746065152.242851:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88008c52a300 x1830881263554048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.242859:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52a300 with x1830881263554048 ext(0->1048575) 00002000:00010000:1.0:1746065152.242863:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52a300 00000100:00100000:1.0:1746065152.242893:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3776 00000100:00100000:1.0:1746065152.242901:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2007:x1830881263554048:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065152.252218:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.252268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.252289:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263554560 00000100:00100000:2.0:1746065152.252297:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263554560 00002000:00100000:2.0:1746065152.252330:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa1880 x1830881263554560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 504/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.252339:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1880 with x1830881263554560 ext(1048576->2097151) 00002000:00010000:2.0:1746065152.252343:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1880 00000100:00100000:2.0:1746065152.252364:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263554432 00000100:00100000:2.0:1746065152.252366:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263554432 00002000:00100000:2.0:1746065152.252377:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097fa2a00 x1830881263554432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.252382:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2a00 with x1830881263554432 ext(0->1048575) 00002000:00010000:2.0:1746065152.252385:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2a00 00000100:00100000:2.0:1746065152.252395:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3777 00000100:00100000:2.0:1746065152.252401:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263554560:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065152.252832:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3778 00000100:00100000:2.0:1746065152.252837:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263554432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065152.264456:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.264568:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263554688 00000100:00100000:3.0:1746065152.264576:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263554688 00000100:00100000:1.0:1746065152.264653:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2007:x1830881263554048:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21748us (22498us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065152.264663:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3776 00002000:00100000:1.0:1746065152.264675:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88008c52a300 x1830881263554048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.264683:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52a300 with x1830881263554048 ext(0->1048575) 00002000:00010000:1.0:1746065152.264688:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52a300 00000100:00100000:3.0:1746065152.264721:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13243 00000100:00100000:3.0:1746065152.264728:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+52:32297:x1830881263554688:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065152.264740:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.264753:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339e2 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.264905:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.264944:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.264952:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.264958:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.264959:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.264963:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1843200->2097151] (req 1843200->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 53 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.264985:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.264995:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 25 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.265005:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263347328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.267100:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.267113:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 10 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065152.267123:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263347456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.268689:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.268701:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 53 pid: 13375 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.268709:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263347584:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.268750:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.273803:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263347328:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.273818:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263347456:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.275589:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263554560:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23181us (23374us total) trans 0 rc 749568/749568 00000100:00100000:2.0:1746065152.275598:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3777 00002000:00100000:2.0:1746065152.275607:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa1880 x1830881263554560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 504/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 749568/749568 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.275614:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1880 with x1830881263554560 ext(1048576->2097151) 00002000:00010000:2.0:1746065152.275619:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1880 00000100:00100000:1.0:1746065152.275887:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.275930:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.276020:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263554944 00000100:00100000:3.0:1746065152.276026:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263554944 00010000:00010000:3.0:1746065152.276048:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065152.276075:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263554816 00000100:00100000:3.0:1746065152.276077:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263554816 00010000:00010000:3.0:1746065152.276085:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 26 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.276097:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5985 00000100:00100000:3.0:1746065152.276102:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263554944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.276112:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.276127:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.276141:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.276158:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9ce00/0xad6b7ddc146f769 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93395d expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.276173:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.276197:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263554944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.276202:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5985 00000100:00100000:3.0:1746065152.276212:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5986 00000100:00100000:3.0:1746065152.276217:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263554816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.276224:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.276231:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 26 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.276238:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 26 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.276248:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc146f71c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933925 expref: 26 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.276257:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.276270:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263554816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.276279:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5986 00000100:00100000:0.0:1746065152.288167:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.290035:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263555072 00000100:00100000:2.0:1746065152.290044:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263555072 00000100:00100000:2.0:1746065152.290088:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13244 00000100:00100000:2.0:1746065152.290095:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+21:32305:x1830881263555072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065152.290111:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065152.290305:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881263554432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 37465us (38035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065152.290312:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3778 00002000:00100000:3.0:1746065152.290319:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097fa2a00 x1830881263554432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.290327:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2a00 with x1830881263554432 ext(0->1048575) 00002000:00010000:3.0:1746065152.290331:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2a00 00010000:00010000:2.0:1746065152.290611:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339e9 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.290635:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 38 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.290641:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065152.290642:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065152.290645:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.290667:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 38 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.290675:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 38 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.290689:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263347712:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.290811:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263347584:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.290833:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1843200->2097151] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 51 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.290842:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:3.0:1746065152.290857:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+51:32297:x1830881263554688:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 26130us (26409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.290863:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13243 00000100:00100000:0.0:1746065152.293481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.293513:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263555200 00000100:00100000:0.0:1746065152.293619:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263555200 00000100:00100000:2.0:1746065152.293698:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746065152.293708:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 51 pid: 13375 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.293730:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5987 00000100:00100000:3.0:1746065152.293737:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881263555200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.293748:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.293762:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 51 pid: 13375 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.293789:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 51 pid: 13375 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.293806:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc146f6eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338f4 expref: 51 pid: 13375 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.293820:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.293822:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.293826:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 50 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.293832:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 50 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.293856:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 50 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.293865:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263347840:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065152.296157:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065152.302647:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.302738:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263347712:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.302761:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.302789:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4400, rc 0) 00000100:00100000:2.0:1746065152.302824:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:32305:x1830881263555072:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12729us (14664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.302831:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13244 00000100:00100000:2.0:1746065152.302865:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263555456 00000100:00100000:2.0:1746065152.302870:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263555456 00002000:00100000:2.0:1746065152.302896:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1843200->1847295) req@ffff880099cf3100 x1830881263555456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.302904:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3100 with x1830881263555456 ext(1843200->1847295) 00002000:00010000:2.0:1746065152.302908:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3100 00000100:00100000:2.0:1746065152.302932:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3779 00000100:00100000:2.0:1746065152.302938:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+51:2006:x1830881263555456:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065152.303024:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+51:2006:x1830881263555456:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 86us (383us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065152.303030:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3779 00002000:00100000:2.0:1746065152.303034:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1843200->1847295) req@ffff880099cf3100 x1830881263555456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.303046:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3100 with x1830881263555456 ext(1843200->1847295) 00002000:00010000:2.0:1746065152.303048:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3100 00000100:00100000:3.0:1746065152.303179:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263347840:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065152.303190:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.303209:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263555200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9474us (9735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.303217:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5987 00000100:00100000:0.0:1746065152.305054:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.305115:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263555584 00000100:00100000:2.0:1746065152.305120:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263555584 00002000:00100000:2.0:1746065152.305145:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1409024->1708031) req@ffff88008c528e00 x1830881263555584/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.305153:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528e00 with x1830881263555584 ext(1409024->1708031) 00010000:00010000:2.0:1746065152.305160:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 39 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.305171:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 39 pid: 9550 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746065152.305177:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c528e00 00000100:00100000:2.0:1746065152.305190:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1314 00000100:00100000:2.0:1746065152.305196:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263555584:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065152.307729:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.308150:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263555712 00000100:00100000:2.0:1746065152.308157:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263555712 00000100:00100000:2.0:1746065152.308192:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13245 00000100:00100000:2.0:1746065152.308199:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+22:32304:x1830881263555712:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065152.308214:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.308276:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339f0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.308298:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065152.308303:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.308309:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065152.308312:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1060864->1708031] (req 1060864->1708031) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 23 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.308340:0:9549:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.308352:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1060864->1708031] (req 1060864->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 23 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.308360:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5c00, rc 0) 00000100:00100000:2.0:1746065152.309121:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+23:32304:x1830881263555712:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 920us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.309129:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13245 00000100:00100000:1.0:1746065152.309139:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.309151:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263555840 00000100:00100000:2.0:1746065152.309154:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263555840 00000100:00100000:2.0:1746065152.309170:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13246 00000100:00100000:2.0:1746065152.309174:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+41:32300:x1830881263555840:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065152.309180:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.309187:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339f7 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.309199:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065152.309202:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1060864->1708031] (req 1060864->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.309211:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065152.309213:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 42 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.309227:0:9549:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1060864->1708031] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.309235:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 42 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.309241:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5e00, rc 0) 00000100:00100000:2.0:1746065152.309260:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+42:32300:x1830881263555840:12345-192.168.202.27@tcp:101:cat.0 Request processed in 85us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.309265:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13246 00000100:00100000:0.0:1746065152.310160:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.310179:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263555968 00000100:00100000:0.0:1746065152.310182:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263555968 00000100:00100000:0.0:1746065152.310199:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13247 00000100:00100000:0.0:1746065152.310204:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+50:32297:x1830881263555968:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065152.310211:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.310220:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9339fe expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.310234:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 51 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.310241:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.310248:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 24 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.310258:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.310259:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.310262:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->2559999] (req 2097152->2559999) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 51 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.310276:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 24 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.310285:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 24 pid: 9548 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.310295:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263348224:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.312750:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.312764:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 9 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746065152.312792:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263348352:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.312869:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 51 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.312878:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 51 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.312890:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263348480:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065152.312906:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.313061:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263555584:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7862us (8010us total) trans 17179873462 rc 0/0 00000100:00100000:3.0:1746065152.313070:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1314 00002000:00100000:3.0:1746065152.313078:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1409024->1708031) req@ffff88008c528e00 x1830881263555584/t17179873462(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/448 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.313086:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528e00 with x1830881263555584 ext(1409024->1708031) 00010000:00010000:3.0:1746065152.313093:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 42 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.313101:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 42 pid: 9550 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746065152.313107:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c528e00 00000100:00100000:2.0:1746065152.316544:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263348224:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.320021:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263348352:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065152.320293:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.320370:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263348480:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.320397:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->2559999] (req 2097152->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 51 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.320410:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:2.0:1746065152.320446:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+51:32297:x1830881263555968:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10240us (10287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.320449:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.320454:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13247 00000100:00100000:1.0:1746065152.320538:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263556224 00000100:00100000:1.0:1746065152.320548:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263556224 00010000:00010000:1.0:1746065152.320570:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 51 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.320671:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263556096 00000100:00100000:1.0:1746065152.320673:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263556096 00010000:00010000:1.0:1746065152.320683:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 10 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065152.320831:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5988 00000100:00100000:3.0:1746065152.320841:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5989 00000100:00100000:3.0:1746065152.320846:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263556096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.320857:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.320873:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 10 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.320882:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 10 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.320899:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d000/0xad6b7ddc146f770 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933964 expref: 10 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.320924:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.320939:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263556096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.320944:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5989 00000100:00100000:3.0:1746065152.320959:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881263556224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.320964:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.320970:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 51 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.320977:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 51 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.320987:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2000/0xad6b7ddc146f715 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93391e expref: 51 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.320994:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.321004:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881263556224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 167us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.321009:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5988 00000100:00100000:0.0:1746065152.323638:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.324932:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.325894:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263556352 00000100:00100000:1.0:1746065152.325904:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263556352 00010000:00010000:1.0:1746065152.325947:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 42 pid: 9550 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.325973:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263556480 00000100:00100000:1.0:1746065152.325976:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263556480 00010000:00010000:1.0:1746065152.325985:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 25 pid: 9548 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.327052:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5990 00000100:00100000:2.0:1746065152.327061:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5991 00000100:00100000:1.0:1746065152.327063:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a850e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263556352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065152.327068:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263556480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.327075:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.327075:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.327092:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 25 pid: 9548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.327092:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 42 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.327102:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 25 pid: 9548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.327102:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 42 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.327121:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c600/0xad6b7ddc146f74d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933941 expref: 25 pid: 9548 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.327121:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146f746 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1409024->1708031) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93393a expref: 42 pid: 9550 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.327135:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.327135:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.327137:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.327137:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.327142:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 49 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.327142:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.327149:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 49 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.327149:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.327174:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 49 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.327174:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.327183:0:10893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.327184:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263348736:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065152.327190:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263348608:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065152.327269:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065152.327555:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.330673:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263348736:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065152.330695:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.330771:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263556480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3699us (5837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.330811:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5991 00000100:00100000:0.0:1746065152.332151:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.332259:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263348608:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065152.332271:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.332299:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a850e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263556352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5238us (8666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.332306:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5990 00000100:00100000:2.0:1746065152.332349:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263556736 00000100:00100000:2.0:1746065152.332356:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263556736 00002000:00100000:2.0:1746065152.332386:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097f52a00 x1830881263556736/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.332395:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52a00 with x1830881263556736 ext(1048576->2097151) 00010000:00010000:2.0:1746065152.332402:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.332414:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746065152.332420:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097f52a00 00000100:00100000:2.0:1746065152.332435:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1315 00000100:00100000:2.0:1746065152.332441:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263556736:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065152.340423:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.341042:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263556992 00000100:00100000:1.0:1746065152.341050:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263556992 00002000:00100000:1.0:1746065152.341087:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2555904->2559999) req@ffff880097f50e00 x1830881263556992/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.341096:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50e00 with x1830881263556992 ext(2555904->2559999) 00002000:00010000:1.0:1746065152.341100:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f50e00 00000100:00100000:1.0:1746065152.341125:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3780 00000100:00100000:1.0:1746065152.341131:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263556992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065152.341249:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881263556992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 117us (1097us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065152.341255:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3780 00002000:00100000:1.0:1746065152.341260:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2555904->2559999) req@ffff880097f50e00 x1830881263556992/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.341266:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50e00 with x1830881263556992 ext(2555904->2559999) 00002000:00010000:1.0:1746065152.341268:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f50e00 00000100:00100000:2.0:1746065152.342742:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263556736:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10297us (10590us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065152.342751:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1315 00002000:00100000:2.0:1746065152.342757:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097f52a00 x1830881263556736/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.342764:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52a00 with x1830881263556736 ext(1048576->2097151) 00010000:00010000:2.0:1746065152.342792:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.342810:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746065152.342816:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097f52a00 00000100:00100000:0.0:1746065152.359748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.359812:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263557120 00000100:00100000:1.0:1746065152.359819:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263557120 00000100:00100000:0.0:1746065152.359821:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065152.359848:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.359978:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263557248 00000100:00100000:2.0:1746065152.359982:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263557248 00000100:00100000:2.0:1746065152.360634:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13248 00000100:00100000:2.0:1746065152.360642:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+24:32305:x1830881263557248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065152.360656:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.360668:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a05 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.360688:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 49 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.360694:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065152.360696:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065152.360700:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.360721:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 49 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.360729:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 49 pid: 3068 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.360743:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263348864:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.360857:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065152.361343:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5992 00000100:00100000:1.0:1746065152.361351:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263557120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.361361:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.361376:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.361390:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.361404:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc146f83b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e9 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.361416:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.361417:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.361422:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.361428:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.361445:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.361452:0:10893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.361458:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263348992:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065152.361480:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.362623:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.362653:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263557376 00000100:00100000:0.0:1746065152.362658:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263557376 00002000:00100000:0.0:1746065152.362686:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1843200->2097151) req@ffff880097f53100 x1830881263557376/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.362694:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53100 with x1830881263557376 ext(1843200->2097151) 00010000:00010000:0.0:1746065152.362699:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 50 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.362709:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 50 pid: 3068 timeout: 848 lvb_type: 0 00002000:00010000:0.0:1746065152.362714:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097f53100 00000100:00100000:0.0:1746065152.362730:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1316 00000100:00100000:0.0:1746065152.362736:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881263557376:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065152.362908:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263348864:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.367334:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 25 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.367350:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4a00, rc 0) 00000100:00100000:0.0:1746065152.370501:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+25:32305:x1830881263557248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9849us (10669us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.370512:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13248 00000100:00100000:2.0:1746065152.371048:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.371072:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263557632 00000100:00100000:2.0:1746065152.371079:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263557632 00002000:00100000:2.0:1746065152.371108:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1060864->1064959) req@ffff880097fa1f80 x1830881263557632/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.371117:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1f80 with x1830881263557632 ext(1060864->1064959) 00010000:00010000:2.0:1746065152.371126:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.371137:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746065152.371143:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa1f80 00000100:00100000:2.0:1746065152.371164:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1317 00000100:00100000:2.0:1746065152.371169:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263557632:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065152.371273:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263557632:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 104us (227us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065152.371279:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1317 00002000:00100000:2.0:1746065152.371284:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1060864->1064959) req@ffff880097fa1f80 x1830881263557632/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.371290:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1f80 with x1830881263557632 ext(1060864->1064959) 00010000:00010000:2.0:1746065152.371294:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.371301:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746065152.371305:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa1f80 00000100:00100000:0.0:1746065152.371333:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263348992:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065152.371483:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065152.371696:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263557120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10344us (11954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.371704:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5992 00000100:00100000:3.0:1746065152.375050:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881263557376:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 12306us (12423us total) trans 21474840916 rc 0/0 00000100:00100000:3.0:1746065152.375060:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1316 00002000:00100000:3.0:1746065152.375069:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1843200->2097151) req@ffff880097f53100 x1830881263557376/t21474840916(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/448 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.375078:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53100 with x1830881263557376 ext(1843200->2097151) 00010000:00010000:3.0:1746065152.375086:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 52 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.375098:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 52 pid: 3068 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746065152.375104:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097f53100 00000100:00100000:0.0:1746065152.378193:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.378280:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263557760 00000100:00100000:2.0:1746065152.378286:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263557760 00010000:00010000:2.0:1746065152.378312:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 52 pid: 3068 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.378713:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5993 00000100:00100000:2.0:1746065152.378722:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881263557760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.378735:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.378750:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 52 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.378760:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 52 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.378809:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc146f834 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339e2 expref: 52 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.378829:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.378831:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.378837:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.378848:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.378875:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.378884:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263349120:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065152.378968:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.379425:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.380073:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263558016 00000100:00100000:3.0:1746065152.380079:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263558016 00002000:00100000:3.0:1746065152.380106:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1703936->1708031) req@ffff880097f51180 x1830881263558016/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.380115:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51180 with x1830881263558016 ext(1703936->1708031) 00010000:00010000:3.0:1746065152.380122:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.380131:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746065152.380136:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097f51180 00000100:00100000:3.0:1746065152.380160:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1318 00000100:00100000:3.0:1746065152.380166:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263558016:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065152.380273:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263558016:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 106us (847us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065152.380279:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1318 00002000:00100000:3.0:1746065152.380284:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1703936->1708031) req@ffff880097f51180 x1830881263558016/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.380290:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51180 with x1830881263558016 ext(1703936->1708031) 00010000:00010000:3.0:1746065152.380294:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.380303:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746065152.380308:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097f51180 00000100:00100000:1.0:1746065152.385530:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.385616:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263349120:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065152.385632:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.385672:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881263557760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6951us (7486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.385680:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5993 00000100:00100000:3.0:1746065152.385749:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263558272 00000100:00100000:3.0:1746065152.385754:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263558272 00002000:00100000:3.0:1746065152.385794:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091a90000 x1830881263558272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.385802:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90000 with x1830881263558272 ext(1048576->2097151) 00002000:00010000:3.0:1746065152.385806:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90000 00000100:00100000:3.0:1746065152.385818:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3781 00000100:00100000:3.0:1746065152.385822:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263558272:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065152.390057:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.390120:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263558528 00000100:00100000:2.0:1746065152.390129:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263558528 00002000:00100000:2.0:1746065152.390169:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1060864->1708031) req@ffff880097f50380 x1830881263558528/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.390179:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50380 with x1830881263558528 ext(1060864->1708031) 00010000:00010000:2.0:1746065152.390187:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.390200:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746065152.390211:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097f50380 00000100:00100000:2.0:1746065152.390495:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1319 00000100:00100000:2.0:1746065152.390502:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263558528:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065152.394205:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263558272:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8223us (8523us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065152.394216:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3781 00002000:00100000:3.0:1746065152.394226:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091a90000 x1830881263558272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.394234:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90000 with x1830881263558272 ext(1048576->2097151) 00002000:00010000:3.0:1746065152.394239:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90000 00000100:00100000:0.0:1746065152.403669:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.403738:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263558656 00000100:00100000:1.0:1746065152.403748:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263558656 00000100:00100000:1.0:1746065152.403825:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13249 00000100:00100000:1.0:1746065152.403833:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+25:32305:x1830881263558656:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065152.403834:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881263558528:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13331us (13785us total) trans 17179873463 rc 0/0 00000100:00100000:2.0:1746065152.403841:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1319 00010000:00010000:1.0:1746065152.403848:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746065152.403851:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1060864->1708031) req@ffff880097f50380 x1830881263558528/t17179873463(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/448 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.403859:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50380 with x1830881263558528 ext(1060864->1708031) 00010000:00010000:1.0:1746065152.403861:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a0c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.403865:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 24 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.403875:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 24 pid: 9549 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746065152.403880:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097f50380 00010000:00010000:1.0:1746065152.403883:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 50 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.403889:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065152.403890:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065152.403894:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.403925:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 50 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.403934:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 50 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.403948:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263349248:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.404243:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cde40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.409561:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.409607:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.409904:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263349248:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065152.409943:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.409959:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46c00, rc 0) 00000100:00100000:2.0:1746065152.409964:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263558912 00000100:00100000:2.0:1746065152.409971:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263558912 00010000:00010000:2.0:1746065152.409996:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 24 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.410008:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ccc4a269-0136-4970-860c-c944630694a4+26:32305:x1830881263558656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6174us (6345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.410019:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5994 00000100:00100000:2.0:1746065152.410025:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263558912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.410038:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.410054:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 24 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.410057:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263558784 00000100:00100000:3.0:1746065152.410061:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263558784 00010000:00010000:2.0:1746065152.410064:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 24 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.410082:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5c00/0xad6b7ddc146f842 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1708031) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f0 expref: 24 pid: 9549 timeout: 848 lvb_type: 0 00002000:00100000:3.0:1746065152.410084:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2559999) req@ffff880097f52680 x1830881263558784/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746065152.410096:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746065152.410097:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52680 with x1830881263558784 ext(2097152->2559999) 00010000:00010000:2.0:1746065152.410097:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.410102:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 51 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.410112:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 51 pid: 1880 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746065152.410118:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097f52680 00000100:00100000:3.0:1746065152.410135:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1320 00000100:00100000:3.0:1746065152.410141:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881263558784:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065152.410285:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13249 00010000:00010000:2.0:1746065152.410400:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.410409:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.410432:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.410442:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263349376:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065152.410496:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.415656:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881263558784:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 5508us (6041us total) trans 21474840917 rc 0/0 00000100:00100000:3.0:1746065152.415666:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1320 00002000:00100000:3.0:1746065152.415675:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2559999) req@ffff880097f52680 x1830881263558784/t21474840917(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/448 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.415684:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f52680 with x1830881263558784 ext(2097152->2559999) 00010000:00010000:3.0:1746065152.415693:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 53 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.415706:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 53 pid: 1880 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746065152.415712:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097f52680 00000001:00080000:0.0:1746065152.420742:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840917 is committed 00000001:00080000:0.0:1746065152.420758:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840915 is committed 00000001:00080000:0.0:1746065152.420847:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840895 is committed 00000100:00100000:2.0:1746065152.421045:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.421078:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263559040 00000100:00100000:2.0:1746065152.421085:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263559040 00010000:00010000:2.0:1746065152.421111:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 25 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.421138:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5995 00000100:00100000:2.0:1746065152.421145:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263559040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.421155:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.421172:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 25 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.421182:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 25 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.421201:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc146f850 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3039231] (req 2097152->2559999) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339fe expref: 25 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.421216:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.421218:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.421224:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.421232:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.421259:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.421270:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263349504:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065152.421338:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.421700:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263349376:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065152.421713:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.421732:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263558912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11707us (12180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.421739:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5994 00000100:00100000:2.0:1746065152.423976:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.424023:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263559296 00000100:00100000:3.0:1746065152.424029:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263559296 00002000:00100000:3.0:1746065152.424057:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88008c528700 x1830881263559296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.424067:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528700 with x1830881263559296 ext(1048576->2097151) 00002000:00010000:3.0:1746065152.424070:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c528700 00000100:00100000:3.0:1746065152.424084:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3782 00000100:00100000:3.0:1746065152.424088:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263559296:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065152.426166:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263349504:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065152.426183:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.426559:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881263559040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5413us (5516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.426567:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5995 00000100:00100000:3.0:1746065152.434899:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263559296:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10803us (10922us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065152.434909:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3782 00002000:00100000:3.0:1746065152.434926:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88008c528700 x1830881263559296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.434934:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528700 with x1830881263559296 ext(1048576->2097151) 00002000:00010000:3.0:1746065152.434939:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c528700 00000100:00100000:0.0:1746065152.441474:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.441636:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263559552 00000100:00100000:3.0:1746065152.441645:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263559552 00002000:00100000:3.0:1746065152.441684:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880098dd8a80 x1830881263559552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.441693:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8a80 with x1830881263559552 ext(2097152->4194303) 00002000:00010000:3.0:1746065152.441698:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8a80 00000100:00100000:3.0:1746065152.442023:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3783 00000100:00100000:3.0:1746065152.442031:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263559552:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065152.442184:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.442460:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263559680 00000100:00100000:0.0:1746065152.442464:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263559680 00000100:00100000:0.0:1746065152.442678:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13250 00000100:00100000:0.0:1746065152.442686:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+20:32300:x1830881263559680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065152.442695:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.442707:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a13 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.442723:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.442724:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.442730:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.442742:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.442750:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31a00, rc 0) 00000100:00100000:0.0:1746065152.442812:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+21:32300:x1830881263559680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 127us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.442818:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13250 00000100:00100000:0.0:1746065152.457833:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.458116:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263559936 00000100:00100000:2.0:1746065152.458125:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263559936 00002000:00100000:2.0:1746065152.458161:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098dd8e00 x1830881263559936/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.458170:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8e00 with x1830881263559936 ext(1048576->2097151) 00002000:00010000:2.0:1746065152.458176:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8e00 00000100:00100000:3.0:1746065152.459063:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3784 00000100:00100000:3.0:1746065152.459072:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263559936:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065152.466727:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263559552:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24687us (25251us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065152.466737:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3783 00002000:00100000:3.0:1746065152.466747:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880098dd8a80 x1830881263559552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.466755:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8a80 with x1830881263559552 ext(2097152->4194303) 00002000:00010000:3.0:1746065152.466760:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8a80 00000100:00100000:3.0:1746065152.468717:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263559936:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9639us (10884us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065152.468726:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3784 00002000:00100000:3.0:1746065152.468733:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880098dd8e00 x1830881263559936/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065152.468741:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8e00 with x1830881263559936 ext(1048576->2097151) 00002000:00010000:3.0:1746065152.468745:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8e00 00000100:00100000:0.0:1746065152.476140:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.476207:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263560064 00000100:00100000:2.0:1746065152.476215:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263560064 00000100:00100000:2.0:1746065152.476399:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13251 00000100:00100000:2.0:1746065152.476407:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+21:32300:x1830881263560064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065152.476423:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065152.476426:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065152.476439:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a1a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.476451:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263560192 00000100:00100000:0.0:1746065152.476454:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263560192 00010000:00010000:2.0:1746065152.476459:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.476460:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.476467:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.476474:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13252 00000100:00100000:0.0:1746065152.476479:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263560192:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065152.476480:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.476486:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.476489:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2ca00, rc 0) 00010000:00010000:0.0:1746065152.476494:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a21 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.476509:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.476511:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.476515:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.476524:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.476530:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31400, rc 0) 00000100:00100000:2.0:1746065152.476536:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+22:32300:x1830881263560064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 129us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.476542:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13251 00000100:00100000:0.0:1746065152.476544:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2004:x1830881263560192:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.476549:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13252 00000100:00100000:0.0:1746065152.480387:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.480426:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.480470:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.480509:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263560704 00000100:00100000:0.0:1746065152.480516:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263560704 00002000:00100000:0.0:1746065152.480553:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880098dd9c00 x1830881263560704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.480562:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9c00 with x1830881263560704 ext(4194304->5021695) 00002000:00010000:0.0:1746065152.480567:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd9c00 00000100:00100000:0.0:1746065152.480580:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263560832 00000100:00100000:0.0:1746065152.480582:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263560832 00002000:00100000:0.0:1746065152.480592:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3039231) req@ffff880098dd9880 x1830881263560832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.480598:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9880 with x1830881263560832 ext(2097152->3039231) 00002000:00010000:0.0:1746065152.480601:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd9880 00000100:00100000:3.0:1746065152.480671:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263560320 00000100:00100000:3.0:1746065152.480674:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263560320 00000100:00100000:3.0:1746065152.480694:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13253 00000100:00100000:3.0:1746065152.480700:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+23:32309:x1830881263560320:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065152.480712:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.480723:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a28 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.480745:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 8 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.480752:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.480757:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.480759:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.480761:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1486848->1679359] (req 1486848->1679359) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.480803:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.480811:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 24 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.480819:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263349632:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.480884:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 8 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.480895:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 8 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.480901:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263349760:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.480929:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065152.481066:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3785 00000100:00100000:0.0:1746065152.481072:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263560704:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065152.481868:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3786 00000100:00100000:3.0:1746065152.481876:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881263560832:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065152.494402:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263349632:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.494413:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263349760:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.494440:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1486848->1679359] (req 1486848->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.494454:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489400, rc 0) 00000100:00100000:2.0:1746065152.494486:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.494805:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+25:32309:x1830881263560320:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 14099us (14421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.494813:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13253 00000100:00100000:3.0:1746065152.494837:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263560960 00000100:00100000:3.0:1746065152.494841:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263560960 00010000:00010000:3.0:1746065152.494860:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 25 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.494870:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263560704:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13798us (14443us total) trans 0 rc 827392/827392 00000100:00100000:0.0:1746065152.494876:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3785 00000100:00100000:3.0:1746065152.494878:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5996 00002000:00100000:0.0:1746065152.494883:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880098dd9c00 x1830881263560704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065152.494884:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263560960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746065152.494891:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9c00 with x1830881263560704 ext(4194304->5021695) 00002000:00010000:0.0:1746065152.494894:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd9c00 00010000:00010000:3.0:1746065152.494895:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.494910:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 25 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.494929:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 25 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.494946:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31a00/0xad6b7ddc146f865 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a13 expref: 25 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.494958:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.494972:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263560960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 88us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.494977:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5996 00000100:00100000:2.0:1746065152.495076:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881263560832:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13201us (14605us total) trans 0 rc 942080/942080 00000100:00100000:2.0:1746065152.495081:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3786 00002000:00100000:2.0:1746065152.495086:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3039231) req@ffff880098dd9880 x1830881263560832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/440 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 942080/942080 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.495093:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9880 with x1830881263560832 ext(2097152->3039231) 00002000:00010000:2.0:1746065152.495096:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd9880 00000100:00100000:0.0:1746065152.495815:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.495869:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263561088 00000100:00100000:3.0:1746065152.495872:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263561088 00010000:00010000:3.0:1746065152.495885:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 8 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.495899:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5997 00000100:00100000:3.0:1746065152.495903:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263561088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.495909:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.495929:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 8 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.495942:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 8 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.495954:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4a00/0xad6b7ddc146f857 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a05 expref: 8 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.495962:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.495964:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.495970:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.495977:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.496001:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.496010:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263349888:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065152.496606:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.498904:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263349888:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065152.498936:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.498977:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263561088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3072us (3162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.498987:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5997 00000100:00100000:0.0:1746065152.500042:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.500254:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263561344 00000100:00100000:2.0:1746065152.500263:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263561344 00002000:00100000:2.0:1746065152.500302:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1486848->1490943) req@ffff880098ddaa00 x1830881263561344/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.500310:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddaa00 with x1830881263561344 ext(1486848->1490943) 00002000:00010000:2.0:1746065152.500314:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098ddaa00 00000100:00100000:2.0:1746065152.500331:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3787 00000100:00100000:2.0:1746065152.500337:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263561344:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065152.500465:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263561344:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 127us (425us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065152.500470:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3787 00002000:00100000:2.0:1746065152.500476:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1486848->1490943) req@ffff880098ddaa00 x1830881263561344/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065152.500483:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddaa00 with x1830881263561344 ext(1486848->1490943) 00002000:00010000:2.0:1746065152.500485:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098ddaa00 00000100:00100000:2.0:1746065152.501472:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.501535:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263561472 00000100:00100000:3.0:1746065152.501541:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263561472 00000100:00100000:3.0:1746065152.501571:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13254 00000100:00100000:3.0:1746065152.501577:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263561472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065152.501588:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.501603:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f881 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a2f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.501645:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263350016:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065152.502649:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746065152.504873:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065151 -> 1746065152 00000100:00100000:3.0:1746065152.504892:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263350016:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065152.504926:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f881 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a2f expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.504937:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f881 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a2f expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.504948:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488a00, rc 0) 00000100:00100000:3.0:1746065152.504989:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263561472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3411us (3519us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065152.504996:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13254 00000100:00100000:0.0:1746065152.505340:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.505438:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263561728 00000100:00100000:1.0:1746065152.505444:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263561728 00002000:00100000:1.0:1746065152.505478:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1675264->1679359) req@ffff880098dd9f80 x1830881263561728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.505486:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9f80 with x1830881263561728 ext(1675264->1679359) 00002000:00010000:1.0:1746065152.505490:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd9f80 00000100:00100000:1.0:1746065152.505511:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3788 00000100:00100000:1.0:1746065152.505517:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263561728:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065152.506828:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263561728:12345-192.168.202.27@tcp:3:cat.0 Request processed in 1306us (1484us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065152.506835:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3788 00002000:00100000:1.0:1746065152.506842:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1675264->1679359) req@ffff880098dd9f80 x1830881263561728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746065163 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065152.506849:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9f80 with x1830881263561728 ext(1675264->1679359) 00002000:00010000:1.0:1746065152.506852:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd9f80 00000100:00100000:0.0:1746065152.507856:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.507935:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263561856 00000100:00100000:3.0:1746065152.507940:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263561856 00000100:00100000:3.0:1746065152.508089:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13255 00000100:00100000:3.0:1746065152.508096:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263561856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065152.508109:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.508122:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f888 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a36 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.508162:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263350144:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065152.509408:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.510937:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263350144:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065152.510965:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f888 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a36 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.510976:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc146f888 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a36 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.510985:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488800, rc 0) 00000100:00100000:3.0:1746065152.511019:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2004:x1830881263561856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2922us (3163us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065152.511026:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13255 00000100:00100000:0.0:1746065152.613257:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.613322:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263561984 00000100:00100000:2.0:1746065152.613331:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263561984 00000100:00100000:2.0:1746065152.613384:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13650 00000100:00100000:2.0:1746065152.613392:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+24:32314:x1830881263561984:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065152.613416:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.613431:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146f88f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a3d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.613480:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.613491:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.613498:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.613508:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.613512:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.613517:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.613565:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.613573:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 53 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.613580:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.613590:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.613614:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.613623:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 32 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.613633:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263350272:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.613726:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 53 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.613733:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 53 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.613740:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263350400:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.613757:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.622419:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263350272:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.624467:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.627042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.627078:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263562240 00000100:00100000:1.0:1746065152.627086:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263562240 00000100:00100000:1.0:1746065152.627122:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263562496 00000100:00100000:1.0:1746065152.627124:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263562496 00000100:00100000:1.0:1746065152.627137:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4927 00000100:00100000:1.0:1746065152.627143:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+33:31231:x1830881263562240:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065152.627321:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+34:31231:x1830881263562240:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 178us (2860us total) trans 8589935983 rc 0/0 00000100:00100000:1.0:1746065152.627327:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4927 00000100:00100000:1.0:1746065152.627342:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4928 00000100:00100000:1.0:1746065152.627346:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+54:30399:x1830881263562496:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065152.627401:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+55:30399:x1830881263562496:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 53us (365us total) trans 8589935984 rc 0/0 00000100:00100000:1.0:1746065152.627405:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4928 00000100:00100000:2.0:1746065152.628580:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263350400:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.628604:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065152.631982:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.632068:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263562624 00000100:00100000:3.0:1746065152.632076:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263562624 00010000:00010000:3.0:1746065152.632110:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 55 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.632147:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5998 00000100:00100000:3.0:1746065152.632155:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+55:2007:x1830881263562624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.632168:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.632172:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 55 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.632185:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 55 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.632205:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc146f7f5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339b8 expref: 55 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.632656:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.632661:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.632669:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.632673:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.632677:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.632725:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881263562624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 571us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.632732:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5998 00000100:00100000:0.0:1746065152.639033:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.639152:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263562752 00000100:00100000:3.0:1746065152.639161:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263562752 00010000:00010000:3.0:1746065152.639191:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 34 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.639216:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5999 00000100:00100000:3.0:1746065152.639223:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+34:2005:x1830881263562752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.639235:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.639240:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 34 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.639250:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 34 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.639268:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc146f811 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339c6 expref: 34 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.639279:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.639283:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639291:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639296:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639321:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.639354:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+33:2005:x1830881263562752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 132us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.639360:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5999 00010000:00010000:3.0:1746065152.639403:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639409:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065152.639455:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065152.639459:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065152.639473:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639482:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639490:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639495:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639499:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639503:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639508:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065152.639511:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639516:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639523:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065152.639526:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065152.639528:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639532:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146f896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639541:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639545:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639550:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639553:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065152.639555:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639559:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639563:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098ce5300) 00010000:00010000:3.0:1746065152.639565:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065152.639567:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639571:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc146f89d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.639595:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146f88f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.639604:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 25 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.639610:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.639611:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065152.639613:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539600, rc 0) 00000100:00100000:3.0:1746065152.639632:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+25:32314:x1830881263561984:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 26242us (26384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.639637:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13650 00000100:00100000:0.0:1746065152.643319:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.643355:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.643370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.643393:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.643436:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263563008 00000100:00100000:0.0:1746065152.643445:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263563008 00000100:00100000:0.0:1746065152.643476:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263563264 00000100:00100000:0.0:1746065152.643477:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263563264 00000100:00100000:0.0:1746065152.643487:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263562880 00000100:00100000:0.0:1746065152.643488:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263562880 00000100:00100000:0.0:1746065152.643496:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263563136 00000100:00100000:0.0:1746065152.643498:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263563136 00000100:00100000:0.0:1746065152.643509:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13256 00000100:00100000:0.0:1746065152.643516:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2006:x1830881263563008:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065152.643532:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.643547:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a4b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.643565:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.643567:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.643574:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 9 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.643586:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 9 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.643595:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31800, rc 0) 00000100:00100000:0.0:1746065152.643629:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2006:x1830881263563008:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 115us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.643635:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13256 00000100:00100000:0.0:1746065152.643649:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13257 00000100:00100000:0.0:1746065152.643653:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263563264:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065152.643660:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.643667:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a59 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.643676:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.643677:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.643682:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.643689:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.643695:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30200, rc 0) 00000100:00100000:0.0:1746065152.643708:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263563264:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 54us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.643713:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13257 00000100:00100000:0.0:1746065152.643721:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13258 00000100:00100000:0.0:1746065152.643724:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263562880:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065152.643729:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.643735:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a44 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.643742:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.643743:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.643747:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.643753:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.643760:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31600, rc 0) 00000100:00100000:0.0:1746065152.643797:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263562880:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 48us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.643804:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13258 00000100:00100000:0.0:1746065152.643813:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13259 00000100:00100000:0.0:1746065152.643817:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263563136:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065152.643822:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065152.643827:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146f8c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a52 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.643858:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263350528:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065152.643909:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065152.645859:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263350528:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065152.645882:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146f8c0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a52 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.645893:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146f8c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a52 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.645905:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30e00, rc 0) 00000100:00100000:2.0:1746065152.646956:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263563136:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3133us (3557us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065152.646964:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13259 00000100:00100000:0.0:1746065152.652075:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.652242:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263563520 00000100:00100000:3.0:1746065152.652250:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263563520 00000100:00100000:3.0:1746065152.653305:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13651 00000100:00100000:3.0:1746065152.653316:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+25:32314:x1830881263563520:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065152.653334:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.653351:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f8c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a60 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.653437:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.653450:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.653455:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.653480:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.653488:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 26 pid: 7231 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.653498:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263350656:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.653569:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.661272:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263350656:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.661298:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065152.662900:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.663130:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263563648 00000100:00100000:3.0:1746065152.663137:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263563648 00010000:00010000:3.0:1746065152.663170:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 27 pid: 7231 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.665064:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6000 00000100:00100000:3.0:1746065152.665077:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+27:2005:x1830881263563648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.665094:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.665102:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 27 pid: 7231 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.665113:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 27 pid: 7231 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.665133:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f8a4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a3d expref: 27 pid: 7231 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.665147:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.665151:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.665160:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.665166:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.665186:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.665228:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+26:2005:x1830881263563648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 155us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.665234:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6000 00010000:00010000:3.0:1746065152.665265:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.665271:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065152.665285:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065152.665388:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc146f8c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a60 expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.665400:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a60 expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.665405:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.665408:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065152.665409:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488600, rc 0) 00000100:00100000:3.0:1746065152.665431:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+26:32314:x1830881263563520:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 12118us (13364us total) trans 8589935985 rc 0/0 00000100:00100000:3.0:1746065152.665437:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13651 00000100:00100000:3.0:1746065152.671401:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263350784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746065152.671454:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.671716:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350784 00000100:00100000:2.0:1746065152.671723:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350784 00000100:00080000:0.0:1746065152.671745:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065152.671758:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1746065152.671764:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881263350784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746065152.671803:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1138731328 pending 5390336 free 3910807552 avail 3679285248 00000100:00100000:2.0:1746065152.671836:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881263350784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.671842:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1746065152.672039:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263350784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065152.679688:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.682658:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263563904 00000100:00100000:3.0:1746065152.682670:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263563904 00000100:00100000:3.0:1746065152.682819:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13652 00000100:00100000:3.0:1746065152.682828:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+26:32314:x1830881263563904:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065152.682850:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.682852:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065152.682878:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488600/0xad6b7ddc146f8ce lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a60 expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.683257:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.683261:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065152.683272:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f8dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a67 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.683350:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146f8e3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.683361:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146f8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.683369:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146f8e3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065152.683379:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065152.683453:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f8dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a67 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.683464:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146f8e3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a67 expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.683470:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.683472:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065152.683473:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:3.0:1746065152.684208:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+27:32314:x1830881263563904:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1379us (4524us total) trans 8589935986 rc 0/0 00000100:00100000:3.0:1746065152.684216:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13652 00000100:00100000:0.0:1746065152.688050:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.688155:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263564032 00000100:00100000:3.0:1746065152.688162:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263564032 00000100:00100000:3.0:1746065152.688194:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13653 00000100:00100000:3.0:1746065152.688200:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+27:32314:x1830881263564032:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065152.688221:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.688237:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f8f1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a6e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.688281:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a6e expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.688291:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f8f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a6e expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.688304:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.688307:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065152.688309:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488a00, rc 0) 00000100:00100000:3.0:1746065152.688724:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+28:32314:x1830881263564032:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 522us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.688731:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13653 00000100:00100000:0.0:1746065152.690804:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.690835:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.690857:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.690868:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263564160 00000100:00100000:2.0:1746065152.690875:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263564160 00000100:00100000:1.0:1746065152.690895:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263564288 00000100:00100000:1.0:1746065152.690898:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263564288 00000100:00100000:2.0:1746065152.690910:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263564544 00000100:00100000:2.0:1746065152.690912:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263564544 00000100:00100000:1.0:1746065152.690925:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13260 00000100:00100000:1.0:1746065152.690931:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263564160:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065152.690935:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13261 00000100:00100000:2.0:1746065152.690938:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263564288:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065152.690958:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.690958:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.690972:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.690972:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.690978:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.690979:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 9 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.690985:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.690985:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 6 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.690990:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.690992:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.690994:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.690994:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.690995:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.690997:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.691015:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.691015:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 6 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.691025:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 23 pid: 13375 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.691025:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 6 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.691036:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263351040:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.691036:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263350912:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.691193:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13262 00000100:00100000:3.0:1746065152.691203:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263564544:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065152.691217:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.691225:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.691230:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065152.691234:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065152.691236:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.691249:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.691256:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.691263:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263351168:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065152.691307:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.691318:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263564800 00000100:00100000:0.0:1746065152.691321:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263564800 00010000:00010000:2.0:1746065152.691330:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065152.691338:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13263 00010000:00010000:2.0:1746065152.691339:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 10 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746065152.691342:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263564800:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065152.691346:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263351296:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.691355:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691364:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 40 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.691368:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.691375:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.691375:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065152.691382:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263351424:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.691382:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.691386:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.691387:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065152.691389:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.691393:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4840 going to sleep for 11 seconds 00010000:00010000:0.0:1746065152.691401:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.691407:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 23 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746065152.691414:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263351552:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.691434:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065152.691435:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.691443:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 10 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746065152.691445:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263564416 00000100:00100000:2.0:1746065152.691447:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263564416 00000100:00100000:0.0:1746065152.691450:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263351680:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.691461:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13264 00000100:00100000:2.0:1746065152.691465:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263564416:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065152.691470:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 40 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.691477:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 40 pid: 9549 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746065152.691478:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.691484:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263351808:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.691487:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 23 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.691493:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065152.691496:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe900 going to sleep for 11 seconds 00010000:00010000:2.0:1746065152.691500:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 40 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.691504:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.691506:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.691508:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.691520:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 40 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.691527:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 40 pid: 13375 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746065152.691533:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263351936:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065152.691544:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.691558:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263564672 00000100:00100000:0.0:1746065152.691561:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263564672 00000100:00100000:0.0:1746065152.691585:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13265 00000100:00100000:0.0:1746065152.691589:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263564672:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065152.691603:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691612:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 6 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691618:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.691624:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691631:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691636:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065152.691637:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065152.691639:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 7/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691652:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 21 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691659:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.691667:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263352064:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.691685:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691692:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 21 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.691698:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263352192:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.691716:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065152.691723:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 13 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746065152.691735:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263352320:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.691754:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 6 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.691761:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 6 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.691768:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263352448:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065152.691801:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065152.692305:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065152.692313:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 13 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746065152.692320:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263352576:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065152.692336:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.692342:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 21 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.692352:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263352704:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.692361:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.692522:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065152.693799:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.693811:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746065152.693821:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263352832:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.693863:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 23 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.693872:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 23 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.693880:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263352960:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.693897:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065152.694343:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263351040:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.694352:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263351424:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.697204:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.697308:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263564928 00000100:00100000:2.0:1746065152.697315:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263564928 00010000:00010000:2.0:1746065152.697344:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 24 pid: 13375 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746065152.697361:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263351552:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.697371:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6001 00000100:00100000:0.0:1746065152.697371:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263351680:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065152.697377:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263564928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.697386:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.697402:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 24 pid: 13375 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746065152.697412:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 24 pid: 13375 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746065152.697430:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc146f873 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a21 expref: 24 pid: 13375 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746065152.697445:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.697476:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263564928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.697482:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6001 00000100:00100000:3.0:1746065152.705255:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263351296:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.705285:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.710451:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263351808:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065152.710451:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263352064:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065152.710476:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.710479:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263352192:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.710499:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263352320:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.710506:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263352448:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065152.710509:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065152.710518:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.710538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.710558:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.710573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.710585:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.710595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.710626:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.710629:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263565440 00000100:00100000:1.0:1746065152.710634:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263565440 00000100:00100000:0.0:1746065152.710647:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263565696 00000100:00100000:0.0:1746065152.710649:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263565696 00010000:00010000:1.0:1746065152.710660:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 41 pid: 9549 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746065152.710660:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 22 pid: 1880 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.710673:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263565952 00000100:00100000:0.0:1746065152.710673:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263565184 00000100:00100000:1.0:1746065152.710675:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263565952 00000100:00100000:0.0:1746065152.710675:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263565184 00010000:00010000:1.0:1746065152.710682:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 7 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.710682:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 12 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746065152.710689:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263565824 00000100:00100000:0.0:1746065152.710689:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263565568 00000100:00100000:0.0:1746065152.710690:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263565568 00000100:00100000:1.0:1746065152.710691:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263565824 00010000:00010000:0.0:1746065152.710696:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 23 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.710698:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 14 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746065152.710703:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263566080 00000100:00100000:0.0:1746065152.710704:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263566080 00000100:00100000:1.0:1746065152.710707:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6002 00010000:00010000:0.0:1746065152.710710:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 23 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746065152.710712:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263565696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065152.710718:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6003 00000100:00100000:0.0:1746065152.710721:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263565440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.710723:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065152.710726:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.710738:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 23 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.710738:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 41 pid: 9549 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.710746:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 23 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.710746:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 41 pid: 9549 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.710762:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc146f86c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a1a expref: 23 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.710762:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00a00/0xad6b7ddc146f627 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933829 expref: 41 pid: 9549 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.710791:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065152.710796:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065152.710821:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263565440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.710826:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6003 00000100:00100000:0.0:1746065152.710841:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6004 00000100:00100000:0.0:1746065152.710845:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263565184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065152.710851:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065152.710859:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 12 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746065152.710866:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 12 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746065152.710874:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc146f8ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a4b expref: 12 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746065152.710881:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.710937:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6005 00000100:00100000:3.0:1746065152.710944:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a850ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263565952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.710951:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.710958:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 7 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.710966:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 7 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.710976:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46c00/0xad6b7ddc146f85e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a0c expref: 7 pid: 1880 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.710988:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.712087:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881263565696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1370us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.712092:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6002 00000100:00100000:1.0:1746065152.712105:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6006 00000100:00100000:1.0:1746065152.712110:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881263565568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.712116:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.712124:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.712131:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.712147:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc146f64a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3039232->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933861 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.712154:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.712166:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881263565568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.712170:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6006 00000100:00100000:1.0:1746065152.712176:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6007 00000100:00100000:1.0:1746065152.712180:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263565824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.712184:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.712188:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 14 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.712195:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 14 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.712202:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30200/0xad6b7ddc146f8b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a59 expref: 14 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.712208:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.712209:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.712213:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712219:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712234:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.712244:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263565824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.712248:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6007 00000100:00100000:1.0:1746065152.712257:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6008 00000100:00100000:1.0:1746065152.712260:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263566080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.712265:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.712272:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 23 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.712278:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 23 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.712286:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc146f643 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933853 expref: 23 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.712292:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.712301:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263566080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.712305:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6008 00010000:00010000:1.0:1746065152.712319:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712325:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712340:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712347:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712352:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712357:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065152.712360:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712366:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712373:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.712377:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc146f91b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.712404:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263564672:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 20815us (20860us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.712410:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13265 00000100:00100000:0.0:1746065152.713691:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263565184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2840us (3111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.713698:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6004 00000100:00100000:3.0:1746065152.715285:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a850ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+6:2006:x1830881263565952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4334us (4718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.715295:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6005 00000100:00100000:1.0:1746065152.716084:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.716108:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.716112:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263565056 00000100:00100000:3.0:1746065152.716120:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263565056 00000100:00100000:1.0:1746065152.716123:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.716138:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065152.716145:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.716149:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263566336 00000100:00100000:1.0:1746065152.716151:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263566336 00000100:00100000:3.0:1746065152.716161:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263566208 00000100:00100000:3.0:1746065152.716163:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263566208 00010000:00010000:3.0:1746065152.716170:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 21 pid: 9549 timeout: 848 lvb_type: 0 00002000:00100000:1.0:1746065152.716175:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1486848->1679359) req@ffff88011dad7800 x1830881263566336/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/0 e 0 to 0 dl 1746065163 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065152.716180:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263565312 00000100:00100000:3.0:1746065152.716182:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263565312 00002000:00100000:1.0:1746065152.716183:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7800 with x1830881263566336 ext(1486848->1679359) 00010000:00010000:3.0:1746065152.716189:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.716189:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.716197:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746065152.716204:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011dad7800 00000100:00100000:3.0:1746065152.716206:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6009 00000100:00100000:3.0:1746065152.716212:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263565056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065152.716218:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6010 00000100:00100000:1.0:1746065152.716221:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263566208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.716222:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.716227:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.716235:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.716236:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 21 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.716244:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.716244:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 21 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.716259:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xad6b7ddc146f849 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339f7 expref: 40 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.716261:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065152.716268:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.716269:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.716272:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.716279:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.716282:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263566208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.716289:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6010 00010000:00010000:3.0:1746065152.716294:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.716299:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6011 00000100:00100000:1.0:1746065152.716303:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263565312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065152.716306:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263565056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (224us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065152.716308:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065152.716310:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6009 00010000:00010000:1.0:1746065152.716314:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746065152.716322:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.716326:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716331:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc146f777 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93396b expref: 11 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.716332:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716338:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.716339:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065152.716341:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.716343:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716347:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.716353:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716358:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065152.716360:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.716365:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538800 already unused, calling callback (ffffffffa086fd70) 00000100:00100000:1.0:1746065152.716368:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263565312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (244us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065152.716369:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.716372:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6011 00010000:00010000:3.0:1746065152.716375:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.716383:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.716387:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc146f8ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716396:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716402:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716411:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.716416:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263564288:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 25477us (25580us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065152.716416:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.716422:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13261 00010000:00010000:1.0:1746065152.716422:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716426:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065152.716429:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716434:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716441:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.716445:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30e00/0xad6b7ddc146f90d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.716447:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263351168:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.716461:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065152.716468:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263564800:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 25125us (25161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.716473:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13263 00000100:00100000:1.0:1746065152.716488:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1321 00000100:00100000:1.0:1746065152.716492:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881263566336:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065152.716537:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263351936:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.716553:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc146f81f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339cd expref: 20 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746065152.716585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.716631:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.716641:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263566464 00000100:00100000:0.0:1746065152.716642:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263566720 00000100:00100000:1.0:1746065152.716643:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263566464 00000100:00100000:0.0:1746065152.716645:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263566720 00010000:00010000:1.0:1746065152.716653:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 39 pid: 13375 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746065152.716654:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.717120:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263352704:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.717415:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6012 00000100:00100000:1.0:1746065152.717422:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263566464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.717429:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065152.717437:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 39 pid: 13375 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746065152.717437:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6013 00000100:00100000:0.0:1746065152.717442:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263566720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065152.717445:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 39 pid: 13375 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746065152.717447:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065152.717452:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.717455:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146f6dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338e6 expref: 39 pid: 13375 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746065152.717459:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 22 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746065152.717464:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065152.717468:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065152.717479:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263566464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.717479:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263566720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 37us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.717484:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6013 00000100:00100000:1.0:1746065152.717486:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6012 00000100:00100000:0.0:1746065152.717523:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263352832:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.717531:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc146f6ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9338c3 expref: 21 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746065152.717538:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263352960:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065152.717551:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.719510:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.720086:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263566592 00000100:00100000:3.0:1746065152.720092:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263566592 00010000:00010000:3.0:1746065152.720118:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 8 pid: 9548 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065152.720150:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6014 00000100:00100000:3.0:1746065152.720156:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263566592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.720165:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.720179:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 8 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.720188:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 8 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.720204:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9d800/0xad6b7ddc146f762 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933956 expref: 8 pid: 9548 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.720215:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.720217:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.720220:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.720227:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.720250:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.720287:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2004:x1830881263566592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 130us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.720293:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6014 00010000:00010000:0.0:1746065152.720380:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.720391:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.720404:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.720411:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.720417:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.720423:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a6cd600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065152.720426:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.720433:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.720443:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065152.720448:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc146f914 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065152.720499:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2004:x1830881263564416:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 29032us (29063us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.720506:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13264 00000100:00100000:1.0:1746065152.725055:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.725094:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.725114:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263566848 00000100:00100000:3.0:1746065152.725121:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263566848 00010000:00010000:3.0:1746065152.725148:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 6 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.725176:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263566976 00000100:00100000:3.0:1746065152.725179:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263566976 00010000:00010000:3.0:1746065152.725187:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 12 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746065152.725202:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6015 00000100:00100000:3.0:1746065152.725208:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+6:2005:x1830881263566848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.725218:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.725234:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 6 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.725243:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 6 pid: 9549 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.725262:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.725292:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+6:2005:x1830881263566848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.725310:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6015 00000100:00100000:3.0:1746065152.725323:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6016 00000100:00100000:3.0:1746065152.725328:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263566976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.725334:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.725341:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 12 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.725348:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 12 pid: 1880 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746065152.725358:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.725360:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.725364:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.725371:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.725385:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.725398:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263566976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.725403:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6016 00010000:00010000:2.0:1746065152.725666:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc146f82d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9339db expref: 5 pid: 9549 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.727044:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263350912:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.727064:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc146f8b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a44 expref: 11 pid: 1880 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746065152.727073:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263352576:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.727092:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727099:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727105:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727120:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727126:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727131:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727141:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065152.727145:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727151:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727162:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.727167:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc146f8f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.727227:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263564160:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 36295us (36454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.727235:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13260 00000100:00100000:0.0:1746065152.730250:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263566336:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13749us (14103us total) trans 21474840918 rc 0/0 00000100:00100000:0.0:1746065152.730262:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1321 00002000:00100000:0.0:1746065152.730271:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1486848->1679359) req@ffff88011dad7800 x1830881263566336/t21474840918(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:68/0 lens 488/448 e 0 to 0 dl 1746065163 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065152.730279:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7800 with x1830881263566336 ext(1486848->1679359) 00010000:00010000:0.0:1746065152.730288:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.730301:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00002000:00010000:0.0:1746065152.730307:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011dad7800 00000100:00100000:0.0:1746065152.736231:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.736499:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263567104 00000100:00100000:2.0:1746065152.736508:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263567104 00010000:00010000:2.0:1746065152.736543:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.736627:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6017 00000100:00100000:2.0:1746065152.736636:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881263567104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.736649:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.736665:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.736676:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.736695:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489400/0xad6b7ddc146f87a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1679359) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a28 expref: 21 pid: 3068 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.736707:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.736709:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.736713:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.736721:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.737956:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065152.737980:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.737988:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.738001:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881263567104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1365us (1775us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065152.738005:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065152.738007:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6017 00010000:00010000:3.0:1746065152.738015:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.738021:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.738027:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065152.738030:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.738037:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.738046:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.738052:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc146f906 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065152.738104:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263564544:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 46901us (47245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.738112:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13262 00000100:00100000:1.0:1746065152.740259:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.741113:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263567360 00000100:00100000:3.0:1746065152.741121:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263567360 00000100:00100000:3.0:1746065152.741161:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13654 00000100:00100000:3.0:1746065152.741271:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+28:32314:x1830881263567360:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:3.0:1746065152.741308:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.741329:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc146f8f1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a6e expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741342:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.741345:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065152.741365:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.741376:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 53 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741382:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741389:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 53 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741394:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741400:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065152.741424:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741434:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 32 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.741449:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263353088:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.741537:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 53 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741545:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 53 pid: 7203 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.741552:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263353216:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.741575:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741582:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 32 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.741587:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263353344:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065152.741606:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 53 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065152.741613:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 53 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.741618:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263353472:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.741630:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065152.744204:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.744219:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263353088:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065152.744229:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263353216:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065152.744304:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.744334:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263567616 00000100:00100000:2.0:1746065152.744340:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263567616 00000100:00100000:1.0:1746065152.744344:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.744378:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4929 00000100:00100000:2.0:1746065152.744384:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+33:30397:x1830881263567616:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065152.744431:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065152.744488:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263567744 00000100:00100000:3.0:1746065152.744491:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263567744 00010000:00010000:3.0:1746065152.744508:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 54 pid: 7203 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.744523:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263568000 00000100:00100000:3.0:1746065152.744525:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263568000 00010000:00010000:3.0:1746065152.744532:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 55 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.744535:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+34:30397:x1830881263567616:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 151us (340us total) trans 8589935987 rc 0/0 00000100:00100000:2.0:1746065152.744541:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4929 00000100:00100000:3.0:1746065152.744542:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263567872 00000100:00100000:3.0:1746065152.744544:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263567872 00010000:00010000:3.0:1746065152.744549:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 35 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746065152.744559:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6018 00000100:00100000:3.0:1746065152.744562:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+55:2007:x1830881263567744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065152.744569:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.744574:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 55 pid: 7203 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.744582:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 55 pid: 7203 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.744584:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6019 00000100:00100000:2.0:1746065152.744590:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+55:2004:x1830881263568000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.744594:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065152.744597:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc146ed4b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933280 expref: 55 pid: 7203 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.744597:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 55 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.744604:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 54 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.744609:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065152.744612:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065152.744643:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6020 00000100:00100000:0.0:1746065152.744652:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+34:2005:x1830881263567872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065152.744657:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065152.744660:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 34 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746065152.744891:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065152.744897:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065152.744900:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.744905:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065152.744910:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881263567744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 347us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.744926:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6018 00000100:00100000:2.0:1746065152.744931:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881263568000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 341us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.744935:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6019 00000100:00100000:2.0:1746065152.744958:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263353344:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.744966:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc146ee0f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332cd expref: 52 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.744975:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263353472:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065152.744992:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065152.745048:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 34 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.745060:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc146eea9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93331a expref: 34 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746065152.745084:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065152.745087:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065152.745092:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065152.745108:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+33:2005:x1830881263567872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 457us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.745113:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6020 00000100:00100000:0.0:1746065152.746120:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.746157:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263568128 00000100:00100000:2.0:1746065152.746162:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263568128 00010000:00010000:2.0:1746065152.746177:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 33 pid: 13395 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746065152.746200:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6021 00000100:00100000:2.0:1746065152.746205:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+33:2004:x1830881263568128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065152.746213:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065152.746217:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 33 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.746224:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 33 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.746234:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc146edd7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9332bf expref: 33 pid: 13395 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746065152.746243:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065152.746246:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.746251:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.746256:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065152.746295:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065152.746325:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+32:2004:x1830881263568128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 120us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.746330:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6021 00010000:00010000:0.0:1746065152.746375:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065152.746380:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000040:00080000:0.0:1746065152.746567:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].558, 88 off57160 00000004:00080000:0.0:1746065152.746574:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748764799831ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.746604:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].501, 88 off52144 00000004:00080000:0.0:1746065152.746609:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748764835234ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065152.746630:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].502, 88 off52232 00000004:00080000:0.0:1746065152.746633:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748764859887ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065152.746641:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].559, 88 off57248 00000004:00080000:0.0:1746065152.746644:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748764870322ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.747896:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].561, 88 off57432 00000004:00080000:0.0:1746065152.747904:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748766129616ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.747933:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].503, 88 off52320 00000004:00080000:0.0:1746065152.747937:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748766163051ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065152.747999:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].504, 88 off52408 00000004:00080000:0.0:1746065152.748003:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748766229530ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065152.748010:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].505, 88 off52496 00000004:00080000:0.0:1746065152.748012:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748766238867ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065152.748021:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].562, 88 off57520 00000004:00080000:0.0:1746065152.748023:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748766249626ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.748041:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].506, 88 off52584 00000004:00080000:0.0:1746065152.748043:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748766269446ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065152.748049:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].563, 88 off57608 00000004:00080000:0.0:1746065152.748051:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748766277606ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.748058:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].507, 88 off52672 00000004:00080000:0.0:1746065152.748061:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748766287252ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065152.748068:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].564, 88 off57696 00000004:00080000:0.0:1746065152.748070:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748766296690ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.748077:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].565, 88 off57784 00000004:00080000:0.0:1746065152.748079:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748766305985ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.748133:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].566, 88 off57872 00000004:00080000:0.0:1746065152.748137:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748766363780ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.748152:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].567, 88 off57960 00000004:00080000:0.0:1746065152.748154:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748766381027ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065152.748164:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].508, 88 off52760 00000004:00080000:0.0:1746065152.748166:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748766392675ns, next at 615601404258ns, rc = 0 00000001:00080000:2.0:1746065152.750408:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935988 is committed 00000004:00080000:2.0:1746065152.750416:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 502 committed 00000004:00080000:2.0:1746065152.750422:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 559 committed 00000004:00080000:2.0:1746065152.750426:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 558 committed 00000004:00080000:2.0:1746065152.750427:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 557 committed 00000004:00080000:2.0:1746065152.750428:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 556 committed 00000004:00080000:2.0:1746065152.750430:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 501 committed 00000004:00080000:2.0:1746065152.750431:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 555 committed 00000004:00080000:2.0:1746065152.750433:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 500 committed 00000004:00080000:2.0:1746065152.750434:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 554 committed 00000004:00080000:2.0:1746065152.750435:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 499 committed 00000004:00080000:2.0:1746065152.750437:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 498 committed 00000004:00080000:2.0:1746065152.750438:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 497 committed 00000004:00080000:2.0:1746065152.750439:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 553 committed 00000004:00080000:2.0:1746065152.750440:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 552 committed 00000004:00080000:2.0:1746065152.750441:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 496 committed 00000004:00080000:2.0:1746065152.750443:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 495 committed 00000004:00080000:2.0:1746065152.750444:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 551 committed 00000001:00080000:2.0:1746065152.750447:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935987 is committed 00000001:00080000:2.0:1746065152.750456:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935984 is committed 00000004:00010000:1.0:1746065152.750601:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009077df80 reply state ffff880098770800 transno 8589935988 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065152.750617:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065152.750623:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.750626:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065152.750629:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065152.750634:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263353856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065152.750681:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1746065152.750687:0:7231:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065152.750697:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32314:x1830881263567360:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 9427us (10442us total) trans 8589935988 rc 0/0 00000100:00100000:0.0:1746065152.750701:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263354368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065152.750704:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13654 00000100:00100000:0.0:1746065152.750712:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065152.750724:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:1.0:1746065152.750725:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065152.750728:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263353728:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746065152.750731:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065152.750737:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065152.750739:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065152.750742:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065152.750746:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065152.750748:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263354240:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746065152.750752:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065152.750757:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065152.750765:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.750767:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065152.750770:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065152.750790:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539600/0xad6b7ddc146f922 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065152.750790:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353856 00000100:00100000:0.0:1746065152.750795:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353856 00000100:00100000:1.0:1746065152.750806:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354368 00000100:00100000:1.0:1746065152.750808:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354368 00000100:00100000:0.0:1746065152.750820:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353728 00000100:00100000:1.0:1746065152.750822:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354240 00000100:00100000:0.0:1746065152.750822:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353728 00000100:00100000:1.0:1746065152.750823:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354240 00000100:00100000:0.0:1746065152.750832:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13266 00000100:00100000:0.0:1746065152.750837:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3760:x1830881263353856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065152.750838:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13267 00000100:00100000:1.0:1746065152.750842:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3760:x1830881263354368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065152.750850:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13268 00000100:00100000:1.0:1746065152.750853:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3760:x1830881263353728:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746065152.750907:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065152.750928:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13269 00000100:00100000:0.0:1746065152.750932:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263354240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065152.750949:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263353728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (208us total) trans 21474840920 rc 0/0 00000100:00100000:1.0:1746065152.750954:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13268 00000100:00100000:0.0:1746065152.750990:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3760:x1830881263354240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (230us total) trans 21474840921 rc 0/0 00000100:00100000:0.0:1746065152.750994:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13269 00002000:00010000:1.0:1746065152.751000:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065152.751002:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065152.751004:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065152.751006:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065152.751008:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:1.0:1746065152.751022:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263354368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (310us total) trans 21474840922 rc 0/0 00000100:00100000:0.0:1746065152.751022:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263353856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (341us total) trans 21474840919 rc 0/0 00000100:00100000:0.0:1746065152.751027:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13266 00000100:00100000:1.0:1746065152.751029:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13267 00000100:00100000:0.0:1746065152.751047:0:3760:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840895 gen 2 00000004:00080000:0.0:1746065152.751050:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d07b80, transno 21474840878 00000004:00080000:0.0:1746065152.751055:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1880, transno 21474840879 00000004:00080000:0.0:1746065152.751057:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3b80, transno 21474840880 00000004:00080000:0.0:1746065152.751059:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1c00, transno 21474840881 00000004:00080000:0.0:1746065152.751060:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc0380, transno 21474840882 00000004:00080000:0.0:1746065152.751062:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139c00, transno 21474840883 00000004:00080000:0.0:1746065152.751064:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc2300, transno 21474840884 00000004:00080000:0.0:1746065152.751066:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513b800, transno 21474840885 00000004:00080000:0.0:1746065152.751068:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d07480, transno 21474840886 00000004:00080000:0.0:1746065152.751070:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3800, transno 21474840887 00000004:00080000:0.0:1746065152.751071:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577e300, transno 21474840888 00000004:00080000:0.0:1746065152.751073:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc2d80, transno 21474840889 00000004:00080000:0.0:1746065152.751075:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577d180, transno 21474840890 00000004:00080000:0.0:1746065152.751076:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1500, transno 21474840891 00000004:00080000:0.0:1746065152.751078:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577d500, transno 21474840892 00000004:00080000:0.0:1746065152.751080:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577df80, transno 21474840893 00000004:00080000:0.0:1746065152.751082:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06300, transno 21474840894 00000004:00080000:0.0:1746065152.751084:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e13100, transno 21474840895 00000100:00100000:0.0:1746065152.751088:0:3760:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012edac700 x1830881263353728/t21474840920(21474840920) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065168 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065152.751096:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edac700/2, rc 0, transno 21474840920 00000100:00100000:0.0:1746065152.751100:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263353728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065152.751108:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaf480/2, rc 0, transno 21474840921 00000100:00100000:0.0:1746065152.751111:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263354240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065152.751116:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edae300/2, rc 0, transno 21474840919 00000100:00100000:0.0:1746065152.751119:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263353856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065152.751129:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edae680/2, rc 0, transno 21474840922 00000100:00100000:0.0:1746065152.751132:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263354368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065152.751160:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263353600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065152.751180:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.751201:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263354112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065152.751217:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065152.751217:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 18 done 00000100:00100000:2.0:1746065152.751228:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065152.751231:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263353984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065152.751237:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353600 00000100:00100000:0.0:1746065152.751239:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353600 00000100:00100000:2.0:1746065152.751245:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065152.751251:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354112 00000100:00100000:2.0:1746065152.751253:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263354496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065152.751253:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354112 00000100:00100000:0.0:1746065152.751260:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353984 00000100:00100000:0.0:1746065152.751263:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353984 00000100:00100000:2.0:1746065152.751264:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065152.751270:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354496 00000100:00100000:0.0:1746065152.751272:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354496 00000100:00100000:2.0:1746065152.751274:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263354624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065152.751278:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13270 00000100:00100000:0.0:1746065152.751282:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263353600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065152.751286:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.751306:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354624 00000100:00100000:2.0:1746065152.751308:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354624 00000100:00100000:2.0:1746065152.751319:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13271 00000100:00100000:2.0:1746065152.751323:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263354112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065152.751333:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263353600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (152us total) trans 21474840923 rc 0/0 00000100:00100000:0.0:1746065152.751338:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13270 00000100:00100000:0.0:1746065152.751346:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13272 00000100:00100000:0.0:1746065152.751350:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263353984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065152.751359:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:2.0:1746065152.751362:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065152.751363:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065152.751365:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065152.751366:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00002000:00010000:0.0:1746065152.751379:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065152.751381:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00000100:00100000:2.0:1746065152.751382:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3762:x1830881263354112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (164us total) trans 21474840924 rc 0/0 00002000:00010000:0.0:1746065152.751383:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065152.751385:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065152.751386:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746065152.751387:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13271 00000100:00100000:0.0:1746065152.751398:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263353984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (153us total) trans 21474840925 rc 0/0 00000100:00100000:0.0:1746065152.751402:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13272 00000100:00100000:0.0:1746065152.751409:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13273 00000100:00100000:0.0:1746065152.751412:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263354496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065152.751440:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:0.0:1746065152.751442:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065152.751444:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065152.751445:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065152.751447:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:0.0:1746065152.751459:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263354496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (194us total) trans 21474840926 rc 0/0 00000100:00100000:0.0:1746065152.751464:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13273 00000100:00100000:0.0:1746065152.751471:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13274 00000100:00100000:0.0:1746065152.751474:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263354624:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065152.751484:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edac000/2, rc 0, transno 21474840925 00000100:00100000:2.0:1746065152.751487:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263353984:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065152.751493:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e52d80/2, rc 0, transno 21474840926 00000100:00100000:2.0:1746065152.751495:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263354496:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065152.751501:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edace00/2, rc 0, transno 21474840923 00000100:00100000:2.0:1746065152.751503:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263353600:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065152.751508:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaed80/2, rc 0, transno 21474840924 00000100:00100000:2.0:1746065152.751510:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263354112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065152.751514:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263354624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (227us total) trans 21474840927 rc 0/0 00000004:00080000:2.0:1746065152.751516:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b64700/2, rc 0, transno 21474840927 00000100:00100000:2.0:1746065152.751519:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263354624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065152.751519:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13274 00000100:00100000:3.0:1746065152.751670:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263355008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.751670:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263354752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.751688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.751694:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354752 00000100:00100000:3.0:1746065152.751696:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354752 00000100:00100000:2.0:1746065152.751700:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263355264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.751712:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.751714:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355264 00000100:00100000:3.0:1746065152.751716:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355264 00000100:00100000:2.0:1746065152.751720:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065152.751724:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263354880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065152.751726:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13275 00000100:00100000:3.0:1746065152.751729:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3759:x1830881263354752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.751735:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.751743:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263355392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.751753:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.751764:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065152.751788:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263355520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.751802:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.751808:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3759:x1830881263354752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (119us total) trans 17179873464 rc 0/0 00000100:00100000:3.0:1746065152.751813:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13275 00000100:00100000:2.0:1746065152.751820:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065152.751821:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354880 00000100:00100000:3.0:1746065152.751823:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354880 00000100:00100000:2.0:1746065152.751824:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263355136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065152.751830:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355392 00000100:00100000:3.0:1746065152.751831:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355392 00000100:00100000:3.0:1746065152.751836:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355008 00000100:00100000:2.0:1746065152.751837:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.751838:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355008 00000100:00100000:3.0:1746065152.751843:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355520 00000100:00100000:3.0:1746065152.751844:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355520 00000100:00100000:2.0:1746065152.751844:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263355648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065152.751849:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355136 00000100:00100000:3.0:1746065152.751850:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355136 00000100:00100000:2.0:1746065152.751854:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065152.751856:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13276 00000100:00100000:3.0:1746065152.751860:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3759:x1830881263355264:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065152.751869:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aceca80/2, rc 0, transno 17179873464 00000100:00100000:2.0:1746065152.751872:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263354752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.751881:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355648 00000100:00100000:2.0:1746065152.751883:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355648 00000100:00100000:2.0:1746065152.751893:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13277 00000100:00100000:2.0:1746065152.751897:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263354880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065152.751908:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263355264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (195us total) trans 17179873465 rc 0/0 00000100:00100000:3.0:1746065152.751923:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13276 00000100:00100000:3.0:1746065152.751932:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13278 00000100:00100000:3.0:1746065152.751936:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263355392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.751956:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263354880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (220us total) trans 17179873466 rc 0/0 00000100:00100000:2.0:1746065152.751961:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13277 00000100:00100000:2.0:1746065152.751970:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13279 00000100:00100000:2.0:1746065152.751974:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263355008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065152.751978:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263355392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (224us total) trans 17179873467 rc 0/0 00000100:00100000:3.0:1746065152.751983:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13278 00000100:00100000:3.0:1746065152.751990:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13280 00000100:00100000:3.0:1746065152.751994:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263355520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065152.752003:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13281 00000100:00100000:3.0:1746065152.752006:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263355136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.752021:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263355008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (256us total) trans 17179873468 rc 0/0 00000100:00100000:2.0:1746065152.752026:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13279 00000100:00100000:2.0:1746065152.752034:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13282 00002000:00010000:3.0:1746065152.752037:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746065152.752038:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263355648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065152.752039:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065152.752041:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065152.752042:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065152.752044:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065152.752059:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263355136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (221us total) trans 17179873469 rc 0/0 00000100:00100000:3.0:1746065152.752064:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13281 00000100:00100000:2.0:1746065152.752080:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263355648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (225us total) trans 17179873470 rc 0/0 00000100:00100000:2.0:1746065152.752084:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13282 00000100:00080000:0.0:1746065152.752145:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746065152.752259:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aceea00/2, rc 0, transno 17179873466 00000100:00100000:2.0:1746065152.752263:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263354880:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065152.752270:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009acef800/2, rc 0, transno 17179873467 00000100:00100000:2.0:1746065152.752272:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263355392:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065152.752278:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aceed80/2, rc 0, transno 17179873465 00000100:00100000:2.0:1746065152.752280:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263355264:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065152.752293:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009acece00/2, rc 0, transno 17179873469 00000100:00100000:2.0:1746065152.752295:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263355136:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065152.752300:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad5f80/2, rc 0, transno 17179873470 00000100:00100000:2.0:1746065152.752302:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263355648:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065152.752308:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009acec000/2, rc 0, transno 17179873468 00000100:00100000:2.0:1746065152.752310:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263355008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065152.752371:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263355520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 376us (568us total) trans 17179873471 rc 0/0 00000100:00100000:2.0:1746065152.752377:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13280 00000004:00080000:0.0:1746065152.752420:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad5500/2, rc 0, transno 17179873471 00000100:00100000:0.0:1746065152.752423:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263355520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065152.753418:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065152.753479:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263568256 00000100:00100000:1.0:1746065152.753483:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263568256 00000100:00100000:1.0:1746065152.753509:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13655 00000100:00100000:1.0:1746065152.753513:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32314:x1830881263568256:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065152.753527:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065152.753539:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a75 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.753739:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.753750:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065152.753763:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065152.753766:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065152.753768:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1a00, rc 0) 00000100:00100000:1.0:1746065152.753815:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32314:x1830881263568256:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 300us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065152.753820:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13655 00000100:00100000:0.0:1746065152.759748:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.760570:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263568384 00000100:00100000:2.0:1746065152.760577:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263568384 00000100:00100000:2.0:1746065152.760620:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13656 00000100:00100000:2.0:1746065152.760627:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32314:x1830881263568384:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065152.760643:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.760660:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc146f930 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a7c expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.760726:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.760737:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.760744:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065152.760764:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065152.760768:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065152.760806:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065152.760825:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc146f930 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.760929:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065152.760936:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065152.760939:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065152.760942:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a400, rc 0) 00000100:00100000:2.0:1746065152.760983:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32314:x1830881263568384:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 356us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.760988:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13656 00000100:00100000:0.0:1746065152.763181:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.763214:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.763236:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263568512 00000100:00100000:0.0:1746065152.763238:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.763241:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263568512 00000100:00100000:0.0:1746065152.763250:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.763262:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.763492:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263568640 00000100:00100000:2.0:1746065152.763495:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263568640 00000100:00100000:0.0:1746065152.763498:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263568768 00000100:00100000:0.0:1746065152.763500:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263568768 00000100:00100000:2.0:1746065152.763509:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263568896 00000100:00100000:2.0:1746065152.763510:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263568896 00000100:00100000:0.0:1746065152.763515:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263569024 00000100:00100000:0.0:1746065152.763517:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263569024 00000100:00100000:2.0:1746065152.763849:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13283 00000100:00100000:2.0:1746065152.763856:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263568512:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065152.763868:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.763881:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a83 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065152.763897:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d700, atime: 0x6812d700, ctime: 0x6812d700, blocks: 0x7f8 00010000:00010000:2.0:1746065152.763910:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.763911:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.763928:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.763939:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.763946:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b800, rc 0) 00000100:00100000:2.0:1746065152.763975:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263568512:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 120us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.763981:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13283 00000100:00100000:2.0:1746065152.763992:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13284 00000100:00100000:2.0:1746065152.763996:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263568640:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065152.764001:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.764009:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a8a expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065152.764018:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d700, atime: 0x6812d700, ctime: 0x6812d700, blocks: 0x808 00010000:00010000:2.0:1746065152.764025:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.764026:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.764029:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.764036:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.764041:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a600, rc 0) 00000100:00100000:2.0:1746065152.764052:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263568640:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 56us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.764056:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13284 00000100:00100000:2.0:1746065152.764062:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13285 00000100:00100000:2.0:1746065152.764066:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263568768:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065152.764070:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.764074:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a91 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065152.764085:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d6ff, atime: 0x6812d6ff, ctime: 0x6812d6ff, blocks: 0x800 00010000:00010000:2.0:1746065152.764089:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.764090:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.764093:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.764100:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.764105:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:2.0:1746065152.764114:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263568768:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 47us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.764118:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13285 00000100:00100000:2.0:1746065152.764125:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13286 00000100:00100000:2.0:1746065152.764128:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263568896:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065152.764132:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.764137:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a98 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065152.764143:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d700, atime: 0x6812d6ff, ctime: 0x6812d700, blocks: 0x808 00010000:00010000:2.0:1746065152.764148:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.764148:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.764151:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.764162:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.764167:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b000, rc 0) 00000100:00100000:2.0:1746065152.764176:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263568896:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 47us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.764179:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13286 00000100:00100000:2.0:1746065152.764185:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13287 00000100:00100000:2.0:1746065152.764188:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263569024:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065152.764192:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065152.764196:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933a9f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065152.764203:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d700, atime: 0x6812d6ff, ctime: 0x6812d700, blocks: 0x1650 00010000:00010000:2.0:1746065152.764208:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.764209:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065152.764211:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.764218:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065152.764223:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a800, rc 0) 00000100:00100000:2.0:1746065152.764234:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263569024:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 45us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065152.764246:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13287 00000100:00100000:0.0:1746065152.764418:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065152.764472:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263569152 00000100:00100000:2.0:1746065152.764476:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263569152 00000100:00100000:3.0:1746065152.764846:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13288 00000100:00100000:3.0:1746065152.764854:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263569152:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065152.764860:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065152.764867:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933aa6 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065152.764882:0:3068:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d6ff, atime: 0x6812d6ff, ctime: 0x6812d6ff, blocks: 0x1000 00010000:00010000:3.0:1746065152.764888:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.764889:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065152.764893:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.764901:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065152.764907:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2200, rc 0) 00000100:00100000:3.0:1746065152.765078:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263569152:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 225us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065152.765084:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13288 00000100:00100000:1.0:1746065152.813307:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065152.813326:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263355776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746065152.813380:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065152.813544:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355776 00000100:00100000:0.0:1746065152.813551:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355776 00000100:00100000:0.0:1746065152.813602:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1746065152.813609:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263355776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746065152.813706:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1204553152 pending 217088 free 3903262720 avail 3662360576 00000100:00100000:0.0:1746065152.814160:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263355776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 550us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.814166:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00080000:1.0:1746065152.814217:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065152.814370:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263355776:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1746065152.915736:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065152.982824:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.982865:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.982896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.982926:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.982944:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.982956:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.982975:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.982995:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263569280 00000100:00100000:0.0:1746065152.983001:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263569280 00000100:00100000:0.0:1746065152.983031:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 188 00000100:00100000:0.0:1746065152.983039:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800902f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881263569280:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983087:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800902f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881263569280:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983094:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 188 00000100:00100000:0.0:1746065152.983127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.983142:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263569408 00000100:00100000:0.0:1746065152.983145:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263569408 00000100:00100000:0.0:1746065152.983165:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1014 00000100:00100000:0.0:1746065152.983170:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263569408:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983197:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263569408:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983201:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1014 00000100:00100000:0.0:1746065152.983209:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263569920 00000100:00100000:0.0:1746065152.983211:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263569920 00000100:00100000:0.0:1746065152.983222:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263570432 00000100:00100000:0.0:1746065152.983224:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263570432 00000100:00100000:0.0:1746065152.983231:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263569536 00000100:00100000:0.0:1746065152.983232:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263569536 00000100:00100000:0.0:1746065152.983246:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1015 00000100:00100000:0.0:1746065152.983250:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263569920:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983269:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263569920:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 18us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983273:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1015 00000100:00100000:0.0:1746065152.983281:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1016 00000100:00100000:0.0:1746065152.983285:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263570432:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983300:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263570432:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 15us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983305:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1016 00000100:00100000:0.0:1746065152.983312:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1017 00000100:00100000:0.0:1746065152.983316:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2005:x1830881263569536:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983330:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2005:x1830881263569536:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 14us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983334:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1017 00000100:00100000:0.0:1746065152.983379:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.983393:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263569664 00000100:00100000:0.0:1746065152.983395:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263569664 00000100:00100000:0.0:1746065152.983411:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263570176 00000100:00100000:0.0:1746065152.983413:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263570176 00000100:00100000:0.0:1746065152.983421:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263570688 00000100:00100000:0.0:1746065152.983423:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263570688 00000100:00100000:0.0:1746065152.983431:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263569792 00000100:00100000:0.0:1746065152.983433:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263569792 00000100:00100000:0.0:1746065152.983443:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 631 00000100:00100000:0.0:1746065152.983447:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881263569664:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983467:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881263569664:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 19us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983471:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 631 00000100:00100000:0.0:1746065152.983479:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 632 00000100:00100000:0.0:1746065152.983483:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263570176:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983498:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263570176:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 14us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983502:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 632 00000100:00100000:0.0:1746065152.983509:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 633 00000100:00100000:0.0:1746065152.983513:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263570688:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983528:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263570688:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 15us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983532:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 633 00000100:00100000:0.0:1746065152.983539:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 634 00000100:00100000:0.0:1746065152.983542:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263569792:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983555:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263569792:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 13us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983560:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 634 00000100:00100000:0.0:1746065152.983592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.983604:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263570048 00000100:00100000:0.0:1746065152.983607:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263570048 00000100:00100000:0.0:1746065152.983622:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1018 00000100:00100000:0.0:1746065152.983625:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263570048:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983643:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263570048:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 17us (51us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983648:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1018 00000100:00100000:0.0:1746065152.983673:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.983682:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263570304 00000100:00100000:0.0:1746065152.983684:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263570304 00000100:00100000:0.0:1746065152.983697:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 635 00000100:00100000:0.0:1746065152.983701:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263570304:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983718:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263570304:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 17us (45us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983723:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 635 00000100:00100000:0.0:1746065152.983750:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.983759:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263570560 00000100:00100000:0.0:1746065152.983761:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263570560 00000100:00100000:0.0:1746065152.983792:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1019 00000100:00100000:0.0:1746065152.983797:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881263570560:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983814:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881263570560:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 17us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983818:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1019 00000100:00100000:0.0:1746065152.983858:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065152.983870:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263570816 00000100:00100000:0.0:1746065152.983873:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263570816 00000100:00100000:0.0:1746065152.983886:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 636 00000100:00100000:0.0:1746065152.983890:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263570816:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065152.983908:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263570816:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 17us (49us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065152.983922:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 636 00000100:00080000:0.0:1746065152.984014:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:3.0:1746065153.681456:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873471 is committed 00000001:00080000:3.0:1746065153.681477:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873463 is committed 00000001:00080000:3.0:1746065153.681482:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873462 is committed 00000100:00100000:0.0:1746065153.772080:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.772115:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.772142:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.772163:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263571072 00000100:00100000:0.0:1746065153.772170:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263571072 00000100:00100000:0.0:1746065153.772206:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263570944 00000100:00100000:0.0:1746065153.772208:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263570944 00000100:00100000:0.0:1746065153.772224:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263571200 00000100:00100000:0.0:1746065153.772225:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263571200 00000100:00100000:0.0:1746065153.772238:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13289 00000100:00100000:0.0:1746065153.772245:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263571072:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065153.772331:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263571072:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.772337:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13289 00000100:00100000:0.0:1746065153.772351:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13290 00000100:00100000:0.0:1746065153.772355:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263570944:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065153.772390:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263570944:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.772396:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13290 00000100:00100000:0.0:1746065153.772405:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13291 00000100:00100000:0.0:1746065153.772409:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263571200:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065153.772436:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263571200:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.772441:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13291 00000100:00080000:0.0:1746065153.772505:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065153.772508:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065153.772532:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.772545:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263571328 00000100:00100000:0.0:1746065153.772548:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263571328 00000100:00100000:0.0:1746065153.772562:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13292 00000100:00100000:0.0:1746065153.772567:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263571328:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065153.772598:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263571328:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 30us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.772603:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13292 00000100:00100000:0.0:1746065153.772650:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.772662:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263571456 00000100:00100000:0.0:1746065153.772664:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263571456 00000100:00100000:0.0:1746065153.772677:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13293 00000100:00100000:0.0:1746065153.772680:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263571456:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065153.772707:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263571456:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 26us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.772711:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13293 00000100:00100000:0.0:1746065153.772746:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.772755:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263571584 00000100:00100000:0.0:1746065153.772758:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263571584 00000100:00100000:0.0:1746065153.772768:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13294 00000100:00100000:0.0:1746065153.772806:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263571584:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065153.772831:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263571584:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 59us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.772836:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13294 00000100:00100000:0.0:1746065153.777964:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.778001:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.778286:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.778431:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263571712 00000100:00100000:3.0:1746065153.778438:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263571712 00000100:00100000:1.0:1746065153.778472:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263571840 00000100:00100000:1.0:1746065153.778475:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263571840 00000100:00100000:0.0:1746065153.778505:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263571968 00000100:00100000:0.0:1746065153.778507:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263571968 00000100:00100000:3.0:1746065153.778743:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13295 00000100:00100000:3.0:1746065153.778887:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263571712:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065153.778965:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13296 00000100:00100000:1.0:1746065153.778972:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263571840:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065153.779045:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263571840:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 73us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065153.779051:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13296 00000100:00100000:1.0:1746065153.779066:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13297 00000100:00100000:2.0:1746065153.779152:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.779164:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263572096 00000100:00100000:2.0:1746065153.779166:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263572096 00000100:00100000:2.0:1746065153.779179:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13298 00000100:00100000:2.0:1746065153.779183:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263572096:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065153.779212:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263572096:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 28us (60us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065153.779216:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13298 00000100:00100000:2.0:1746065153.779254:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.779262:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263572224 00000100:00100000:2.0:1746065153.779264:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263572224 00000100:00100000:2.0:1746065153.779273:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13299 00000100:00100000:2.0:1746065153.779277:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263572224:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065153.779298:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263572224:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 21us (44us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065153.779303:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13299 00000100:00100000:2.0:1746065153.779334:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.779343:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263572352 00000100:00100000:2.0:1746065153.779345:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263572352 00000100:00100000:2.0:1746065153.779355:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13300 00000100:00100000:2.0:1746065153.779358:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263572352:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065153.779383:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263572352:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 24us (48us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065153.779387:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13300 00000100:00100000:1.0:1746065153.780336:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263571968:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065153.780381:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263571968:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 1310us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065153.780393:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13297 00000100:00100000:3.0:1746065153.780533:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263571712:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 1648us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065153.780539:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13295 00000100:00100000:0.0:1746065153.787010:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.787541:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263572480 00000100:00100000:3.0:1746065153.787549:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263572480 00000100:00100000:3.0:1746065153.787630:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13301 00000100:00100000:3.0:1746065153.787637:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263572480:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:3.0:1746065153.787912:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065153.787915:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065153.787917:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065153.787919:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065153.787921:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065153.787989:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263572480:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 351us (984us total) trans 17179873472 rc 0/0 00000100:00100000:3.0:1746065153.787995:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13301 00000100:00100000:0.0:1746065153.790371:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.790455:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263572608 00000100:00100000:3.0:1746065153.790461:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263572608 00000100:00100000:3.0:1746065153.790500:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13302 00000100:00100000:3.0:1746065153.790506:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263572608:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:3.0:1746065153.790627:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065153.790630:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065153.790632:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065153.790634:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065153.790635:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:3.0:1746065153.790664:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263572608:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 158us (299us total) trans 21474840928 rc 0/0 00000100:00100000:3.0:1746065153.790670:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13302 00000100:00100000:0.0:1746065153.796942:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.797183:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263572864 00000100:00100000:2.0:1746065153.797192:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263572864 00000100:00100000:2.0:1746065153.797242:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3789 00000100:00100000:2.0:1746065153.797249:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263572864:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:2.0:1746065153.797282:0:29488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.797295:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.797296:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.797299:0:29488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.797312:0:29488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065153.800261:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.800294:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.800323:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.800353:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.800373:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263573120 00000100:00100000:0.0:1746065153.800379:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263573120 00000100:00100000:0.0:1746065153.800419:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263573632 00000100:00100000:0.0:1746065153.800421:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263573632 00000100:00100000:0.0:1746065153.800434:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263573504 00000100:00100000:0.0:1746065153.800436:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263573504 00000100:00100000:0.0:1746065153.800448:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263573888 00000100:00100000:0.0:1746065153.800449:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263573888 00000100:00100000:0.0:1746065153.800462:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3790 00000100:00100000:0.0:1746065153.800469:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263573120:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065153.800497:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.800513:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.800515:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.800519:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.800532:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065153.801151:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3791 00000100:00100000:0.0:1746065153.801329:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263573632:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065153.801346:0:29493:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.801354:0:29493:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.801355:0:29493:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.801357:0:29493:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.801365:0:29493:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065153.801574:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3792 00000100:00100000:1.0:1746065153.801582:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263573504:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065153.801596:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.801602:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065153.801603:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065153.801605:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.801612:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065153.801932:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3793 00000100:00100000:0.0:1746065153.801938:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263573888:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065153.801952:0:9553:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.801959:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.801960:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.801962:0:9553:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.801969:0:9553:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065153.802181:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.802544:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263574016 00000100:00100000:0.0:1746065153.802549:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263574016 00000100:00100000:0.0:1746065153.802589:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3794 00000100:00100000:0.0:1746065153.802594:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263574016:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065153.802606:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.802614:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.802615:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.802617:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.802624:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065153.804494:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065153.804533:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.804602:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263574272 00000100:00100000:2.0:1746065153.804608:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263574272 00000100:00100000:2.0:1746065153.804644:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263574656 00000100:00100000:2.0:1746065153.804646:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263574656 00000100:00100000:2.0:1746065153.804661:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3795 00000100:00100000:2.0:1746065153.804667:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2004:x1830881263574272:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:2.0:1746065153.804691:0:29489:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.804700:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.804702:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.804706:0:29489:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.804715:0:29489:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065153.804872:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3796 00000100:00100000:3.0:1746065153.804879:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263574656:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065153.804897:0:20324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.804913:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.804914:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.804917:0:20324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.804925:0:20324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.816587:0:29488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.816602:0:29488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.816609:0:29488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.816615:0:29488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065153.816619:0:29488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.816624:0:29488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.816639:0:29488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.816643:0:29488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc146f968 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065153.817924:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263572864:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 20669us (20984us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746065153.817934:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3789 00010000:00010000:0.0:1746065153.821803:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.821818:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.821825:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.821836:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065153.821840:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.821847:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.821862:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.821868:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc146f96f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065153.821955:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263573120:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 21482us (21696us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065153.821963:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3790 00010000:00010000:1.0:1746065153.837298:0:29493:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.837314:0:29493:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.837321:0:29493:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.837326:0:29493:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065153.837330:0:29493:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.837337:0:29493:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.837351:0:29493:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.837357:0:29493:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc146f976 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065153.837444:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263573632:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 36113us (37144us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065153.837452:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3791 00010000:00010000:2.0:1746065153.843296:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.843311:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.843318:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.843324:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065153.843327:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.843333:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.843348:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.843354:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146f97d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065153.844192:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263573504:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 42607us (43863us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065153.844202:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3792 00010000:00010000:2.0:1746065153.851405:0:9553:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.851421:0:9553:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.851428:0:9553:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.851434:0:9553:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065153.851438:0:9553:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.851444:0:9553:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.851460:0:9553:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.851466:0:9553:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc146f984 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065153.852705:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263573888:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 50760us (52344us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065153.852714:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3793 00010000:00010000:0.0:1746065153.853537:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.853548:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.853555:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.853559:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065153.853563:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.853570:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.853582:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.853588:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc146f98b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065153.853660:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263574016:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 51064us (51478us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065153.853667:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3794 00010000:00010000:2.0:1746065153.857001:0:29489:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.857016:0:29489:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.857029:0:29489:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.857034:0:29489:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065153.857038:0:29489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.857045:0:29489:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.857057:0:29489:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.857063:0:29489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc146f992 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065153.857240:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263574272:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 52568us (52748us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065153.857248:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3795 00010000:00010000:3.0:1746065153.860885:0:20324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.860899:0:20324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.860919:0:20324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.860924:0:20324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065153.860928:0:20324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.860934:0:20324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.860947:0:20324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.860956:0:20324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc146f999 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065153.861024:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263574656:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 56141us (56487us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065153.861033:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3796 00000100:00100000:0.0:1746065153.866363:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.866446:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263574784 00000100:00100000:2.0:1746065153.866453:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263574784 00000100:00100000:2.0:1746065153.866506:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 722 00000100:00100000:2.0:1746065153.866512:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32314:x1830881263574784:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:2.0:1746065153.866523:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065153.866542:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc146f8e3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a67 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.866570:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065153.866573:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065153.866608:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32314:x1830881263574784:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065153.866613:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 722 00000100:00080000:0.0:1746065153.866693:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065153.867867:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.867966:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263575040 00000100:00100000:2.0:1746065153.867971:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263575040 00000100:00100000:2.0:1746065153.868011:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4930 00000100:00100000:2.0:1746065153.868017:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32314:x1830881263575040:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065153.868295:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32314:x1830881263575040:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 277us (429us total) trans 8589935989 rc 0/0 00000100:00100000:2.0:1746065153.868301:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4930 00000100:00100000:0.0:1746065153.870186:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.870263:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263575296 00000100:00100000:2.0:1746065153.870267:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263575296 00000100:00100000:2.0:1746065153.870296:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4931 00000100:00100000:2.0:1746065153.870301:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32314:x1830881263575296:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065153.870419:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32314:x1830881263575296:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 117us (238us total) trans 8589935990 rc 0/0 00000100:00100000:2.0:1746065153.870423:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4931 00000100:00100000:0.0:1746065153.897275:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.897318:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.897373:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263575552 00000100:00100000:2.0:1746065153.897381:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263575552 00000100:00080000:0.0:1746065153.897410:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065153.897423:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263575808 00000100:00100000:2.0:1746065153.897426:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263575808 00000100:00100000:0.0:1746065153.897434:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13657 00000100:00100000:0.0:1746065153.897442:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+7:32324:x1830881263575552:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065153.897458:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065153.897459:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13658 00000100:00100000:2.0:1746065153.897464:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+27:32323:x1830881263575808:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065153.897472:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146f9a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933aad expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.897473:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065153.897480:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146f9a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ab4 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.897527:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897538:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897546:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897555:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897560:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897565:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065153.897630:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.897636:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ada00/0xad6b7ddc146f9c3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065153.897638:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.897643:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ada00/0xad6b7ddc146f9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065153.897644:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.897648:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ada00/0xad6b7ddc146f9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065153.897650:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.897655:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065153.897655:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065153.897660:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.897796:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897803:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897808:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897813:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065153.897814:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.897818:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065153.897821:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065153.897823:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.897827:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065153.897829:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065153.897835:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065153.897835:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065153.897838:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065153.897841:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.897845:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc146f9ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065153.897868:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.897877:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.897881:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.897885:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065153.897887:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.897891:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.897896:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065153.897898:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065153.897900:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.897916:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc146f9bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.898184:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.898189:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.898193:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.898197:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065153.898199:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.898203:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.898209:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009554f600) 00010000:00010000:0.0:1746065153.898211:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065153.898213:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.898217:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc146f9b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065153.898241:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0xad6b7ddc146f9a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aad expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.898250:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ada00/0xad6b7ddc146f9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aad expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.898256:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065153.898258:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065153.898260:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ada00, rc 0) 00000100:00100000:0.0:1746065153.898329:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+9:32324:x1830881263575552:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 888us (1060us total) trans 8589935991 rc 0/0 00000100:00100000:0.0:1746065153.898335:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13657 00010000:00010000:2.0:1746065153.898363:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.898369:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.898373:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.898377:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065153.898380:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.898388:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.898395:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009554f600) 00010000:00010000:2.0:1746065153.898397:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065153.898399:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.898403:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc146f9ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.898427:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc146f9a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 30 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.898436:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 29 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.898441:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065153.898443:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065153.898445:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a200, rc 0) 00000100:00080000:0.0:1746065153.898461:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065153.898466:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+29:32323:x1830881263575808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1001us (1147us total) trans 8589935992 rc 0/0 00000100:00100000:2.0:1746065153.898471:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13658 00000100:00100000:0.0:1746065153.902150:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.902233:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263576064 00000100:00100000:2.0:1746065153.902240:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263576064 00000100:00100000:2.0:1746065153.902272:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13659 00000100:00100000:2.0:1746065153.902278:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+9:32328:x1830881263576064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065153.902477:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065153.902492:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc146f9e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933abb expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.902574:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc146f9ed lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.902591:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc146f9ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.902600:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc146f9ed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065153.902610:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065153.902693:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc146f9e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933abb expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.902725:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc146f9ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933abb expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.902732:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065153.902734:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065153.902737:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1be00, rc 0) 00000100:00100000:2.0:1746065153.902953:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+11:32328:x1830881263576064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 674us (808us total) trans 8589935993 rc 0/0 00000100:00100000:2.0:1746065153.902960:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13659 00000100:00100000:0.0:1746065153.903248:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065153.903353:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263576192 00000100:00100000:1.0:1746065153.903356:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263576192 00000100:00080000:0.0:1746065153.903417:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065153.903447:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13303 00000100:00100000:1.0:1746065153.903452:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881263576192:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065153.903460:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065153.903469:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ac2 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.903482:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065153.903483:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065153.903489:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 21 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065153.903498:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 21 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065153.903504:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f7400, rc 0) 00000100:00100000:1.0:1746065153.903520:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881263576192:12345-192.168.202.27@tcp:101:cat.0 Request processed in 68us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065153.903525:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13303 00000100:00100000:0.0:1746065153.906118:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.906150:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.906522:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.906799:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263576320 00000100:00100000:3.0:1746065153.906808:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263576320 00000100:00100000:0.0:1746065153.906930:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263576448 00000100:00100000:0.0:1746065153.906935:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263576448 00000100:00100000:0.0:1746065153.906974:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263576832 00000100:00100000:0.0:1746065153.906978:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263576832 00000100:00100000:1.0:1746065153.907049:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13304 00000100:00100000:1.0:1746065153.907060:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263576448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065153.907080:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065153.907097:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ad0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.907121:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065153.907123:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065153.907132:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 26 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065153.907152:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 26 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065153.907164:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6800, rc 0) 00000100:00100000:1.0:1746065153.907213:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263576448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 155us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065153.907220:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13304 00000100:00100000:1.0:1746065153.907238:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13305 00000100:00100000:1.0:1746065153.907244:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881263576832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065153.907253:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065153.907264:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ae5 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065153.907275:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065153.907276:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065153.907281:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065153.907292:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065153.907297:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6a00, rc 0) 00000100:00100000:1.0:1746065153.907312:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881263576832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 68us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065153.907316:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13305 00000100:00080000:2.0:1746065153.907607:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065153.907653:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13306 00000100:00100000:0.0:1746065153.907660:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263576320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065153.907667:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065153.907674:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ac9 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.907685:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.907686:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.907691:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 26 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065153.907702:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 26 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065153.907709:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7aca00, rc 0) 00000100:00100000:0.0:1746065153.907734:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263576320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 73us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.907853:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13306 00000100:00100000:1.0:1746065153.908133:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.908157:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263577216 00000100:00100000:3.0:1746065153.908161:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263577216 00000100:00100000:3.0:1746065153.908180:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13307 00000100:00100000:3.0:1746065153.908185:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881263577216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065153.908192:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065153.908199:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933afa expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.908210:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.908211:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.908216:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065153.908226:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065153.908232:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00000100:00100000:3.0:1746065153.908250:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263577216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065153.908256:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13307 00000100:00100000:0.0:1746065153.909447:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.909477:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.909494:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.909508:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.909509:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263576576 00000100:00100000:2.0:1746065153.909515:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263576576 00000100:00100000:3.0:1746065153.909527:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263577600 00000100:00100000:0.0:1746065153.909529:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.909531:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263577600 00000100:00100000:3.0:1746065153.909551:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263576960 00000100:00100000:3.0:1746065153.909553:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263576960 00000100:00100000:3.0:1746065153.909569:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263577344 00000100:00100000:3.0:1746065153.909570:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263577344 00000100:00100000:2.0:1746065153.909572:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13308 00000100:00100000:3.0:1746065153.909579:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263576704 00000100:00100000:3.0:1746065153.909580:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263576704 00000100:00100000:2.0:1746065153.909581:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263577600:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065153.909591:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13309 00000100:00100000:3.0:1746065153.909596:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+6:2005:x1830881263576576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065153.909596:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065153.909603:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065153.909606:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b0f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.909610:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ad7 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.909621:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.909621:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.909623:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.909623:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.909627:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 7 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065153.909628:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 27 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065153.909637:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 7 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065153.909639:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 27 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065153.909643:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2e00, rc 0) 00010000:00010000:2.0:1746065153.909646:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1bc00, rc 0) 00000100:00100000:3.0:1746065153.909667:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263576576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065153.909672:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13309 00000100:00100000:2.0:1746065153.909673:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263577600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065153.909679:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13308 00000100:00100000:3.0:1746065153.909684:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13310 00000100:00100000:3.0:1746065153.909689:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+6:2005:x1830881263576960:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065153.909693:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065153.909695:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065153.909695:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13311 00010000:00010000:3.0:1746065153.909702:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933aec expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065153.909702:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+6:2005:x1830881263577344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065153.909709:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065153.909711:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263577088 00000100:00100000:0.0:1746065153.909714:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263577088 00010000:00010000:3.0:1746065153.909715:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065153.909716:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b01 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.909717:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.909721:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 7 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065153.909727:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.909729:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 7 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065153.909729:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065153.909731:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13312 00010000:00010000:2.0:1746065153.909733:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 8 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065153.909735:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:0.0:1746065153.909736:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263576704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065153.909742:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065153.909743:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 8 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065153.909749:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ade expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065153.909750:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263576960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 61us (255us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065153.909752:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ae00, rc 0) 00000100:00100000:3.0:1746065153.909755:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13310 00010000:00010000:0.0:1746065153.909760:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065153.909761:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065153.909764:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13313 00010000:00010000:0.0:1746065153.909766:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 7 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065153.909769:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263577088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065153.909792:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065153.909793:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 7 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065153.909797:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933af3 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.909800:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad800, rc 0) 00000100:00100000:2.0:1746065153.909801:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263577344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (263us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065153.909806:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065153.909807:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13311 00010000:00010000:3.0:1746065153.909808:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.909811:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065153.909815:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263576704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.909820:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13312 00010000:00010000:3.0:1746065153.909824:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00000100:00080000:2.0:1746065153.909828:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065153.909831:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00080000:2.0:1746065153.909831:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065153.909847:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263577088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065153.909851:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13313 00000100:00100000:0.0:1746065153.909861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.909875:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263577472 00000100:00100000:3.0:1746065153.909877:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263577472 00000100:00100000:3.0:1746065153.909896:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13314 00000100:00100000:3.0:1746065153.909900:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263577472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065153.909920:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065153.909926:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b08 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.909934:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.909936:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065153.909939:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065153.909946:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065153.909952:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3600, rc 0) 00000100:00100000:3.0:1746065153.910094:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263577472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 193us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065153.910102:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13314 00010000:00010000:2.0:1746065153.917485:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065153.924653:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.924743:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263577856 00000100:00100000:3.0:1746065153.924750:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263577856 00002000:00100000:3.0:1746065153.924807:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097e56d80 x1830881263577856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065153.924816:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56d80 with x1830881263577856 ext(0->1048575) 00002000:00010000:3.0:1746065153.924820:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e56d80 00000100:00100000:3.0:1746065153.924848:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3797 00000100:00100000:3.0:1746065153.924855:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263577856:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065153.929256:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.929296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065153.930497:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263578112 00000100:00100000:3.0:1746065153.930500:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263578368 00000100:00100000:3.0:1746065153.930507:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263578368 00000100:00100000:1.0:1746065153.930507:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263578112 00002000:00100000:3.0:1746065153.930545:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097e57480 x1830881263578368/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065153.930546:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097e56680 x1830881263578112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065153.930554:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e57480 with x1830881263578368 ext(1048576->2097151) 00002000:00100000:1.0:1746065153.930554:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56680 with x1830881263578112 ext(1048576->2097151) 00002000:00010000:3.0:1746065153.930558:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e57480 00002000:00010000:1.0:1746065153.930558:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e56680 00000100:00100000:3.0:1746065153.930576:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3798 00000100:00100000:3.0:1746065153.930582:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263578368:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065153.930595:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3799 00000100:00100000:1.0:1746065153.930603:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263578112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065153.931366:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.931392:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263578624 00000100:00100000:2.0:1746065153.931398:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263578624 00002000:00100000:2.0:1746065153.931423:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091b65880 x1830881263578624/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065153.931430:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65880 with x1830881263578624 ext(1048576->2097151) 00000100:00100000:3.0:1746065153.931432:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065153.931434:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b65880 00000100:00100000:3.0:1746065153.931455:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263578880 00000100:00100000:3.0:1746065153.931459:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263578880 00000100:00100000:2.0:1746065153.931466:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3800 00002000:00100000:3.0:1746065153.931473:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88011dad6300 x1830881263578880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065153.931474:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263578624:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:3.0:1746065153.931481:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6300 with x1830881263578880 ext(0->1048575) 00002000:00010000:3.0:1746065153.931484:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad6300 00000100:00100000:3.0:1746065153.931503:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3801 00000100:00100000:3.0:1746065153.931509:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263578880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065153.931931:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.931942:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263579136 00000100:00100000:0.0:1746065153.931945:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263579136 00002000:00100000:0.0:1746065153.931962:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880091b64a80 x1830881263579136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065153.931971:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64a80 with x1830881263579136 ext(1048576->2097151) 00002000:00010000:0.0:1746065153.931974:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64a80 00000100:00100000:0.0:1746065153.931985:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3802 00000100:00100000:0.0:1746065153.931991:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263579136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065153.934178:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065153.934251:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.934253:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263579264 00000100:00100000:2.0:1746065153.934260:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263579264 00000100:00100000:0.0:1746065153.934287:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263579648 00000100:00100000:0.0:1746065153.934290:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263579648 00002000:00100000:2.0:1746065153.934294:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880091b65f80 x1830881263579264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065153.934303:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65f80 with x1830881263579264 ext(1048576->2097151) 00002000:00100000:0.0:1746065153.934303:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800907bc380 x1830881263579648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:69/0 lens 488/0 e 0 to 0 dl 1746065164 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746065153.934307:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65f80 00002000:00100000:0.0:1746065153.934309:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc380 with x1830881263579648 ext(1048576->2097151) 00002000:00010000:0.0:1746065153.934311:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bc380 00000100:00100000:2.0:1746065153.934338:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3803 00000100:00100000:2.0:1746065153.934345:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263579264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065153.934811:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3804 00000100:00100000:1.0:1746065153.934820:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263579648:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065153.936156:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.936247:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263579904 00000100:00100000:0.0:1746065153.936252:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263579904 00000100:00100000:0.0:1746065153.936287:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13660 00000100:00100000:0.0:1746065153.936293:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+11:32324:x1830881263579904:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065153.936306:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065153.936309:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746065153.936329:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc146f9ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933abb expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936351:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ada00/0xad6b7ddc146f9c3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aad expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936361:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065153.936364:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065153.936373:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146fa4f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b16 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936407:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.936422:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936428:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936434:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936439:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.936459:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936469:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 9 pid: 7231 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746065153.936480:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263355904:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065153.936554:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936561:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 28 pid: 13395 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746065153.936569:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263356032:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065153.936592:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065153.936603:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 9 pid: 13395 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746065153.936609:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263356160:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065153.936624:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065153.938660:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263577856:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13793us (14000us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065153.938684:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3797 00002000:00100000:3.0:1746065153.938697:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097e56d80 x1830881263577856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:69/0 lens 488/440 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065153.938707:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56d80 with x1830881263577856 ext(0->1048575) 00002000:00010000:3.0:1746065153.938713:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097e56d80 00000100:00100000:1.0:1746065153.940604:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263355904:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065153.941589:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065153.941719:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263580032 00000100:00100000:1.0:1746065153.941727:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263580032 00010000:00010000:1.0:1746065153.941762:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 10 pid: 7231 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746065153.941823:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6022 00000100:00100000:1.0:1746065153.941830:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263580032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065153.941840:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065153.941845:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 10 pid: 7231 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746065153.941853:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 10 pid: 7231 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746065153.941869:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146f929 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a75 expref: 10 pid: 7231 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746065153.941884:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065153.941887:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065153.941894:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065153.941899:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065153.941940:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263580032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 110us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065153.941946:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6022 00000100:00100000:0.0:1746065153.943377:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065153.943407:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263580288 00000100:00100000:0.0:1746065153.943412:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263580288 00010000:00010000:0.0:1746065153.943431:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 9 pid: 13395 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746065153.943462:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6023 00000100:00100000:0.0:1746065153.943468:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263580288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065153.943477:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065153.943481:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 9 pid: 13395 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746065153.943489:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 9 pid: 13395 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746065153.943501:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065153.943504:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.943510:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065153.943518:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065153.943541:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263580288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065153.943547:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6023 00000100:00100000:2.0:1746065153.943737:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263356032:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065153.943748:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc146f937 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a7c expref: 8 pid: 13395 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746065153.943762:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263356160:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065153.943796:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065153.947555:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065153.948804:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263580160 00000100:00100000:1.0:1746065153.948813:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263580160 00010000:00010000:1.0:1746065153.948841:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 29 pid: 13395 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746065153.948864:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6024 00000100:00100000:1.0:1746065153.948870:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263580160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065153.948881:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065153.948886:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 29 pid: 13395 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746065153.948896:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 29 pid: 13395 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746065153.948929:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc146f9d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ab4 expref: 29 pid: 13395 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746065153.948943:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065153.948947:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065153.948955:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065153.948960:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065153.948990:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065153.949025:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263580160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 155us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065153.949031:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6024 00000100:00100000:0.0:1746065153.949345:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065153.950034:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263580416 00000100:00100000:2.0:1746065153.950038:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263580416 00000100:00100000:2.0:1746065153.950064:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13661 00000100:00100000:2.0:1746065153.950069:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+11:32328:x1830881263580416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065153.950082:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065153.950095:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b1d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.950133:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.950140:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.950151:0:7203:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065153.950159:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.950168:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065153.950171:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065153.950174:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065153.950179:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174a00, rc 0) 00000100:00100000:2.0:1746065153.950200:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+12:32328:x1830881263580416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 130us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065153.950205:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13661 00000100:00100000:2.0:1746065153.950285:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263578368:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19704us (20989us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065153.950291:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3798 00002000:00100000:2.0:1746065153.950297:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880097e57480 x1830881263578368/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:69/0 lens 488/440 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065153.950303:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e57480 with x1830881263578368 ext(1048576->2097151) 00002000:00010000:2.0:1746065153.950306:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e57480 00000100:00100000:0.0:1746065153.950426:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263579136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18433us (18494us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065153.950432:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3802 00002000:00100000:0.0:1746065153.950438:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880091b64a80 x1830881263579136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:69/0 lens 488/440 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065153.950445:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64a80 with x1830881263579136 ext(1048576->2097151) 00002000:00010000:0.0:1746065153.950448:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64a80 00010000:00010000:3.0:1746065153.950862:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065153.950869:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00000040:00080000:3.0:1746065153.952640:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].568, 88 off58048 00000004:00080000:3.0:1746065153.952651:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749970877021ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952681:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].509, 88 off52848 00000004:00080000:3.0:1746065153.952686:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749970911991ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065153.952698:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].510, 88 off52936 00000004:00080000:3.0:1746065153.952700:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749970926841ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065153.952709:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].569, 88 off58136 00000004:00080000:3.0:1746065153.952711:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749970938016ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952718:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].570, 88 off58224 00000004:00080000:3.0:1746065153.952721:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749970947409ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952728:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].511, 88 off53024 00000004:00080000:3.0:1746065153.952730:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749970957011ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065153.952737:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].512, 88 off53112 00000004:00080000:3.0:1746065153.952739:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749970965966ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065153.952745:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].513, 88 off53200 00000004:00080000:3.0:1746065153.952747:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749970973908ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065153.952753:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].571, 88 off58312 00000004:00080000:3.0:1746065153.952755:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749970981681ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952846:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].514, 88 off53288 00000004:00080000:3.0:1746065153.952850:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749971076324ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065153.952862:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].572, 88 off58400 00000004:00080000:3.0:1746065153.952864:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749971090496ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952872:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].515, 88 off53376 00000004:00080000:3.0:1746065153.952874:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749971100571ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065153.952881:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].573, 88 off58488 00000004:00080000:3.0:1746065153.952884:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749971110318ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952891:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].574, 88 off58576 00000004:00080000:3.0:1746065153.952894:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749971120108ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952901:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].575, 88 off58664 00000004:00080000:3.0:1746065153.952914:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749971140029ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952924:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].576, 88 off58752 00000004:00080000:3.0:1746065153.952926:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749971152303ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065153.952933:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].516, 88 off53464 00000004:00080000:3.0:1746065153.952936:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749971162224ns, next at 615601404258ns, rc = 0 00000001:00080000:2.0:1746065153.955384:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935994 is committed 00000004:00080000:2.0:1746065153.955392:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 510 committed 00000004:00080000:2.0:1746065153.955401:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 568 committed 00000004:00080000:2.0:1746065153.955527:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 567 committed 00000004:00080000:2.0:1746065153.955529:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 566 committed 00000004:00080000:2.0:1746065153.955531:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 565 committed 00000004:00080000:2.0:1746065153.955533:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 509 committed 00000004:00080000:2.0:1746065153.955534:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 564 committed 00000004:00080000:2.0:1746065153.955535:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 508 committed 00000004:00080000:2.0:1746065153.955537:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 563 committed 00000004:00080000:2.0:1746065153.955538:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 507 committed 00000004:00080000:2.0:1746065153.955539:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 506 committed 00000004:00080000:2.0:1746065153.955541:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 505 committed 00000004:00080000:2.0:1746065153.955543:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 562 committed 00000004:00080000:2.0:1746065153.955545:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 561 committed 00000004:00080000:2.0:1746065153.955546:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 504 committed 00000004:00080000:2.0:1746065153.955548:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 503 committed 00000004:00080000:2.0:1746065153.955549:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 560 committed 00000001:00080000:2.0:1746065153.955556:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935992 is committed 00000001:00080000:2.0:1746065153.955561:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935990 is committed 00000100:00100000:0.0:1746065153.955632:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263356416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065153.955681:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065153.955703:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263356288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065153.955762:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263356672:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065153.955800:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263356544:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065153.955882:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.955892:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065153.955895:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065153.955899:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.955916:0:13395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.955922:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065153.955930:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263356928:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065153.955941:0:13395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065153.955945:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065153.955949:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263358336:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065153.955962:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263357440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065153.955974:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065153.955986:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065153.955995:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065153.955997:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263357184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065153.956008:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356416 00000100:00100000:0.0:1746065153.956009:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065153.956014:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356416 00000100:00100000:0.0:1746065153.956019:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263357696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065153.956032:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065153.956037:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356928 00000100:00100000:3.0:1746065153.956039:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356928 00000100:00100000:0.0:1746065153.956041:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263358208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065153.956048:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357440 00000100:00100000:3.0:1746065153.956049:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357440 00000100:00100000:0.0:1746065153.956051:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065153.956058:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356672 00000100:00100000:3.0:1746065153.956059:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356672 00000100:00100000:0.0:1746065153.956060:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065153.956064:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263357312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065153.956067:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357184 00000100:00100000:3.0:1746065153.956068:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357184 00000100:00100000:3.0:1746065153.956073:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357696 00000100:00100000:3.0:1746065153.956075:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357696 00000100:00100000:0.0:1746065153.956076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065153.956080:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358208 00000100:00100000:3.0:1746065153.956082:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358208 00000100:00100000:0.0:1746065153.956082:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263357824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065153.956089:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357312 00000100:00100000:3.0:1746065153.956090:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357312 00000100:00100000:0.0:1746065153.956094:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065153.956096:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357824 00000100:00100000:3.0:1746065153.956098:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357824 00000100:00100000:3.0:1746065153.956107:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13315 00000100:00100000:3.0:1746065153.956112:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263356416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065153.956130:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065153.956136:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065153.956142:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263357056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065153.956145:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263356800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065153.956157:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065153.956163:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356544 00000100:00100000:1.0:1746065153.956166:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356544 00000100:00100000:2.0:1746065153.956167:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263357568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065153.956178:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065153.956190:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263358080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065153.956205:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065153.956219:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356288 00000100:00100000:2.0:1746065153.956221:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356288 00002000:00010000:3.0:1746065153.956518:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065153.956521:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065151 -> 1746065151 00002000:00010000:3.0:1746065153.956523:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065151 -> 1746065151 00002000:00010000:3.0:1746065153.956524:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065151 -> 1746065151 00002000:00010000:3.0:1746065153.956526:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065153.956530:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13316 00000100:00100000:0.0:1746065153.956536:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3761:x1830881263356928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065153.956548:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3761:x1830881263356416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 437us (868us total) trans 17179873473 rc 0/0 00000100:00100000:3.0:1746065153.956554:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13315 00000100:00100000:3.0:1746065153.956566:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357056 00000100:00100000:3.0:1746065153.956568:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357056 00000100:00100000:3.0:1746065153.956575:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357568 00000100:00100000:3.0:1746065153.956577:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357568 00000100:00100000:3.0:1746065153.956582:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358080 00000100:00100000:3.0:1746065153.956583:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358080 00000100:00100000:3.0:1746065153.956591:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13317 00000100:00100000:0.0:1746065153.956594:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263356928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (648us total) trans 17179873474 rc 0/0 00000100:00100000:3.0:1746065153.956595:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881263357440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065153.956599:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13316 00000100:00100000:0.0:1746065153.956607:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13318 00000100:00100000:0.0:1746065153.956610:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3759:x1830881263356672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065153.956638:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065153.956640:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065153.956641:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065153.956642:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065153.956643:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065153.956644:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065152 -> 1746065152 00002000:00010000:0.0:1746065153.956645:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00002000:00010000:3.0:1746065153.956646:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065151 -> 1746065151 00002000:00010000:3.0:1746065153.956647:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065152 -> 1746065152 00002000:00010000:3.0:1746065153.956649:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065153.956661:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881263357440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (685us total) trans 21474840929 rc 0/0 00000100:00100000:0.0:1746065153.956662:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263356672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (676us total) trans 17179873475 rc 0/0 00000100:00100000:3.0:1746065153.956666:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13317 00000100:00100000:0.0:1746065153.956668:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13318 00000100:00100000:3.0:1746065153.956674:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13319 00000100:00100000:0.0:1746065153.956676:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13320 00000100:00100000:3.0:1746065153.956678:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3759:x1830881263357184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065153.956680:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263357696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065153.956710:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065153.956712:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065153.956714:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065153.956715:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065153.956717:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746065153.956721:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263357184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (711us total) trans 17179873476 rc 0/0 00000100:00100000:3.0:1746065153.956726:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13319 00000100:00100000:0.0:1746065153.956729:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263357696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (696us total) trans 21474840930 rc 0/0 00000100:00100000:0.0:1746065153.956733:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13320 00000100:00100000:3.0:1746065153.956735:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13321 00000100:00100000:3.0:1746065153.956739:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263358208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065153.956740:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13322 00000100:00100000:0.0:1746065153.956744:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263357312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065153.956786:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13323 00002000:00010000:3.0:1746065153.956789:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:3.0:1746065153.956791:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00000100:00100000:0.0:1746065153.956791:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263357824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065153.956793:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065153.956794:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065153.956796:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:3.0:1746065153.956812:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263358208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (759us total) trans 21474840932 rc 0/0 00000100:00100000:3.0:1746065153.956817:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13321 00000100:00100000:3.0:1746065153.956825:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13324 00002000:00010000:0.0:1746065153.956826:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:0.0:1746065153.956828:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00000100:00100000:3.0:1746065153.956829:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881263357056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065153.956830:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065153.956832:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065153.956833:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:0.0:1746065153.956849:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263357824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (754us total) trans 21474840933 rc 0/0 00000100:00100000:0.0:1746065153.956854:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13323 00000100:00100000:0.0:1746065153.956863:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13325 00000100:00100000:0.0:1746065153.956867:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263357568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065153.956874:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263357056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (716us total) trans 17179873477 rc 0/0 00000100:00100000:3.0:1746065153.956878:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13324 00000100:00100000:3.0:1746065153.956886:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13326 00000100:00100000:3.0:1746065153.956890:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263358080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065153.956898:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:0.0:1746065153.956900:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065152 -> 1746065152 00002000:00010000:0.0:1746065153.956916:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065151 -> 1746065151 00002000:00010000:0.0:1746065153.956918:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065152 -> 1746065152 00002000:00010000:0.0:1746065153.956920:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00002000:00010000:3.0:1746065153.956935:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746065153.956936:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3762:x1830881263357568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (757us total) trans 21474840934 rc 0/0 00002000:00010000:3.0:1746065153.956937:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065153.956938:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065153.956940:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00000100:00100000:0.0:1746065153.956941:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13325 00002000:00010000:3.0:1746065153.956942:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:3.0:1746065153.956954:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3762:x1830881263358080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (749us total) trans 21474840935 rc 0/0 00000100:00100000:3.0:1746065153.956958:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13326 00000004:00080000:0.0:1746065153.956968:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856f480/2, rc 0, transno 21474840933 00000100:00100000:0.0:1746065153.956974:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263357824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065153.956982:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856e680/2, rc 0, transno 21474840930 00000100:00100000:0.0:1746065153.956984:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263357696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065153.956989:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097241880/2, rc 0, transno 21474840932 00000100:00100000:0.0:1746065153.956992:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263358208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065153.957026:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13327 00000100:00100000:1.0:1746065153.957032:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881263356544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065153.957072:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065153.957075:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065151 -> 1746065151 00002000:00010000:1.0:1746065153.957076:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065151 -> 1746065151 00002000:00010000:1.0:1746065153.957078:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065151 -> 1746065151 00002000:00010000:1.0:1746065153.957079:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746065153.957098:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263356544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (967us total) trans 17179873478 rc 0/0 00000100:00100000:1.0:1746065153.957103:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13327 00000100:00100000:1.0:1746065153.957136:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065153.957154:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263358464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065153.957170:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065153.957186:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358464 00000100:00100000:1.0:1746065153.957186:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356800 00000100:00100000:2.0:1746065153.957189:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358464 00000100:00100000:1.0:1746065153.957189:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356800 00000100:00100000:2.0:1746065153.957200:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13328 00000100:00100000:1.0:1746065153.957202:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13329 00000100:00100000:2.0:1746065153.957204:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881263356288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065153.957205:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881263358464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065153.957238:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065153.957240:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065153.957242:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065153.957243:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065153.957245:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065153.957251:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881263358464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (80us total) trans 21474840936 rc 0/0 00000100:00100000:1.0:1746065153.957256:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13329 00000100:00100000:2.0:1746065153.957260:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263356288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (1124us total) trans 17179873479 rc 0/0 00000100:00100000:1.0:1746065153.957265:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13330 00000100:00100000:1.0:1746065153.957269:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263356800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065153.957314:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3760:x1830881263356800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (177us total) trans 17179873480 rc 0/0 00000100:00100000:1.0:1746065153.957319:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13330 00000004:00080000:1.0:1746065153.957337:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097242a00/2, rc 0, transno 21474840936 00000100:00100000:1.0:1746065153.957341:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263358464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065153.957348:0:3760:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873471 gen 2 00000004:00080000:1.0:1746065153.957351:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aceca80, transno 17179873464 00000004:00080000:1.0:1746065153.957357:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aceed80, transno 17179873465 00000004:00080000:1.0:1746065153.957359:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aceea00, transno 17179873466 00000004:00080000:1.0:1746065153.957361:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acef800, transno 17179873467 00000004:00080000:1.0:1746065153.957363:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acec000, transno 17179873468 00000004:00080000:1.0:1746065153.957365:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acece00, transno 17179873469 00000004:00080000:1.0:1746065153.957367:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad5f80, transno 17179873470 00000004:00080000:1.0:1746065153.957369:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad5500, transno 17179873471 00000100:00100000:1.0:1746065153.957373:0:3760:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880091b66680 x1830881263356288/t17179873479(17179873479) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065169 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065153.957380:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b66680/2, rc 0, transno 17179873479 00000100:00100000:1.0:1746065153.957383:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263356288:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065153.957391:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc3b80/2, rc 0, transno 17179873480 00000100:00100000:1.0:1746065153.957393:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263356800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065153.957400:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13328 00000004:00080000:2.0:1746065153.957421:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097242300/2, rc 0, transno 21474840935 00000100:00100000:2.0:1746065153.957424:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263358080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065153.957429:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b65c00/2, rc 0, transno 17179873478 00000100:00100000:2.0:1746065153.957431:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263356544:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065153.957437:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc3800/2, rc 0, transno 17179873477 00000100:00100000:2.0:1746065153.957439:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263357056:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065153.957444:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856f100/2, rc 0, transno 21474840934 00000100:00100000:2.0:1746065153.957446:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263357568:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065153.957463:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 8 done 00000004:00080000:0.0:1746065153.957592:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b66a00/2, rc 0, transno 17179873475 00000100:00100000:0.0:1746065153.957595:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263356672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065153.957602:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc1500/2, rc 0, transno 17179873476 00000100:00100000:0.0:1746065153.957604:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263357184:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065153.957620:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856d880/2, rc 0, transno 21474840929 00000100:00100000:0.0:1746065153.957622:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263357440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065153.957627:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263357952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065153.957836:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746065153.957885:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065153.957887:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065153.957889:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065153.957890:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065152 -> 1746065152 00002000:00010000:2.0:1746065153.957892:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:2.0:1746065153.957925:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263357312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1179us (1847us total) trans 21474840931 rc 0/0 00000100:00100000:2.0:1746065153.957930:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13322 00000004:00080000:1.0:1746065153.958160:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bf800/2, rc 0, transno 21474840931 00000100:00100000:1.0:1746065153.958165:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263357312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065153.958418:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b67800/2, rc 0, transno 17179873473 00000100:00100000:1.0:1746065153.958421:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263356416:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065153.958428:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cc0380/2, rc 0, transno 17179873474 00000100:00100000:1.0:1746065153.958430:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263356928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065153.958457:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357952 00000100:00100000:2.0:1746065153.958460:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357952 00000100:00100000:2.0:1746065153.958478:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13331 00000100:00100000:2.0:1746065153.958482:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263357952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065153.958550:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263357952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (714us total) trans 21474840937 rc 0/0 00000100:00100000:2.0:1746065153.958558:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13331 00000004:00080000:1.0:1746065153.958590:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097241180/2, rc 0, transno 21474840937 00000100:00100000:1.0:1746065153.958594:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263357952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065153.967200:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263578112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36590us (37942us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065153.967210:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3799 00002000:00100000:2.0:1746065153.967220:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097e56680 x1830881263578112/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:69/0 lens 488/440 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065153.967228:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097e56680 with x1830881263578112 ext(1048576->2097151) 00002000:00010000:2.0:1746065153.967233:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097e56680 00000100:00100000:0.0:1746065153.969340:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.969895:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263358336:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065153.969921:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263580544 00000100:00100000:2.0:1746065153.969927:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263580544 00010000:00010000:3.0:1746065153.969942:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc146fa4f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 11 pid: 13395 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065153.969968:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065153.969969:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4932 00000100:00100000:2.0:1746065153.969975:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+10:32328:x1830881263580544:12345-192.168.202.27@tcp:49:cat.0 00010000:00010000:3.0:1746065153.969991:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:3.0:1746065153.970023:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+10:32324:x1830881263579904:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 33730us (33869us total) trans 8589935994 rc 0/0 00000100:00100000:3.0:1746065153.970029:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13660 00000100:00100000:2.0:1746065153.970029:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+10:32328:x1830881263580544:12345-192.168.202.27@tcp:49:cat.0 Request processed in 54us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065153.970033:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4932 00000100:00100000:2.0:1746065153.971447:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263578624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 39970us (40077us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065153.971455:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3800 00002000:00100000:2.0:1746065153.971463:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880091b65880 x1830881263578624/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:69/0 lens 488/440 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065153.971476:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65880 with x1830881263578624 ext(1048576->2097151) 00002000:00010000:2.0:1746065153.971481:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b65880 00000100:00100000:3.0:1746065153.976443:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263578880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 44925us (45002us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065153.976453:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3801 00002000:00100000:3.0:1746065153.976463:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88011dad6300 x1830881263578880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:69/0 lens 488/440 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065153.976471:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6300 with x1830881263578880 ext(0->1048575) 00002000:00010000:3.0:1746065153.976477:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad6300 00000100:00100000:2.0:1746065153.982014:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263579264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 47660us (47835us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065153.982025:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3803 00002000:00100000:2.0:1746065153.982034:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880091b65f80 x1830881263579264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:69/0 lens 488/440 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065153.982042:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65f80 with x1830881263579264 ext(1048576->2097151) 00002000:00010000:2.0:1746065153.982047:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65f80 00000100:00100000:0.0:1746065153.992425:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065153.992551:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263580672 00000100:00100000:3.0:1746065153.992559:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263580672 00000100:00100000:1.0:1746065153.992696:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263579648:12345-192.168.202.27@tcp:3:cat.0 Request processed in 57876us (58444us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065153.992708:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3804 00002000:00100000:1.0:1746065153.992718:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800907bc380 x1830881263579648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:69/0 lens 488/440 e 0 to 0 dl 1746065164 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065153.992726:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc380 with x1830881263579648 ext(1048576->2097151) 00002000:00010000:1.0:1746065153.992731:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bc380 00000100:00100000:3.0:1746065153.994628:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13662 00000100:00100000:3.0:1746065153.994641:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+27:32329:x1830881263580672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065153.994661:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065153.994679:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b24 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.994722:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.994735:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065153.994750:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065153.994752:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065153.994755:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b9400, rc 0) 00000100:00100000:3.0:1746065153.994808:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+28:32329:x1830881263580672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 170us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065153.994813:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13662 00000100:00100000:0.0:1746065154.002098:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.002158:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263580800 00000100:00100000:2.0:1746065154.002165:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263580800 00000100:00100000:2.0:1746065154.002211:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13332 00000100:00100000:2.0:1746065154.002218:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+8:32324:x1830881263580800:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065154.002233:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.002247:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b2b expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.002272:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.002280:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.002288:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.002293:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.002295:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.002298:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3551232->4001791] (req 3551232->4001791) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.002327:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.002337:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 22 pid: 13375 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.002348:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263358592:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.002433:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.002440:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 9 pid: 9550 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.002447:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263358720:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.002803:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.002812:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 12 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.002820:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263358848:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.003637:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.006821:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.006927:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263358592:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.006939:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263358720:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.006945:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263358848:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.006972:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3551232->4001791] (req 3551232->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.006986:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719c00, rc 0) 00000100:00100000:2.0:1746065154.007022:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+9:32324:x1830881263580800:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4804us (4931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.007030:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13332 00000100:00100000:0.0:1746065154.007176:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.007224:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263580928 00000100:00100000:1.0:1746065154.007230:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263580928 00010000:00010000:1.0:1746065154.007251:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 9 pid: 9550 timeout: 850 lvb_type: 1 00000100:00100000:1.0:1746065154.007276:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263581184 00000100:00100000:1.0:1746065154.007278:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263581184 00010000:00010000:1.0:1746065154.007285:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 23 pid: 13375 timeout: 850 lvb_type: 1 00000100:00100000:1.0:1746065154.007297:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6025 00000100:00100000:1.0:1746065154.007303:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263580928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065154.007313:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065154.007328:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 9 pid: 9550 timeout: 850 lvb_type: 1 00010000:00010000:1.0:1746065154.007337:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 9 pid: 9550 timeout: 850 lvb_type: 1 00010000:00010000:1.0:1746065154.007355:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc146fa33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b01 expref: 9 pid: 9550 timeout: 850 lvb_type: 1 00010000:00010000:1.0:1746065154.007374:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.007540:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6026 00000100:00100000:3.0:1746065154.007547:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881263581184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.007554:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065154.007562:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 23 pid: 13375 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.007569:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 23 pid: 13375 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.007578:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc146fa17 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933afa expref: 23 pid: 13375 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.007590:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.007607:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881263581184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 61us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.007612:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6026 00000100:00100000:1.0:1746065154.008009:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263580928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 704us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.008015:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6025 00000100:00100000:2.0:1746065154.010871:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.010920:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.010935:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263581440 00000100:00100000:1.0:1746065154.010943:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263581440 00000100:00100000:2.0:1746065154.010947:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:1.0:1746065154.010974:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88008f3e4380 x1830881263581440/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065154.010976:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:1.0:1746065154.010983:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4380 with x1830881263581440 ext(1048576->2097151) 00002000:00010000:1.0:1746065154.010989:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e4380 00000100:00100000:2.0:1746065154.010992:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263581056 00000100:00100000:2.0:1746065154.010996:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263581056 00010000:00010000:2.0:1746065154.011013:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 13 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.011375:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6027 00000100:00100000:2.0:1746065154.011382:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263581056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.011393:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.011410:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 13 pid: 11461 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.011420:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 13 pid: 11461 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.011438:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc146f95a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a9f expref: 13 pid: 11461 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.011453:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.011454:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.011460:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.011467:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.011493:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.011502:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263358976:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065154.011570:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065154.011859:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263581568 00000100:00100000:1.0:1746065154.011862:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263581568 00002000:00100000:1.0:1746065154.011875:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800a4e50700 x1830881263581568/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.011883:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50700 with x1830881263581568 ext(1048576->2097151) 00002000:00010000:1.0:1746065154.011887:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e50700 00000100:00100000:1.0:1746065154.011895:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263581952 00000100:00100000:1.0:1746065154.011896:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263581952 00002000:00100000:1.0:1746065154.011913:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012edaf100 x1830881263581952/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065154.011914:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3805 00002000:00100000:1.0:1746065154.011919:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881263581952 ext(1048576->2097151) 00000100:00100000:3.0:1746065154.011922:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263581440:12345-192.168.202.27@tcp:3:multiop.0 00002000:00010000:1.0:1746065154.011922:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edaf100 00000100:00100000:1.0:1746065154.011932:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3806 00000100:00100000:1.0:1746065154.011937:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263581568:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065154.012448:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3807 00000100:00100000:1.0:1746065154.012454:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263581952:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065154.018924:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.019019:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263582208 00000100:00100000:1.0:1746065154.019028:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263582208 00002000:00100000:1.0:1746065154.019064:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3551232->3555327) req@ffff880136a7b480 x1830881263582208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.019080:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b480 with x1830881263582208 ext(3551232->3555327) 00002000:00010000:1.0:1746065154.019085:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a7b480 00000100:00100000:2.0:1746065154.019089:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263358976:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065154.019105:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065154.019637:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3808 00000100:00100000:1.0:1746065154.019646:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263582208:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065154.020265:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263581056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8881us (9286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.020275:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6027 00000100:00100000:1.0:1746065154.020474:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263582208:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 827us (1571us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065154.020480:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3808 00002000:00100000:1.0:1746065154.020486:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3551232->3555327) req@ffff880136a7b480 x1830881263582208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.020494:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b480 with x1830881263582208 ext(3551232->3555327) 00002000:00010000:1.0:1746065154.020497:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a7b480 00000100:00100000:1.0:1746065154.021496:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263581568:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9555us (10572us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065154.021503:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3806 00002000:00100000:1.0:1746065154.021508:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800a4e50700 x1830881263581568/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.021516:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50700 with x1830881263581568 ext(1048576->2097151) 00002000:00010000:1.0:1746065154.021520:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e50700 00000100:00100000:0.0:1746065154.027876:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.034260:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.037608:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263582592 00000100:00100000:1.0:1746065154.037619:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263582592 00000100:00100000:0.0:1746065154.037630:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.037649:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263582720 00000100:00100000:0.0:1746065154.037652:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263582720 00002000:00100000:1.0:1746065154.037669:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880136a79180 x1830881263582592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.037669:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880136a7a300 x1830881263582720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.037677:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79180 with x1830881263582592 ext(1048576->2097151) 00002000:00100000:0.0:1746065154.037677:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7a300 with x1830881263582720 ext(1048576->2097151) 00002000:00010000:1.0:1746065154.037682:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a79180 00002000:00010000:0.0:1746065154.037682:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7a300 00000100:00100000:0.0:1746065154.037708:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263582848 00000100:00100000:0.0:1746065154.037711:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263582848 00002000:00100000:0.0:1746065154.037720:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880136a7bb80 x1830881263582848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.037726:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7bb80 with x1830881263582848 ext(1048576->2097151) 00002000:00010000:0.0:1746065154.037729:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7bb80 00000100:00100000:2.0:1746065154.037852:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3809 00000100:00100000:2.0:1746065154.037860:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263582720:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.038291:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3810 00000100:00100000:3.0:1746065154.038298:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263582592:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.039052:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263581440:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 27128us (28185us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.039059:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3805 00002000:00100000:3.0:1746065154.039065:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88008f3e4380 x1830881263581440/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.039071:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4380 with x1830881263581440 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.039075:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e4380 00000100:00100000:3.0:1746065154.039090:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3811 00000100:00100000:3.0:1746065154.039095:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263582848:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065154.043134:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263581952:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 30671us (32177us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065154.043143:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3807 00002000:00100000:1.0:1746065154.043152:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012edaf100 x1830881263581952/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.043160:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881263581952 ext(1048576->2097151) 00002000:00010000:1.0:1746065154.043165:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edaf100 00000100:00100000:0.0:1746065154.045670:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.045751:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263583232 00000100:00100000:1.0:1746065154.045758:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263583232 00002000:00100000:1.0:1746065154.045816:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3997696->4001791) req@ffff880136a78a80 x1830881263583232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.045825:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78a80 with x1830881263583232 ext(3997696->4001791) 00002000:00010000:1.0:1746065154.045830:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a78a80 00000100:00100000:1.0:1746065154.045845:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3812 00000100:00100000:1.0:1746065154.045852:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263583232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065154.045968:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263583232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 116us (304us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065154.045974:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3812 00002000:00100000:1.0:1746065154.045978:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3997696->4001791) req@ffff880136a78a80 x1830881263583232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.045985:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78a80 with x1830881263583232 ext(3997696->4001791) 00002000:00010000:1.0:1746065154.045987:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a78a80 00000100:00100000:3.0:1746065154.066798:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263582592:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28471us (38898us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.066807:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3810 00002000:00100000:3.0:1746065154.066816:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880136a79180 x1830881263582592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.066829:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79180 with x1830881263582592 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.066835:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a79180 00000100:00100000:3.0:1746065154.075150:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263582848:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36046us (37514us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.075159:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3811 00002000:00100000:3.0:1746065154.075166:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880136a7bb80 x1830881263582848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.075174:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7bb80 with x1830881263582848 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.075179:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7bb80 00000100:00100000:2.0:1746065154.082338:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.082404:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263583488 00000100:00100000:1.0:1746065154.082413:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263583488 00000100:00100000:1.0:1746065154.082454:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4933 00000100:00100000:1.0:1746065154.082461:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+9:32324:x1830881263583488:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065154.082627:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+10:32324:x1830881263583488:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 166us (296us total) trans 8589935995 rc 0/0 00000100:00100000:1.0:1746065154.082633:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4933 00000100:00100000:0.0:1746065154.083554:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263582720:12345-192.168.202.27@tcp:3:cat.0 Request processed in 45694us (49300us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065154.083561:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3809 00002000:00100000:0.0:1746065154.083569:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880136a7a300 x1830881263582720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.083578:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7a300 with x1830881263582720 ext(1048576->2097151) 00002000:00010000:0.0:1746065154.083582:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7a300 00000100:00100000:0.0:1746065154.094362:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.094454:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263583616 00000100:00100000:2.0:1746065154.094462:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263583616 00000100:00100000:2.0:1746065154.094508:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13333 00000100:00100000:2.0:1746065154.094514:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+22:32323:x1830881263583616:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065154.094529:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.094543:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b32 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.094565:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.094572:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.094573:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.094576:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.094599:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 7 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.094609:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 7 pid: 10219 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.094619:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263359104:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.103394:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065154.105024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.106274:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.106621:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263583872 00000100:00100000:3.0:1746065154.106629:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263583872 00002000:00100000:3.0:1746065154.106665:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009aceca80 x1830881263583872/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 504/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.106674:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceca80 with x1830881263583872 ext(2097152->4194303) 00010000:00010000:3.0:1746065154.106681:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 8 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.106693:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 8 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746065154.106700:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aceca80 00000100:00100000:3.0:1746065154.106943:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263584128 00000100:00100000:3.0:1746065154.106947:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263584128 00002000:00100000:3.0:1746065154.106963:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009aceed80 x1830881263584128/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.106974:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceed80 with x1830881263584128 ext(2097152->4194303) 00002000:00010000:3.0:1746065154.106977:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aceed80 00000100:00100000:2.0:1746065154.107020:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1322 00000100:00100000:2.0:1746065154.107028:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263583872:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.108260:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3813 00000100:00100000:3.0:1746065154.108268:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263584128:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.115921:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263359104:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.115949:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.115962:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0c00, rc 0) 00000100:00100000:3.0:1746065154.116004:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+23:32323:x1830881263583616:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 21489us (21648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.116012:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13333 00000100:00100000:0.0:1746065154.118507:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.119595:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263584384 00000100:00100000:2.0:1746065154.119605:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263584384 00002000:00100000:2.0:1746065154.119640:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3551232->4001791) req@ffff880136a79500 x1830881263584384/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.119649:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79500 with x1830881263584384 ext(3551232->4001791) 00010000:00010000:2.0:1746065154.119657:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.119669:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746065154.119675:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136a79500 00000100:00100000:2.0:1746065154.119693:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1323 00000100:00100000:2.0:1746065154.119700:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263584384:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065154.120337:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.120424:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263584256 00000100:00100000:3.0:1746065154.120427:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263584256 00000100:00100000:3.0:1746065154.120450:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13334 00000100:00100000:3.0:1746065154.120455:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263584256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065154.120464:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.120475:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146fa79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b39 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.120512:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263359232:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065154.120563:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746065154.124933:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065152 -> 1746065154 00002000:00010000:3.0:1746065154.124938:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065151 -> 1746065154 00002000:00010000:3.0:1746065154.124940:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065152 -> 1746065154 00000100:00100000:3.0:1746065154.124954:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263359232:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065154.124982:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146fa79 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b39 expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.124995:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146fa79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b39 expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.126383:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc400, rc 0) 00000100:00100000:3.0:1746065154.126435:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263584256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5976us (6096us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065154.126443:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13334 00000100:00100000:2.0:1746065154.133705:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263584128:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25429us (27425us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065154.133714:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3813 00002000:00100000:2.0:1746065154.133725:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009aceed80 x1830881263584128/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.133734:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceed80 with x1830881263584128 ext(2097152->4194303) 00002000:00010000:2.0:1746065154.133739:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aceed80 00000100:00100000:0.0:1746065154.138648:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.138821:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263583872:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31792us (33800us total) trans 0 rc 1646592/1646592 00000100:00100000:0.0:1746065154.138830:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1322 00002000:00100000:0.0:1746065154.138840:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009aceca80 x1830881263583872/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 504/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 1646592/1646592 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.138849:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceca80 with x1830881263583872 ext(2097152->4194303) 00010000:00010000:0.0:1746065154.138858:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 12 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.138870:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 12 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746065154.138877:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aceca80 00000100:00100000:2.0:1746065154.138899:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263584512 00000100:00100000:2.0:1746065154.138914:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263584512 00000100:00100000:2.0:1746065154.138946:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13335 00000100:00100000:2.0:1746065154.138952:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+23:32329:x1830881263584512:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.138968:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.138981:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b40 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.139000:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.139005:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.139010:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065154.139013:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.139039:0:10219:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.139050:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 24 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.139058:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1400, rc 0) 00000100:00100000:2.0:1746065154.139076:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+24:32329:x1830881263584512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 125us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.139081:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13335 00000100:00100000:3.0:1746065154.139536:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263584384:12345-192.168.202.27@tcp:4:cat.0 Request processed in 19835us (21307us total) trans 21474840938 rc 0/0 00000100:00100000:3.0:1746065154.139543:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1323 00002000:00100000:3.0:1746065154.139549:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3551232->4001791) req@ffff880136a79500 x1830881263584384/t21474840938(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.139556:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79500 with x1830881263584384 ext(3551232->4001791) 00010000:00010000:3.0:1746065154.139560:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.139570:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746065154.139575:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136a79500 00000100:00100000:0.0:1746065154.149954:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.150004:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.150020:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263584640 00000100:00100000:2.0:1746065154.150028:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263584640 00010000:00010000:2.0:1746065154.150060:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.150097:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6028 00000100:00100000:2.0:1746065154.150104:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263584640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.150117:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.150134:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.150145:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.150164:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c719c00/0xad6b7ddc146fa6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3551232->4001791) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b2b expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.150178:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.150180:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.150184:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.150190:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.150216:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.150225:0:9565:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 23 pid: 10219 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.150235:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263359488:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065154.150240:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263584768 00000100:00100000:3.0:1746065154.150244:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263584768 00000100:00100000:3.0:1746065154.150267:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13336 00000100:00100000:3.0:1746065154.150273:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+10:32328:x1830881263584768:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065154.150285:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.150296:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b47 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.150301:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065154.150311:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065154.150312:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065154.150316:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.150324:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.150330:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc600, rc 0) 00000100:00100000:3.0:1746065154.150352:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+11:32328:x1830881263584768:12345-192.168.202.27@tcp:101:cat.0 Request processed in 79us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.150357:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13336 00000100:00100000:0.0:1746065154.154742:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.156693:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263359488:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065154.156711:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.156766:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263584640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6662us (6819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.156796:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6028 00000100:00100000:3.0:1746065154.157451:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263585024 00000100:00100000:3.0:1746065154.157458:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263585024 00002000:00100000:3.0:1746065154.157492:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3129344->3133439) req@ffff8800957db480 x1830881263585024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.157500:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db480 with x1830881263585024 ext(3129344->3133439) 00010000:00010000:3.0:1746065154.157508:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 24 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.157520:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 24 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746065154.157525:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957db480 00000100:00100000:3.0:1746065154.157723:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1324 00000100:00100000:3.0:1746065154.157730:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263585024:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.157864:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263585024:12345-192.168.202.27@tcp:3:cat.0 Request processed in 134us (3128us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065154.157870:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1324 00002000:00100000:3.0:1746065154.157875:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3129344->3133439) req@ffff8800957db480 x1830881263585024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.157886:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db480 with x1830881263585024 ext(3129344->3133439) 00010000:00010000:3.0:1746065154.157891:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 24 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.157899:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 24 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746065154.157917:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957db480 00000100:00100000:2.0:1746065154.164211:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.164480:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263585280 00000100:00100000:0.0:1746065154.164488:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263585280 00000100:00100000:0.0:1746065154.164531:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13337 00000100:00100000:0.0:1746065154.164538:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+27:32323:x1830881263585280:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065154.164552:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.164567:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b4e expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.164588:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.164601:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 7 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.164607:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 28 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.164612:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.164614:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.164617:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [2097152->2994175] (req 2097152->2994175) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.164638:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 28 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.164646:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 28 pid: 9550 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.164656:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263359616:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065154.164728:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 7 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.164735:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 7 pid: 13375 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.164742:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263359744:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065154.164766:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.164787:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 9 pid: 3068 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.164794:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263359872:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.164810:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.164868:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.166034:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263585408 00000100:00100000:0.0:1746065154.166040:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263585408 00002000:00100000:0.0:1746065154.166069:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3129344->3145727) req@ffff880091a90380 x1830881263585408/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 16872/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.166076:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90380 with x1830881263585408 ext(3129344->3145727) 00010000:00010000:0.0:1746065154.166082:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 24 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.166091:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 24 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746065154.166095:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a90380 00000100:00100000:0.0:1746065154.166122:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1325 00000100:00100000:0.0:1746065154.166129:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881263585408:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065154.169349:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263585408:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3212us (4473us total) trans 21474840939 rc 0/0 00000100:00100000:0.0:1746065154.169359:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1325 00002000:00100000:0.0:1746065154.169369:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3129344->3145727) req@ffff880091a90380 x1830881263585408/t21474840939(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 16872/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.169378:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90380 with x1830881263585408 ext(3129344->3145727) 00010000:00010000:0.0:1746065154.169385:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 26 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.169396:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 26 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746065154.169402:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a90380 00000100:00100000:0.0:1746065154.170364:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.170385:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.170416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.170447:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263585536 00000100:00100000:0.0:1746065154.170451:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263585536 00010000:00010000:0.0:1746065154.170469:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 29 pid: 9550 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.170485:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263585664 00000100:00100000:0.0:1746065154.170486:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263585664 00010000:00010000:0.0:1746065154.170494:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 10 pid: 3068 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.170502:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263585792 00000100:00100000:0.0:1746065154.170504:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263585792 00010000:00010000:0.0:1746065154.170510:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 8 pid: 13375 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.170524:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6029 00000100:00100000:0.0:1746065154.170529:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263585536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.170539:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.170551:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 29 pid: 9550 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.170558:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 29 pid: 9550 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.170896:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6030 00000100:00100000:2.0:1746065154.170918:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263585664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.170925:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.170934:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 10 pid: 3068 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.170942:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 10 pid: 3068 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.170955:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.170978:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263585664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.170984:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6030 00000100:00100000:2.0:1746065154.170997:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6031 00000100:00100000:2.0:1746065154.171001:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263585792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.171006:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.171013:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 8 pid: 13375 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.171020:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 8 pid: 13375 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.171031:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.171033:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.171038:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.171045:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.171070:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.171080:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263360000:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065154.171125:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56000 going to sleep for 11 seconds 00010000:00010000:2.0:1746065154.171153:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1bc00/0xad6b7ddc146fa1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b0f expref: 29 pid: 9550 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.171168:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263359616:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.171189:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc146fa48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b08 expref: 8 pid: 13375 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.171196:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263359744:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.171205:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc146f961 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aa6 expref: 9 pid: 3068 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.171213:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263359872:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.171235:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.171243:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:2.0:1746065154.171263:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:32323:x1830881263585280:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6725us (7059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.171268:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13337 00010000:00010000:0.0:1746065154.172292:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.172328:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263585536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1796us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.172335:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6029 00000100:00100000:2.0:1746065154.172691:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.173875:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263585920 00000100:00100000:0.0:1746065154.173881:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263585920 00010000:00010000:0.0:1746065154.173910:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 26 pid: 10219 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.174999:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6032 00000100:00100000:0.0:1746065154.175008:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263585920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.175021:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.175038:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 26 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.175053:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 26 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.175071:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc146fa72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b32 expref: 26 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.175234:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.175236:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.175243:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.175250:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.175257:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.175258:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.175261:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.175267:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.175292:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.175302:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263360128:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065154.175337:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263360000:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065154.175350:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.175370:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263585792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4368us (4953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.175377:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6031 00010000:00010000:0.0:1746065154.175381:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 25 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.175389:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263360256:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065154.175407:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.185129:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.186575:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263586176 00000100:00100000:2.0:1746065154.186585:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263586176 00002000:00100000:2.0:1746065154.186622:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2990080->2994175) req@ffff88008f7fdc00 x1830881263586176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.186631:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdc00 with x1830881263586176 ext(2990080->2994175) 00002000:00010000:2.0:1746065154.186635:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fdc00 00000100:00100000:2.0:1746065154.186665:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3814 00000100:00100000:2.0:1746065154.186673:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263586176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065154.186807:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263586176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 133us (1685us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065154.186813:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3814 00002000:00100000:2.0:1746065154.186819:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2990080->2994175) req@ffff88008f7fdc00 x1830881263586176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.186826:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdc00 with x1830881263586176 ext(2990080->2994175) 00002000:00010000:2.0:1746065154.186829:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fdc00 00000100:00100000:0.0:1746065154.194278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.194526:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263586432 00000100:00100000:3.0:1746065154.194535:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263586432 00002000:00100000:3.0:1746065154.194570:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88008f7fd180 x1830881263586432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.194579:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd180 with x1830881263586432 ext(2097152->3145727) 00002000:00010000:3.0:1746065154.194583:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd180 00000100:00100000:3.0:1746065154.194607:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3815 00000100:00100000:3.0:1746065154.194613:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263586432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065154.195978:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263360128:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065154.195989:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263360256:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065154.196008:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.196048:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263585920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 21041us (23357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.196055:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6032 00000100:00100000:0.0:1746065154.196197:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.196279:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263586688 00000100:00100000:1.0:1746065154.196284:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263586688 00002000:00100000:1.0:1746065154.196321:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88008f7fe680 x1830881263586688/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.196328:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe680 with x1830881263586688 ext(3145728->4194303) 00002000:00010000:1.0:1746065154.196332:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe680 00000100:00100000:1.0:1746065154.196354:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3816 00000100:00100000:1.0:1746065154.196361:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263586688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065154.204876:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.205655:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263586944 00000100:00100000:2.0:1746065154.205664:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263586944 00000100:00100000:2.0:1746065154.205717:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4934 00000100:00100000:2.0:1746065154.205725:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:32323:x1830881263586944:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065154.205958:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32323:x1830881263586944:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 232us (1088us total) trans 8589935996 rc 0/0 00000100:00100000:2.0:1746065154.205964:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4934 00000100:00100000:3.0:1746065154.213237:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263586432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18615us (18958us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.213248:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3815 00002000:00100000:3.0:1746065154.213262:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88008f7fd180 x1830881263586432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.213270:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd180 with x1830881263586432 ext(2097152->3145727) 00002000:00010000:3.0:1746065154.213274:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fd180 00000100:00100000:0.0:1746065154.228854:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.228935:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.228969:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263587456 00000100:00100000:0.0:1746065154.228976:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263587456 00002000:00100000:0.0:1746065154.229011:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2994176->3145727) req@ffff88008f7fca80 x1830881263587456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.229020:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fca80 with x1830881263587456 ext(2994176->3145727) 00002000:00010000:0.0:1746065154.229025:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fca80 00000100:00100000:0.0:1746065154.229043:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3817 00000100:00100000:0.0:1746065154.229050:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263587456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065154.229471:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263586688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33109us (33274us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065154.229478:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3816 00002000:00100000:1.0:1746065154.229484:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88008f7fe680 x1830881263586688/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.229490:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe680 with x1830881263586688 ext(3145728->4194303) 00002000:00010000:1.0:1746065154.229493:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe680 00000100:00100000:3.0:1746065154.230329:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263587328 00000100:00100000:3.0:1746065154.230335:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263587328 00000100:00100000:3.0:1746065154.230380:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13663 00000100:00100000:3.0:1746065154.230386:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+10:32332:x1830881263587328:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065154.230402:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.230415:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fa95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b55 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.230477:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230487:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230497:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230507:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230512:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230520:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230601:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230608:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230613:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065154.230620:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065154.230675:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230681:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230685:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230689:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abada00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.230692:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230697:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230705:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065154.230707:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.230710:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230716:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc146fa9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230730:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230734:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230738:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230741:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.230743:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230748:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230753:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090dc5300) 00010000:00010000:3.0:1746065154.230755:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.230757:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230761:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc146faa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.230812:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fa95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 13 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.230823:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.230832:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065154.230834:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065154.230836:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:3.0:1746065154.230865:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+12:32332:x1830881263587328:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 480us (2019us total) trans 8589935997 rc 0/0 00000100:00100000:3.0:1746065154.230870:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13663 00000100:00100000:0.0:1746065154.233504:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.236653:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.236807:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263587456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7756us (7870us total) trans 0 rc 151552/151552 00000100:00100000:0.0:1746065154.236816:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3817 00002000:00100000:0.0:1746065154.236826:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2994176->3145727) req@ffff88008f7fca80 x1830881263587456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 151552/151552 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.236835:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fca80 with x1830881263587456 ext(2994176->3145727) 00002000:00010000:0.0:1746065154.236840:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fca80 00000100:00100000:0.0:1746065154.236859:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263587712 00000100:00100000:0.0:1746065154.236865:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263587712 00002000:00100000:0.0:1746065154.236889:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88009a6dfb80 x1830881263587712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.236895:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dfb80 with x1830881263587712 ext(3145728->4194303) 00002000:00010000:0.0:1746065154.236897:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dfb80 00000100:00100000:0.0:1746065154.236922:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263587968 00000100:00100000:0.0:1746065154.236925:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263587968 00002000:00100000:0.0:1746065154.236936:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009a6ddc00 x1830881263587968/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.236942:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddc00 with x1830881263587968 ext(3145728->4194303) 00002000:00010000:0.0:1746065154.236945:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddc00 00000100:00100000:0.0:1746065154.237556:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3818 00000100:00100000:0.0:1746065154.237565:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263587712:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065154.237703:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3819 00000100:00100000:2.0:1746065154.237709:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263587968:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065154.243051:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.243144:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263588096 00000100:00100000:2.0:1746065154.243152:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263588096 00000100:00100000:2.0:1746065154.243201:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13338 00000100:00100000:2.0:1746065154.243208:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:32328:x1830881263588096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.243225:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.243239:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b5c expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.243264:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.243270:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.243272:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.243274:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.243298:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.243307:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 28 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.243316:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263360384:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.243372:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.250405:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263360384:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.250438:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.250457:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:2.0:1746065154.252231:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:32328:x1830881263588096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9016us (9180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.252239:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13338 00000100:00100000:1.0:1746065154.252518:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263587712:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14953us (19019us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065154.252526:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3818 00002000:00100000:1.0:1746065154.252534:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff88009a6dfb80 x1830881263587712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.252542:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dfb80 with x1830881263587712 ext(3145728->4194303) 00002000:00010000:1.0:1746065154.252547:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dfb80 00000100:00100000:0.0:1746065154.253921:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.254025:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263588224 00000100:00100000:1.0:1746065154.254032:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263588224 00002000:00100000:1.0:1746065154.254061:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2994175) req@ffff880099ec4700 x1830881263588224/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.254069:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4700 with x1830881263588224 ext(2097152->2994175) 00010000:00010000:1.0:1746065154.254077:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 29 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.254089:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 29 pid: 3068 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746065154.254095:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec4700 00000100:00100000:1.0:1746065154.254111:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1326 00000100:00100000:1.0:1746065154.254117:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263588224:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065154.254601:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263587968:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16890us (17952us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065154.254608:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3819 00002000:00100000:2.0:1746065154.254613:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009a6ddc00 x1830881263587968/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.254620:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddc00 with x1830881263587968 ext(3145728->4194303) 00010000:00010000:2.0:1746065154.254624:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 29 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.254633:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 29 pid: 3068 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746065154.254639:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6ddc00 00000100:00100000:0.0:1746065154.267590:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.267671:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263588352 00000100:00100000:2.0:1746065154.267680:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263588352 00000100:00100000:2.0:1746065154.267715:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13339 00000100:00100000:2.0:1746065154.267722:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:32329:x1830881263588352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.267737:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.267751:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b63 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.267792:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.267797:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.267808:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.267821:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ce00, rc 0) 00000100:00100000:2.0:1746065154.267949:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:32329:x1830881263588352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 226us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.267956:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13339 00000100:00100000:1.0:1746065154.280067:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263588224:12345-192.168.202.27@tcp:4:cat.0 Request processed in 25939us (26140us total) trans 17179873481 rc 0/0 00000100:00100000:1.0:1746065154.280077:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1326 00002000:00100000:1.0:1746065154.280086:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2994175) req@ffff880099ec4700 x1830881263588224/t17179873481(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.280100:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4700 with x1830881263588224 ext(2097152->2994175) 00010000:00010000:1.0:1746065154.280109:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.280124:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746065154.280130:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec4700 00000100:00100000:0.0:1746065154.310938:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.311031:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263588480 00000100:00100000:2.0:1746065154.311039:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263588480 00010000:00010000:2.0:1746065154.311067:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.311102:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6033 00000100:00100000:2.0:1746065154.311108:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263588480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.311118:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065154.311131:0:7191:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065151 -> 1746065154 00002000:00010000:2.0:1746065154.311133:0:7191:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065151 -> 1746065154 00002000:00010000:2.0:1746065154.311135:0:7191:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065151 -> 1746065154 00010000:00010000:2.0:1746065154.311139:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.311149:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.311170:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc146fa8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2994175) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b4e expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.311197:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.311199:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.311206:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.311308:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.311317:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.311318:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.311322:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.311327:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.311359:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.311369:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263360512:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065154.311663:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.311672:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263360640:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065154.314576:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065154.315075:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263360512:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065154.317044:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263360640:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065154.317064:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.317177:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263588480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6067us (6273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.317186:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6033 00000100:00100000:0.0:1746065154.318074:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.318132:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263588736 00000100:00100000:1.0:1746065154.318138:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263588736 00002000:00100000:1.0:1746065154.318170:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099ec7b80 x1830881263588736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.318178:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7b80 with x1830881263588736 ext(3145728->4194303) 00002000:00010000:1.0:1746065154.318182:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec7b80 00000100:00100000:1.0:1746065154.318207:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3820 00000100:00100000:1.0:1746065154.318214:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263588736:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065154.323888:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.323991:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263588864 00000100:00100000:2.0:1746065154.323999:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263588864 00000100:00100000:2.0:1746065154.324054:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13664 00000100:00100000:2.0:1746065154.324061:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:32334:x1830881263588864:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065154.324084:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.324098:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146fac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b6a expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.324146:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324156:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324164:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324173:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324177:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324181:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324230:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324237:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324241:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065154.324269:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065154.324272:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065154.324284:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324291:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324297:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324301:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324306:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324310:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324315:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835c200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065154.324318:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324323:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324331:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065154.324334:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065154.324336:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324341:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc146facd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324368:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324372:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324377:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324380:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835cc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065154.324382:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324385:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324390:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009aa6a400) 00010000:00010000:2.0:1746065154.324392:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065154.324393:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324396:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835cc00/0xad6b7ddc146fad4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.324416:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c000/0xad6b7ddc146fac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.324424:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.324429:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.324431:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065154.324433:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c600, rc 0) 00000100:00100000:2.0:1746065154.324684:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32334:x1830881263588864:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 622us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.324690:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13664 00000100:00100000:1.0:1746065154.327094:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263588736:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8873us (9015us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065154.327104:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3820 00002000:00100000:1.0:1746065154.327112:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099ec7b80 x1830881263588736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.327121:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7b80 with x1830881263588736 ext(3145728->4194303) 00002000:00010000:1.0:1746065154.327126:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec7b80 00000100:00100000:0.0:1746065154.341766:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.341829:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.341873:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.341894:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263589248 00000100:00100000:0.0:1746065154.341911:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263589248 00000100:00100000:0.0:1746065154.341956:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263589376 00000100:00100000:0.0:1746065154.341959:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263589376 00000100:00100000:0.0:1746065154.341974:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13340 00000100:00100000:0.0:1746065154.341981:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263589248:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065154.341997:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.342012:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b71 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.342031:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.342032:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.342040:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.342052:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.342061:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:0.0:1746065154.342106:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263589248:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 125us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.342112:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13340 00000100:00100000:0.0:1746065154.342125:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13341 00000100:00100000:0.0:1746065154.342130:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263589376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065154.342136:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.342145:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b78 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.342159:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.342160:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.342164:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.342172:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.342178:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30000, rc 0) 00000100:00100000:0.0:1746065154.342191:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263589376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 62us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.342196:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13341 00000100:00100000:1.0:1746065154.342315:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263589120 00000100:00100000:1.0:1746065154.342320:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263589120 00002000:00100000:1.0:1746065154.342343:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099ec5180 x1830881263589120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.342350:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5180 with x1830881263589120 ext(3145728->4194303) 00002000:00010000:1.0:1746065154.342354:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec5180 00000100:00100000:1.0:1746065154.342365:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3821 00000100:00100000:1.0:1746065154.342369:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263589120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065154.343832:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.343888:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263589888 00000100:00100000:3.0:1746065154.343892:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263589888 00000100:00100000:3.0:1746065154.343934:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13665 00000100:00100000:3.0:1746065154.343939:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+29:32336:x1830881263589888:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065154.343954:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.343966:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146faf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b7f expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.344021:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344031:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344042:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344051:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344056:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344060:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344127:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344135:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344140:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065154.344147:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065154.344197:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344203:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344208:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344212:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abadc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.344215:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344220:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344229:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065154.344232:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.344235:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344239:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146faf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344253:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344257:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344262:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344265:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abaca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.344267:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344271:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344276:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090dc5100) 00010000:00010000:3.0:1746065154.344277:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.344279:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344283:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fafe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.344312:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146faf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.344321:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 31 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.344326:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065154.344327:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065154.344329:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abade00, rc 0) 00000100:00100000:3.0:1746065154.344354:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+31:32336:x1830881263589888:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 414us (524us total) trans 8589935998 rc 0/0 00000100:00100000:3.0:1746065154.344359:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13665 00000100:00100000:0.0:1746065154.349850:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.349967:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263590016 00000100:00100000:2.0:1746065154.349975:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263590016 00000100:00100000:2.0:1746065154.350019:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13342 00000100:00100000:2.0:1746065154.350026:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:32332:x1830881263590016:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065154.350041:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.350055:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b86 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.350081:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.350088:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.350094:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 28 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.350100:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.350101:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.350104:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1056768->1748991] (req 1056768->1748991) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.350130:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 28 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.350139:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 28 pid: 9550 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.350153:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263360768:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.350246:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.350254:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 11 pid: 12260 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.350261:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263360896:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.350285:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.350292:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 9 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.350299:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263361024:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.350312:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.354336:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.354395:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263589632 00000100:00100000:3.0:1746065154.354402:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263589632 00002000:00100000:3.0:1746065154.354436:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092744e00 x1830881263589632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.354449:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744e00 with x1830881263589632 ext(4194304->5021695) 00002000:00010000:3.0:1746065154.354454:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092744e00 00000100:00100000:3.0:1746065154.354483:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3822 00000100:00100000:3.0:1746065154.354490:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263589632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065154.358849:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263360768:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.358860:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263360896:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.361817:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.362832:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.362874:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.362893:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263590400 00000100:00100000:0.0:1746065154.362907:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263590400 00010000:00010000:0.0:1746065154.362935:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 29 pid: 9550 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.362955:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263590656 00000100:00100000:0.0:1746065154.362956:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263590656 00010000:00010000:0.0:1746065154.362963:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 12 pid: 12260 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.362979:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6034 00000100:00100000:0.0:1746065154.362984:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263590400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.362993:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.363008:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 29 pid: 9550 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.363016:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 29 pid: 9550 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.363031:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7aca00/0xad6b7ddc146fa10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac9 expref: 29 pid: 9550 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.363046:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.363074:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263590400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.363079:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6034 00000100:00100000:0.0:1746065154.363090:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6035 00000100:00100000:0.0:1746065154.363094:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263590656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.363099:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.363103:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 12 pid: 12260 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.363111:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 12 pid: 12260 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.363123:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad800/0xad6b7ddc146fa3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ade expref: 12 pid: 12260 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.363130:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.363142:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+11:2006:x1830881263590656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.363146:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6035 00000100:00100000:0.0:1746065154.363171:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.363182:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263590528 00000100:00100000:0.0:1746065154.363185:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263590528 00010000:00010000:0.0:1746065154.363194:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 10 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.363207:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6036 00000100:00100000:0.0:1746065154.363211:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263590528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.363216:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.363221:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 10 pid: 11461 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.363228:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 10 pid: 11461 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.363240:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.363241:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.363247:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363257:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363281:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.363291:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263361152:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065154.363351:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.363455:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263589120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21084us (21696us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065154.363462:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3821 00002000:00100000:0.0:1746065154.363468:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880099ec5180 x1830881263589120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.363476:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5180 with x1830881263589120 ext(3145728->4194303) 00002000:00010000:0.0:1746065154.363480:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec5180 00000100:00100000:0.0:1746065154.363575:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263590272 00000100:00100000:0.0:1746065154.363578:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263590272 00000100:00100000:0.0:1746065154.363599:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13666 00000100:00100000:0.0:1746065154.363604:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c1bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32334:x1830881263590272:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065154.363615:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.363627:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146fb1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b8d expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363698:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065154.363711:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363717:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363723:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 30 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363730:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065154.363746:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 30 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363755:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 30 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.363762:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263361280:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065154.363827:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363835:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 8 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.363841:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263361408:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065154.363860:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363868:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 11 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.363874:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263361536:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.363885:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfea80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065154.363921:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc146f945 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a8a expref: 10 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.363929:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263361024:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065154.363948:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.363955:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d000, rc 0) 00000100:00100000:0.0:1746065154.363971:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:32332:x1830881263590016:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 13945us (14211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.363977:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13342 00000100:00100000:3.0:1746065154.373839:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263589632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19338us (19499us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065154.373850:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3822 00002000:00100000:3.0:1746065154.373862:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880092744e00 x1830881263589632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.373875:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744e00 with x1830881263589632 ext(4194304->5021695) 00002000:00010000:3.0:1746065154.373881:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092744e00 00000100:00100000:2.0:1746065154.374210:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.374248:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.374263:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263590784 00000100:00100000:2.0:1746065154.374269:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263590784 00010000:00010000:2.0:1746065154.374290:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 31 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.374307:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263590912 00000100:00100000:2.0:1746065154.374309:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263590912 00010000:00010000:2.0:1746065154.374316:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 12 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.374328:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6037 00000100:00100000:2.0:1746065154.374333:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263590784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.374342:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.374346:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 31 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.374355:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 31 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.374373:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.374377:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.374383:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.374388:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.374414:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263590784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.374419:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6037 00000100:00100000:2.0:1746065154.374430:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6038 00000100:00100000:2.0:1746065154.374434:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263590912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.374441:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.374445:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 12 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.374451:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 12 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.374460:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.374463:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.374468:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.374472:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.374485:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263590912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.374490:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6038 00000100:00100000:2.0:1746065154.374537:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.374547:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263591040 00000100:00100000:2.0:1746065154.374550:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263591040 00010000:00010000:2.0:1746065154.374559:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.374572:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6039 00000100:00100000:2.0:1746065154.374576:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263591040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.374583:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.374585:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.374593:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.374602:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.374605:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.374611:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.374617:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.374630:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.374643:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263591040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.374648:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6039 00000100:00100000:2.0:1746065154.374684:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.374741:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.374755:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263591296 00000100:00100000:2.0:1746065154.374759:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263591296 00002000:00100000:2.0:1746065154.374800:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6e:0x0] (1056768->1060863) req@ffff880091a90e00 x1830881263591296/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.374807:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90e00 with x1830881263591296 ext(1056768->1060863) 00002000:00010000:2.0:1746065154.374810:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90e00 00000100:00100000:2.0:1746065154.374825:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263591552 00000100:00100000:2.0:1746065154.374827:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263591552 00002000:00100000:2.0:1746065154.374838:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880091a92680 x1830881263591552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.374845:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92680 with x1830881263591552 ext(4194304->5021695) 00002000:00010000:2.0:1746065154.374848:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a92680 00000100:00100000:2.0:1746065154.374864:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3823 00000100:00100000:2.0:1746065154.374869:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263591296:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065154.374962:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263591296:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 92us (277us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065154.374967:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3823 00002000:00100000:2.0:1746065154.374971:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1056768->1060863) req@ffff880091a90e00 x1830881263591296/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.374977:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90e00 with x1830881263591296 ext(1056768->1060863) 00002000:00010000:2.0:1746065154.374980:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90e00 00000100:00100000:2.0:1746065154.374989:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3824 00000100:00100000:2.0:1746065154.374994:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263591552:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065154.375979:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb05 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b7f expref: 30 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.375998:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263361280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.376007:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc146fadb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b6a expref: 8 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.376014:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263361408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.376022:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc146faaa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b55 expref: 11 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.376031:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263361536:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.376048:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.376054:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.376059:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065154.376073:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065154.376160:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc146fb1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.376171:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.376177:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.376179:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065154.376182:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:2.0:1746065154.376201:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c1bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32334:x1830881263590272:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 12597us (14429us total) trans 8589935999 rc 0/0 00000100:00100000:2.0:1746065154.376207:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13666 00000100:00100000:0.0:1746065154.379097:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263361152:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065154.379114:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.379279:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263590528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 16064us (16104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.379288:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6036 00000100:00100000:0.0:1746065154.384631:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.384702:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.384882:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263591680 00000100:00100000:1.0:1746065154.384890:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263591680 00000100:00100000:3.0:1746065154.384945:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263591808 00000100:00100000:3.0:1746065154.384949:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263591808 00000100:00100000:3.0:1746065154.384981:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13343 00000100:00100000:3.0:1746065154.384988:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:32336:x1830881263591808:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:1.0:1746065154.385020:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13344 00000100:00100000:1.0:1746065154.385025:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263591680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065154.385034:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.385047:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc146fb2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b94 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.385380:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.385389:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933b9b expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.385405:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.385412:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.385417:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.385422:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.385423:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.385426:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.385460:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263591552:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10464us (10717us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065154.385467:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3824 00002000:00100000:2.0:1746065154.385476:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880091a92680 x1830881263591552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.385484:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92680 with x1830881263591552 ext(4194304->5021695) 00010000:00010000:2.0:1746065154.385489:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065154.385615:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263361664:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065154.385797:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065154.385971:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065154.386087:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.386096:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263361792:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.386124:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.386144:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746065154.386150:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a92680 00010000:00010000:3.0:1746065154.386508:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 12 pid: 10219 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746065154.386516:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263361920:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.386545:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 26 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.386551:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 26 pid: 10219 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.386557:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263362048:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065154.386566:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.387930:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.388084:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263591936 00000100:00100000:2.0:1746065154.388090:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263591936 00000100:00100000:2.0:1746065154.388122:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13667 00000100:00100000:2.0:1746065154.388128:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32334:x1830881263591936:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065154.388145:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.388158:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fb3d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ba2 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.388230:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.388242:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.388248:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.389603:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.389618:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.389628:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263362176:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.389690:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56f00 going to sleep for 11 seconds 00002000:00010000:0.0:1746065154.389874:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065152 -> 1746065154 00002000:00010000:0.0:1746065154.389877:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065152 -> 1746065154 00002000:00010000:0.0:1746065154.389879:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065152 -> 1746065154 00000100:00100000:0.0:1746065154.389890:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263361664:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065154.389919:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc146fb2f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b94 expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.389928:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc146fb2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b94 expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.389940:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdae00, rc 0) 00000100:00100000:0.0:1746065154.389973:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263591680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4946us (5350us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065154.389980:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13344 00000100:00100000:3.0:1746065154.390160:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263361792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.390849:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.390913:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.390929:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263592320 00000100:00100000:0.0:1746065154.390933:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263592320 00010000:00010000:0.0:1746065154.390955:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 13 pid: 10219 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.390975:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6040 00000100:00100000:0.0:1746065154.390981:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263592320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.390990:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.391001:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 13 pid: 10219 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.391013:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 13 pid: 10219 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746065154.391029:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.391044:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263592320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.391049:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6040 00010000:00010000:3.0:1746065154.391194:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc146fae2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b71 expref: 12 pid: 10219 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746065154.391211:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263361920:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.391433:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263592192 00000100:00100000:2.0:1746065154.391438:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263592192 00002000:00100000:2.0:1746065154.391461:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1744896->1748991) req@ffff880097fa4a80 x1830881263592192/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.391469:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa4a80 with x1830881263592192 ext(1744896->1748991) 00002000:00010000:2.0:1746065154.391472:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa4a80 00000100:00100000:2.0:1746065154.391493:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3825 00000100:00100000:2.0:1746065154.391499:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263592192:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065154.394018:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263592192:12345-192.168.202.27@tcp:3:cat.0 Request processed in 2507us (3159us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065154.394031:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3825 00002000:00100000:2.0:1746065154.394043:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1744896->1748991) req@ffff880097fa4a80 x1830881263592192/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.394051:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa4a80 with x1830881263592192 ext(1744896->1748991) 00002000:00010000:2.0:1746065154.394057:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa4a80 00000100:00100000:0.0:1746065154.395449:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.395467:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.395519:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.395536:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263592576 00000100:00100000:0.0:1746065154.395542:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263592576 00010000:00010000:0.0:1746065154.395566:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.395586:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263592704 00000100:00100000:0.0:1746065154.395588:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263592704 00010000:00010000:0.0:1746065154.395597:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 10 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.395608:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6041 00000100:00100000:0.0:1746065154.395613:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263592576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.395623:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.395638:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.395650:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.395674:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fa87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b47 expref: 10 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.395686:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.395768:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263362048:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.395807:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.395817:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abade00, rc 0) 00000100:00100000:2.0:1746065154.395874:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6042 00000100:00100000:2.0:1746065154.395881:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263592704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.395888:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.395894:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 10 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.395911:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 10 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.395925:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.395929:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.395937:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.395943:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.395954:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.396320:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263592576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 704us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.396326:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6041 00000100:00100000:0.0:1746065154.396345:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263592448 00000100:00100000:0.0:1746065154.396348:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263592448 00000100:00100000:0.0:1746065154.396367:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13345 00000100:00100000:0.0:1746065154.396372:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263592448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065154.396383:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.396392:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146fb4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ba9 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.396404:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.396409:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146fb4b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba9 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.396417:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc146fb4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba9 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.396423:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b400, rc 0) 00000100:00100000:3.0:1746065154.396589:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:32336:x1830881263591808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11600us (11885us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.396594:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13343 00000100:00100000:2.0:1746065154.396678:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263592704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 796us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.396683:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6042 00010000:00010000:2.0:1746065154.396715:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3a00/0xad6b7ddc146fb21 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b8d expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.396743:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263362176:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.396755:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.396761:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.396766:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065154.396820:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065154.396823:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065154.396836:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.396858:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fb3d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.396867:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.396873:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.396875:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065154.396877:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3e00, rc 0) 00000100:00100000:2.0:1746065154.396895:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32334:x1830881263591936:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8767us (8969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.396912:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13667 00000100:00100000:0.0:1746065154.397113:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263592448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 739us (1667us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065154.397118:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13345 00000100:00100000:2.0:1746065154.397928:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.397966:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263592832 00000100:00100000:0.0:1746065154.397971:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263592832 00000100:00100000:0.0:1746065154.398002:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13346 00000100:00100000:0.0:1746065154.398008:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+26:32329:x1830881263592832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065154.398016:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.398024:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bb0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.398039:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.398041:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.398046:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.398057:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.398064:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5aa00, rc 0) 00000100:00100000:0.0:1746065154.398093:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+27:32329:x1830881263592832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.398098:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13346 00000100:00100000:0.0:1746065154.399333:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.399367:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.399425:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263592960 00000100:00100000:1.0:1746065154.399429:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263592960 00000100:00100000:1.0:1746065154.399456:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263593088 00000100:00100000:1.0:1746065154.399462:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263593088 00000100:00100000:1.0:1746065154.399475:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13347 00000100:00100000:1.0:1746065154.399480:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263592960:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065154.399490:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.399499:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146fb59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bb7 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065154.399536:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263362304:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065154.399586:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065154.399635:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13348 00000100:00100000:3.0:1746065154.399642:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263593088:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065154.399649:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.399656:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb60 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bbe expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.399667:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.399673:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb60 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bbe expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.399682:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb60 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bbe expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.399690:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abadc00, rc 0) 00000100:00100000:3.0:1746065154.399705:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263593088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 65us (338us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065154.399711:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13348 00000100:00100000:0.0:1746065154.402814:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.403025:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.403048:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.403061:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.403078:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263593472 00000100:00100000:0.0:1746065154.403084:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263593472 00000100:00100000:1.0:1746065154.403251:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263362304:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065154.403276:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146fb59 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb7 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.403287:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc146fb59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb7 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.403301:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdbe00, rc 0) 00000100:00100000:1.0:1746065154.403341:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263592960:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3859us (4010us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065154.403347:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13347 00000100:00100000:1.0:1746065154.403452:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263593344 00000100:00100000:1.0:1746065154.403454:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263593344 00000100:00100000:2.0:1746065154.403500:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263593728 00000100:00100000:2.0:1746065154.403503:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263593728 00000100:00100000:2.0:1746065154.403524:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4935 00000100:00100000:2.0:1746065154.403530:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+11:32332:x1830881263593728:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065154.403648:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+12:32332:x1830881263593728:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 118us (599us total) trans 8589936000 rc 0/0 00000100:00100000:2.0:1746065154.403653:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4935 00000100:00100000:3.0:1746065154.403735:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263593216 00000100:00100000:3.0:1746065154.403738:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263593216 00010000:00010000:3.0:1746065154.403753:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 27 pid: 10219 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.403789:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6043 00000100:00100000:3.0:1746065154.403794:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263593216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.403802:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065154.403813:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 27 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.403822:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 27 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.403836:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc146fa80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b40 expref: 27 pid: 10219 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.403846:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.403847:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.403852:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.403860:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.403881:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.403892:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263362432:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065154.403934:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.403991:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13349 00000100:00100000:0.0:1746065154.403997:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+9:32328:x1830881263593472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065154.404004:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.404013:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bc5 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.404024:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.404026:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.404029:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 10 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.404038:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 10 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.404045:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a800, rc 0) 00000100:00100000:0.0:1746065154.404059:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:32328:x1830881263593472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 62us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.404063:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13349 00000100:00100000:0.0:1746065154.404073:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13350 00000100:00100000:0.0:1746065154.404077:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263593344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065154.404083:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.404089:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc146fb6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bcc expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.404113:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263362560:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065154.404128:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.404165:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.405020:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263593856 00000100:00100000:1.0:1746065154.405024:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263593856 00000100:00100000:1.0:1746065154.405059:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13351 00000100:00100000:1.0:1746065154.405064:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263593856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065154.405072:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.405078:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146fb75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bd3 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.405092:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146fb75 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bd3 expref: 28 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.405104:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc146fb75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bd3 expref: 28 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.405111:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdac00, rc 0) 00000100:00100000:1.0:1746065154.405131:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263593856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (966us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065154.405136:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13351 00000100:00100000:0.0:1746065154.408825:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.409116:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263594368 00000100:00100000:2.0:1746065154.409124:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263594368 00000100:00100000:2.0:1746065154.409174:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13668 00000100:00100000:2.0:1746065154.409182:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32334:x1830881263594368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065154.409200:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.409216:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fb7c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bda expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.409295:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409306:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409316:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409327:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409332:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409337:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409342:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065154.409345:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409350:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409359:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.409362:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065154.409365:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409370:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fb83 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.409394:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fb7c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bda expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.409402:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fb7c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bda expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.409408:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2200, rc 0) 00000100:00100000:2.0:1746065154.409447:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32334:x1830881263594368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 266us (629us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065154.409453:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13668 00000100:00100000:3.0:1746065154.409557:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263362432:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065154.409573:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.409592:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263593216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5797us (6784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.409599:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6043 00000100:00100000:1.0:1746065154.409855:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263362560:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065154.409874:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc146fb6e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bcc expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.409882:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc146fb6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bcc expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.409890:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b000, rc 0) 00000100:00100000:1.0:1746065154.409920:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263593344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5842us (6857us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065154.409926:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13350 00000100:00100000:0.0:1746065154.410022:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.410530:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.410585:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263594496 00000100:00100000:1.0:1746065154.410589:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263594496 00000100:00100000:1.0:1746065154.410611:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13352 00000100:00100000:1.0:1746065154.410616:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263594496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065154.410626:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.410634:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdbc00/0xad6b7ddc146fb8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933be1 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.410652:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdbc00/0xad6b7ddc146fb8a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be1 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.410659:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdbc00/0xad6b7ddc146fb8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be1 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.410666:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdbc00, rc 0) 00000100:00100000:1.0:1746065154.410681:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263594496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 65us (152us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065154.410686:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13352 00000100:00100000:3.0:1746065154.410737:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263594112 00000100:00100000:3.0:1746065154.410740:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263594112 00002000:00100000:3.0:1746065154.410760:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3276800->3280895) req@ffff880097fa6a00 x1830881263594112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.410768:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa6a00 with x1830881263594112 ext(3276800->3280895) 00002000:00010000:3.0:1746065154.410788:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa6a00 00000100:00100000:3.0:1746065154.410801:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3826 00000100:00100000:3.0:1746065154.410806:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263594112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.410886:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263594112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 80us (864us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065154.410892:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3826 00002000:00100000:3.0:1746065154.410896:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3276800->3280895) req@ffff880097fa6a00 x1830881263594112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.410932:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa6a00 with x1830881263594112 ext(3276800->3280895) 00002000:00010000:3.0:1746065154.410935:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa6a00 00000100:00100000:2.0:1746065154.421761:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.423174:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.423201:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.423215:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263595008 00000100:00100000:0.0:1746065154.423223:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263595008 00000100:00100000:2.0:1746065154.423227:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:0.0:1746065154.423257:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880091a91180 x1830881263595008/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.423265:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91180 with x1830881263595008 ext(5017600->5021695) 00002000:00010000:0.0:1746065154.423270:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a91180 00000100:00100000:0.0:1746065154.423294:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263595264 00000100:00100000:0.0:1746065154.423296:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263595264 00002000:00100000:0.0:1746065154.423307:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (3481600->3485695) req@ffff880091a90a80 x1830881263595264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.423312:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881263595264 ext(3481600->3485695) 00002000:00010000:0.0:1746065154.423315:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90a80 00000100:00100000:0.0:1746065154.423325:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263595520 00000100:00100000:0.0:1746065154.423327:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263595520 00002000:00100000:0.0:1746065154.423334:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880091a93800 x1830881263595520/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.423339:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93800 with x1830881263595520 ext(5017600->5021695) 00002000:00010000:0.0:1746065154.423342:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a93800 00000100:00100000:0.0:1746065154.423360:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3827 00000100:00100000:0.0:1746065154.423365:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263595008:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.423415:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3828 00000100:00100000:3.0:1746065154.423422:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263595264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.423532:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263595264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 111us (330us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065154.423539:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3828 00002000:00100000:3.0:1746065154.423544:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3481600->3485695) req@ffff880091a90a80 x1830881263595264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.423550:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881263595264 ext(3481600->3485695) 00002000:00010000:3.0:1746065154.423553:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90a80 00000100:00100000:3.0:1746065154.423566:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3829 00000100:00100000:3.0:1746065154.423571:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263595520:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065154.423605:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263595008:12345-192.168.202.27@tcp:3:cat.0 Request processed in 238us (435us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065154.423609:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263595520:12345-192.168.202.27@tcp:3:cat.0 Request processed in 38us (382us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065154.423611:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3827 00000100:00100000:3.0:1746065154.423614:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3829 00002000:00100000:0.0:1746065154.423616:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880091a91180 x1830881263595008/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.423618:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (5017600->5021695) req@ffff880091a93800 x1830881263595520/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.423622:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91180 with x1830881263595008 ext(5017600->5021695) 00002000:00100000:3.0:1746065154.423624:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93800 with x1830881263595520 ext(5017600->5021695) 00002000:00010000:0.0:1746065154.423624:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a91180 00002000:00010000:3.0:1746065154.423627:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a93800 00000100:00100000:1.0:1746065154.423837:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263594752 00000100:00100000:1.0:1746065154.423842:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263594752 00000100:00100000:1.0:1746065154.423975:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4936 00000100:00100000:1.0:1746065154.423980:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32334:x1830881263594752:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065154.424313:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32334:x1830881263594752:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 332us (2559us total) trans 8589936001 rc 0/0 00000100:00100000:1.0:1746065154.424319:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4936 00000100:00100000:0.0:1746065154.427866:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.427958:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263595776 00000100:00100000:1.0:1746065154.427967:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263595776 00000100:00100000:1.0:1746065154.428015:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4937 00000100:00100000:1.0:1746065154.428022:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+12:32328:x1830881263595776:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065154.428195:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+13:32328:x1830881263595776:12345-192.168.202.27@tcp:35:cat.0 Request processed in 173us (336us total) trans 8589936002 rc 0/0 00000100:00100000:1.0:1746065154.428201:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4937 00000100:00100000:0.0:1746065154.431892:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.431955:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263596032 00000100:00100000:2.0:1746065154.431963:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263596032 00000100:00100000:2.0:1746065154.432007:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4938 00000100:00100000:2.0:1746065154.432013:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32336:x1830881263596032:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065154.432190:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:32336:x1830881263596032:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 176us (305us total) trans 8589936003 rc 0/0 00000100:00100000:2.0:1746065154.432196:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4938 00000100:00100000:0.0:1746065154.569932:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.569992:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.574765:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263596288 00000100:00100000:3.0:1746065154.574812:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263596544 00000100:00100000:3.0:1746065154.574817:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263596544 00000100:00100000:3.0:1746065154.574867:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13669 00000100:00100000:3.0:1746065154.574875:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+31:32349:x1830881263596544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065154.574895:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.574920:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad000/0xad6b7ddc146fb91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bef expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.574980:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.574992:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575001:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575012:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575016:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575021:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575102:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575109:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575115:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065154.575122:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065154.575183:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575189:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575194:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575200:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575204:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abadc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.575208:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575214:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575223:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065154.575226:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.575230:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575234:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc146fb98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575265:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575270:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575274:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575278:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abac800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.575280:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575288:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575293:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090dc5300) 00010000:00010000:3.0:1746065154.575295:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.575297:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065154.575301:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc146fb9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00000100:00100000:2.0:1746065154.575972:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263596288 00000100:00100000:2.0:1746065154.576018:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13670 00000100:00100000:2.0:1746065154.576025:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+13:32344:x1830881263596288:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065154.576038:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.576049:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146fbb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933be8 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.576088:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576096:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576106:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576115:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576119:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576124:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576180:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576187:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576192:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065154.576199:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065154.576238:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576243:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576248:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576252:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065154.576254:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576259:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576265:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065154.576267:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065154.576270:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576274:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576299:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576304:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576308:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576312:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065154.576314:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576320:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576326:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009aa6a400) 00010000:00010000:2.0:1746065154.576327:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065154.576330:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065154.576585:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad000/0xad6b7ddc146fb91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 34 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.576598:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 33 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.576604:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065154.576605:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065154.576607:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abaca00, rc 0) 00000100:00100000:3.0:1746065154.576653:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+33:32349:x1830881263596544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1779us (6660us total) trans 8589936004 rc 0/0 00000100:00100000:3.0:1746065154.576658:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13669 00010000:00010000:2.0:1746065154.576967:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc146fbc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.576996:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc146fbb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 16 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.577474:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.577481:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.577483:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065154.577485:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2400, rc 0) 00000100:00100000:2.0:1746065154.577509:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+15:32344:x1830881263596288:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1485us (7617us total) trans 8589936005 rc 0/0 00000100:00100000:2.0:1746065154.577515:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13670 00000100:00100000:0.0:1746065154.579729:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.579816:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263596800 00000100:00100000:1.0:1746065154.579824:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263596800 00000100:00100000:1.0:1746065154.579875:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4939 00000100:00100000:1.0:1746065154.579882:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32349:x1830881263596800:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065154.580051:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+34:32349:x1830881263596800:12345-192.168.202.27@tcp:35:cat.0 Request processed in 169us (328us total) trans 8589936006 rc 0/0 00000100:00100000:1.0:1746065154.580057:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4939 00000100:00100000:0.0:1746065154.583039:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.583735:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263597056 00000100:00100000:2.0:1746065154.583743:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263597056 00000100:00100000:0.0:1746065154.584924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.585008:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13671 00000100:00100000:2.0:1746065154.585017:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+34:32351:x1830881263597056:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065154.585037:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.585053:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146fbd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bf6 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.585139:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.585151:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.585157:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.585163:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.585169:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.585197:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.585207:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 14 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.585217:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263362688:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.585296:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.585304:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 35 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.585317:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263362816:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.585342:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.585349:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 8 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.585357:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263362944:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.585374:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.585439:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.585461:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263597184 00000100:00100000:1.0:1746065154.585465:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263597184 00000100:00100000:1.0:1746065154.585494:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263597568 00000100:00100000:1.0:1746065154.585496:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263597568 00000100:00100000:1.0:1746065154.585510:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13353 00000100:00100000:1.0:1746065154.585515:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263597184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065154.585523:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065154.585665:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13354 00000100:00100000:0.0:1746065154.585671:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263597568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065154.585678:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.585686:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc146fbe5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c0b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.585703:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc146fbe5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c0b expref: 27 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.585714:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c600/0xad6b7ddc146fbe5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c0b expref: 27 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.585725:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c600, rc 0) 00000100:00100000:0.0:1746065154.585745:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263597568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 75us (306us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065154.585750:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13354 00010000:00010000:1.0:1746065154.586131:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146fbec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933bfd expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065154.586158:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263363072:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065154.586206:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.587886:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.589498:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263597440 00000100:00100000:2.0:1746065154.589508:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263597440 00000100:00100000:2.0:1746065154.589563:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13672 00000100:00100000:2.0:1746065154.589575:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+15:32353:x1830881263597440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.589595:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.589610:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146fbf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c04 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.589697:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.589709:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065154.589718:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065154.589728:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065154.589835:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc146fbf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.589850:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.589856:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.589859:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065154.589861:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.589867:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.589872:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2e00, rc 0) 00000100:00100000:2.0:1746065154.589939:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+17:32353:x1830881263597440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 368us (2056us total) trans 8589936007 rc 0/0 00000100:00100000:2.0:1746065154.589945:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13672 00000100:00100000:1.0:1746065154.591259:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263362688:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065154.591269:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263362816:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065154.591276:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263362944:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065154.591293:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065154.591521:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.591539:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.591573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.591596:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263597696 00000100:00100000:0.0:1746065154.591600:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263597696 00010000:00010000:0.0:1746065154.591623:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 17 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.591640:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263597952 00000100:00100000:0.0:1746065154.591642:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263597952 00010000:00010000:0.0:1746065154.591649:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 36 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.591659:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263597824 00000100:00100000:0.0:1746065154.591661:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263597824 00010000:00010000:0.0:1746065154.591668:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.591679:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6044 00000100:00100000:0.0:1746065154.591685:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263597696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.591694:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.591698:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 17 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591706:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 17 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591721:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc146fbc9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933be8 expref: 17 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591731:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065154.591735:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065154.591741:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065154.591745:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.591795:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263597696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.591802:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6044 00000100:00100000:0.0:1746065154.591816:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6045 00000100:00100000:0.0:1746065154.591821:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881263597952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.591828:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.591832:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 36 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591844:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 36 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591854:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc146fba6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bef expref: 36 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591862:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065154.591864:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065154.591869:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065154.591873:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.591886:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263597952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.591891:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6045 00000100:00100000:0.0:1746065154.591931:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6046 00000100:00100000:0.0:1746065154.591936:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263597824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.591942:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.591946:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591953:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591962:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3e00/0xad6b7ddc146fb44 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ba2 expref: 9 pid: 9571 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.591970:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065154.591973:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065154.591978:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065154.591982:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065154.591995:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.592009:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263597824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 72us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.592013:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6046 00000100:00100000:0.0:1746065154.592055:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263363072:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065154.592070:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146fbec lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bfd expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.592079:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc146fbec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bfd expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.592085:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:0.0:1746065154.592100:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263597184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6585us (7180us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065154.592104:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13353 00010000:00010000:1.0:1746065154.592214:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065154.592220:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065154.592234:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065154.592323:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc146fbd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.592347:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 35 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.592352:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065154.592354:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065154.592357:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2800, rc 0) 00000100:00100000:1.0:1746065154.592377:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+35:32351:x1830881263597056:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7362us (9345us total) trans 8589936008 rc 0/0 00000100:00100000:1.0:1746065154.592383:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13671 00000100:00100000:0.0:1746065154.594076:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.597659:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263598080 00000100:00100000:1.0:1746065154.597671:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263598080 00000100:00100000:1.0:1746065154.597729:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13673 00000100:00100000:1.0:1746065154.597737:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+16:32353:x1830881263598080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065154.597759:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.597800:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc146fc0f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c12 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.597875:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065154.597889:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 34 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.597907:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065154.597935:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 34 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.597946:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 34 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746065154.597957:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263363200:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065154.598033:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.599433:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.599495:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263598464 00000100:00100000:2.0:1746065154.599500:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263598464 00002000:00100000:2.0:1746065154.599528:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097faaa00 x1830881263598464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.599537:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faaa00 with x1830881263598464 ext(0->1048575) 00002000:00010000:2.0:1746065154.599541:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097faaa00 00000100:00100000:2.0:1746065154.599554:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3830 00000100:00100000:2.0:1746065154.599560:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263598464:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065154.602754:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.605283:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263598336 00000100:00100000:0.0:1746065154.605296:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263598336 00000100:00100000:0.0:1746065154.605354:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13355 00000100:00100000:0.0:1746065154.605361:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:32351:x1830881263598336:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065154.605379:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.605393:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c19 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.605418:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.605426:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 7 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.605433:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.605438:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.605440:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.605443:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1875968->2080767] (req 1875968->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.605467:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.605475:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 29 pid: 9548 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.605491:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263363328:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065154.605560:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 7 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.605567:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 7 pid: 13375 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.605574:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263363456:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065154.605595:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.605601:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 8 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.605607:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263363584:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.605619:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065154.605864:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acec000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263363200:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065154.605880:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065154.613968:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.617402:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263598592 00000100:00100000:2.0:1746065154.617413:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263598592 00010000:00010000:2.0:1746065154.617449:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 35 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.617694:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6047 00000100:00100000:2.0:1746065154.617704:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263598592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.617719:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065154.617724:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 35 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.617735:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 35 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.617753:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc146fbde lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bf6 expref: 35 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.617768:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.617799:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.617807:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.617813:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065154.617834:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.617873:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263598592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 171us (3914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.617879:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6047 00010000:00010000:1.0:1746065154.619000:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065154.619009:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065154.619053:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065154.619057:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065154.619076:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065154.619105:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc146fc0f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 18 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.619138:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.619144:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065154.619146:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065154.619148:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdba00, rc 0) 00000100:00100000:1.0:1746065154.619178:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+17:32353:x1830881263598080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 21443us (25107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.619184:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13673 00000100:00100000:2.0:1746065154.619892:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263363328:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.624161:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.624374:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263363456:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.624385:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263363584:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065154.624409:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1875968->2080767] (req 1875968->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.624425:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835da00, rc 0) 00000100:00100000:0.0:1746065154.624476:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:32351:x1830881263598336:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 19114us (21728us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.624483:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13355 00000100:00100000:3.0:1746065154.624518:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263598720 00000100:00100000:3.0:1746065154.624523:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263598720 00010000:00010000:3.0:1746065154.624547:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 9 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746065154.624568:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6048 00000100:00100000:3.0:1746065154.624575:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263598720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.624586:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065154.624600:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 9 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.624604:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263598464:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 25044us (25175us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746065154.624608:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 9 pid: 11461 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.624611:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3830 00002000:00100000:2.0:1746065154.624618:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097faaa00 x1830881263598464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.624625:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faaa00 with x1830881263598464 ext(0->1048575) 00010000:00010000:3.0:1746065154.624626:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc146f94c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a91 expref: 9 pid: 11461 timeout: 850 lvb_type: 1 00002000:00010000:2.0:1746065154.624629:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097faaa00 00010000:00010000:3.0:1746065154.624638:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.624656:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263598720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.624661:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6048 00000100:00100000:2.0:1746065154.626437:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.626468:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.626477:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263598976 00000100:00100000:3.0:1746065154.626482:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263598976 00000100:00100000:2.0:1746065154.626483:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.626498:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263598848 00010000:00010000:3.0:1746065154.626500:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 29 pid: 9548 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.626501:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263598848 00000100:00100000:3.0:1746065154.626518:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6049 00000100:00100000:2.0:1746065154.626520:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263599104 00000100:00100000:2.0:1746065154.626522:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263599104 00000100:00100000:3.0:1746065154.626523:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263598976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.626532:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065154.626543:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 29 pid: 9548 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.626555:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 29 pid: 9548 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.626569:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc146fa02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad0 expref: 29 pid: 9548 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.626578:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.626804:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13356 00000100:00100000:2.0:1746065154.626810:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263598848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.626821:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.626831:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146fc24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c20 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.626844:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.626851:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146fc24 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c20 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.626858:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc146fc24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c20 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.626872:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3200, rc 0) 00000100:00100000:0.0:1746065154.627031:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13357 00000100:00100000:0.0:1746065154.627039:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263599104:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065154.627047:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.627055:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc146fc2b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c27 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.627069:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc146fc2b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c27 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.627077:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc146fc2b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c27 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065154.627088:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51b800, rc 0) 00000100:00100000:3.0:1746065154.627921:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263598976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1395us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.627921:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263598848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1108us (1450us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065154.627921:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263599104:12345-192.168.202.27@tcp:101:cat.0 Request processed in 881us (1434us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065154.627927:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13356 00000100:00100000:3.0:1746065154.627928:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6049 00000100:00100000:0.0:1746065154.627930:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13357 00000100:00100000:2.0:1746065154.627973:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.630753:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263599232 00000100:00100000:3.0:1746065154.630765:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263599232 00010000:00010000:3.0:1746065154.630813:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 8 pid: 13375 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746065154.630851:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6050 00000100:00100000:3.0:1746065154.630859:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263599232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.630875:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065154.630892:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 8 pid: 13375 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.630915:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 8 pid: 13375 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.630934:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc146fa2c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933aec expref: 8 pid: 13375 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746065154.630948:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.630950:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.630956:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.630963:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.630990:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.631001:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263363712:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065154.631094:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.631370:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.631438:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263599360 00000100:00100000:2.0:1746065154.631443:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263599360 00000100:00100000:2.0:1746065154.631465:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13358 00000100:00100000:2.0:1746065154.631470:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:32349:x1830881263599360:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.631482:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.631490:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c2e expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.631505:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.631510:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.631511:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.631514:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.631528:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.631536:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 7 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.631548:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263363840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.631728:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.633017:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.633085:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263363712:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065154.633098:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.633131:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263599232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2272us (5157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.633138:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6050 00000100:00100000:2.0:1746065154.633200:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263599616 00000100:00100000:2.0:1746065154.633204:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263599616 00002000:00100000:2.0:1746065154.633228:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1875968->1880063) req@ffff880097fa9c00 x1830881263599616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.633238:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9c00 with x1830881263599616 ext(1875968->1880063) 00002000:00010000:2.0:1746065154.633245:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa9c00 00000100:00100000:2.0:1746065154.633262:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3831 00000100:00100000:2.0:1746065154.633268:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263599616:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065154.633366:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263599616:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 97us (350us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065154.633375:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3831 00002000:00100000:2.0:1746065154.633379:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1875968->1880063) req@ffff880097fa9c00 x1830881263599616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.633386:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9c00 with x1830881263599616 ext(1875968->1880063) 00002000:00010000:2.0:1746065154.633389:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa9c00 00000100:00100000:2.0:1746065154.634513:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263363840:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.634531:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.634545:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2200, rc 0) 00000100:00100000:2.0:1746065154.634582:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:32349:x1830881263599360:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3111us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.634589:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13358 00000100:00100000:0.0:1746065154.635482:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.636139:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.636186:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263600000 00000100:00100000:1.0:1746065154.636193:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263600000 00002000:00100000:1.0:1746065154.636222:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa8700 x1830881263600000/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 504/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.636230:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8700 with x1830881263600000 ext(1048576->2097151) 00010000:00010000:1.0:1746065154.636236:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 7 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.636248:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 7 pid: 3068 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746065154.636254:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa8700 00000100:00100000:1.0:1746065154.636265:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263600128 00000100:00100000:1.0:1746065154.636267:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263600128 00002000:00100000:1.0:1746065154.636276:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097fa8a80 x1830881263600128/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.636282:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8a80 with x1830881263600128 ext(0->1048575) 00002000:00010000:1.0:1746065154.636285:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8a80 00000100:00100000:1.0:1746065154.636292:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1327 00000100:00100000:1.0:1746065154.636297:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263600000:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065154.636343:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3832 00000100:00100000:0.0:1746065154.636349:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263600128:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065154.638202:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.638245:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.638266:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263600384 00000100:00100000:2.0:1746065154.638274:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263600384 00002000:00100000:2.0:1746065154.638303:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (2076672->2080767) req@ffff880097fa8e00 x1830881263600384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.638311:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8e00 with x1830881263600384 ext(2076672->2080767) 00002000:00010000:2.0:1746065154.638315:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8e00 00000100:00100000:2.0:1746065154.638328:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263600512 00000100:00100000:2.0:1746065154.638330:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263600512 00002000:00100000:2.0:1746065154.638338:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1056768->1748991) req@ffff880097fa5880 x1830881263600512/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.638344:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa5880 with x1830881263600512 ext(1056768->1748991) 00010000:00010000:2.0:1746065154.638350:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 9 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.638361:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 9 pid: 3068 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746065154.638366:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa5880 00000100:00100000:2.0:1746065154.638394:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1328 00000100:00100000:2.0:1746065154.638400:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263600512:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065154.638400:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3833 00000100:00100000:0.0:1746065154.638407:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263600384:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065154.638508:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263600384:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 101us (312us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065154.638514:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3833 00002000:00100000:0.0:1746065154.638519:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (2076672->2080767) req@ffff880097fa8e00 x1830881263600384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.638526:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8e00 with x1830881263600384 ext(2076672->2080767) 00002000:00010000:0.0:1746065154.638529:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8e00 00000100:00100000:1.0:1746065154.643950:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263600000:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6459us (7276us total) trans 0 rc 356352/356352 00000100:00100000:1.0:1746065154.643965:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1327 00002000:00100000:1.0:1746065154.643978:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa8700 x1830881263600000/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 504/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 356352/356352 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.643988:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8700 with x1830881263600000 ext(1048576->2097151) 00000100:00100000:2.0:1746065154.644143:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263600128:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7792us (8002us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065154.644150:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3832 00010000:00010000:1.0:1746065154.644154:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 9 pid: 3068 timeout: 850 lvb_type: 0 00002000:00100000:2.0:1746065154.644156:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097fa8a80 x1830881263600128/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.644163:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8a80 with x1830881263600128 ext(0->1048575) 00002000:00010000:2.0:1746065154.644167:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8a80 00010000:00010000:1.0:1746065154.644169:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 9 pid: 3068 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746065154.644175:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa8700 00000100:00100000:2.0:1746065154.648222:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.648799:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263600768 00000100:00100000:0.0:1746065154.648806:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263600768 00000100:00100000:0.0:1746065154.648840:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4940 00000100:00100000:0.0:1746065154.648847:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+34:32351:x1830881263600768:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065154.649008:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+35:32351:x1830881263600768:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 160us (793us total) trans 8589936009 rc 0/0 00000100:00100000:0.0:1746065154.649015:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4940 00000100:00100000:3.0:1746065154.650642:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263600512:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12236us (12391us total) trans 17179873482 rc 0/0 00000100:00100000:3.0:1746065154.650653:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1328 00002000:00100000:3.0:1746065154.650661:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1056768->1748991) req@ffff880097fa5880 x1830881263600512/t17179873482(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.650669:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa5880 with x1830881263600512 ext(1056768->1748991) 00010000:00010000:3.0:1746065154.650679:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 9 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.650692:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 9 pid: 3068 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746065154.650698:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa5880 00000100:00100000:0.0:1746065154.656617:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.656694:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.656760:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263601024 00000100:00100000:2.0:1746065154.656768:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263601024 00000100:00100000:2.0:1746065154.656840:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13359 00000100:00100000:2.0:1746065154.656846:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+9:32353:x1830881263601024:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.656861:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.656876:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c35 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.656929:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263600896 00000100:00100000:3.0:1746065154.656933:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263600896 00010000:00010000:3.0:1746065154.656949:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 11 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.656966:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6051 00000100:00100000:3.0:1746065154.656971:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263600896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.656981:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065154.656995:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 11 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.657006:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 11 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.657022:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc146fb13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1056768->1748991) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b86 expref: 11 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.657050:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.657052:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.657057:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.657068:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.657093:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.657105:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263363968:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065154.659541:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.659547:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.659557:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.659575:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.659584:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2000, rc 0) 00000100:00100000:2.0:1746065154.659645:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+10:32353:x1830881263601024:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2794us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.659653:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13359 00000100:00100000:3.0:1746065154.659760:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.665000:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.665575:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263363968:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065154.665593:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.667001:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263601280 00000100:00100000:2.0:1746065154.667010:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263601280 00002000:00100000:2.0:1746065154.667051:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa4000 x1830881263601280/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.667061:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa4000 with x1830881263601280 ext(1048576->2097151) 00002000:00010000:2.0:1746065154.667065:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa4000 00000100:00100000:2.0:1746065154.667096:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3834 00000100:00100000:2.0:1746065154.667102:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263601280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.667465:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263600896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10491us (10855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.667472:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6051 00000100:00100000:0.0:1746065154.668262:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.668365:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263601536 00000100:00100000:3.0:1746065154.668372:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263601536 00002000:00100000:3.0:1746065154.668402:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009adf7b80 x1830881263601536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.668411:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7b80 with x1830881263601536 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.668415:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7b80 00000100:00100000:3.0:1746065154.668449:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3835 00000100:00100000:3.0:1746065154.668457:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263601536:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065154.675472:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.676587:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263601792 00000100:00100000:3.0:1746065154.676596:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263601792 00002000:00100000:3.0:1746065154.676630:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880091a91f80 x1830881263601792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 504/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.676639:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91f80 with x1830881263601792 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.676643:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91f80 00000100:00100000:3.0:1746065154.676672:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3836 00000100:00100000:3.0:1746065154.676679:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263601792:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065154.684568:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263601536:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 16103us (16301us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.684579:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3835 00002000:00100000:3.0:1746065154.684589:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009adf7b80 x1830881263601536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.684599:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7b80 with x1830881263601536 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.684604:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7b80 00000100:00100000:1.0:1746065154.685064:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263364096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746065154.685108:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065154.685372:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364096 00000100:00100000:3.0:1746065154.685378:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364096 00000100:00100000:3.0:1746065154.685404:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1746065154.685409:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263364096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746065154.685432:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:3.0:1746065154.685459:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263364096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.685463:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1746065154.685567:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263364096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065154.697976:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263601280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30865us (32975us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065154.697988:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3834 00002000:00100000:0.0:1746065154.697998:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa4000 x1830881263601280/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.698008:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa4000 with x1830881263601280 ext(1048576->2097151) 00002000:00010000:0.0:1746065154.698013:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa4000 00000100:00100000:3.0:1746065154.698101:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263601792:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 21423us (22637us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065154.698108:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3836 00002000:00100000:3.0:1746065154.698114:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880091a91f80 x1830881263601792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 504/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 843776/843776 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.698121:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91f80 with x1830881263601792 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.698124:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91f80 00000100:00100000:1.0:1746065154.701190:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065154.701208:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881263364224:0@lo:400:kworker.0 00000100:00100000:1.0:1746065154.701260:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065154.701366:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364224 00000100:00100000:0.0:1746065154.701372:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364224 00000100:00100000:0.0:1746065154.701401:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1746065154.701407:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800902f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881263364224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.701442:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800902f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881263364224:12345-0@lo:400:kworker.0 Request processed in 36us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.701447:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1746065154.702812:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3760:1830881263364480:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.702855:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065154.702884:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3760:1830881263364992:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.702919:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065154.702939:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263365504:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.702967:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065154.702989:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746065154.702995:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263364352:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703022:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065154.703043:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3760:1830881263364864:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703065:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065154.703082:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263365376:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703103:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065154.703134:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364352 00000100:00100000:3.0:1746065154.703140:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364352 00000100:00100000:3.0:1746065154.703175:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1746065154.703183:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881263364352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703230:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881263364352:12345-0@lo:400:kworker.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.703236:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1746065154.703276:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263364352:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703307:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364480 00000100:00100000:3.0:1746065154.703310:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364480 00000100:00100000:3.0:1746065154.703333:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364992 00000100:00100000:3.0:1746065154.703337:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364992 00000100:00100000:3.0:1746065154.703369:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364864 00000100:00100000:3.0:1746065154.703373:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364864 00000100:00100000:3.0:1746065154.703395:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1746065154.703401:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3760:x1830881263364480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703443:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3760:x1830881263364480:12345-0@lo:400:kworker.0 Request processed in 41us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.703449:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1746065154.703462:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:3.0:1746065154.703468:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3760:x1830881263364992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703501:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3760:x1830881263364992:12345-0@lo:400:kworker.0 Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.703506:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:3.0:1746065154.703518:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:3.0:1746065154.703524:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3760:x1830881263364864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703554:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3760:x1830881263364864:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.703559:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:3.0:1746065154.703588:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3760:1830881263364864:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703599:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3760:1830881263364480:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703607:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3760:1830881263364992:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703634:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365504 00000100:00100000:3.0:1746065154.703639:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365504 00000100:00100000:3.0:1746065154.703670:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365376 00000100:00100000:3.0:1746065154.703674:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365376 00000100:00100000:3.0:1746065154.703695:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1746065154.703701:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263365504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703740:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263365504:12345-0@lo:400:kworker.0 Request processed in 38us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.703745:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1746065154.703758:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1746065154.703763:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881263365376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703831:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881263365376:12345-0@lo:400:kworker.0 Request processed in 66us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.703837:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1746065154.703869:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263365376:0@lo:400:kworker.0 00000100:00100000:3.0:1746065154.703879:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263365504:0@lo:400:kworker.0 00000100:00080000:3.0:1746065154.703923:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746065154.703927:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746065154.703929:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746065154.703931:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065154.704109:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263364736:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704142:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065154.704185:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3762:1830881263365248:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704210:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065154.704248:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746065154.704256:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263364608:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704279:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065154.704297:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881263365120:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704311:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065154.704323:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881263365632:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704342:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065154.704371:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365248 00000100:00100000:0.0:1746065154.704376:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365248 00000100:00100000:0.0:1746065154.704406:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365120 00000100:00100000:0.0:1746065154.704410:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365120 00000100:00100000:0.0:1746065154.704429:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365632 00000100:00100000:0.0:1746065154.704433:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365632 00000100:00100000:0.0:1746065154.704451:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1746065154.704457:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3762:x1830881263365248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704496:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3762:x1830881263365248:12345-0@lo:400:kworker.0 Request processed in 38us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.704502:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1746065154.704516:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1746065154.704522:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881263365120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704553:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881263365120:12345-0@lo:400:kworker.0 Request processed in 31us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.704558:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1746065154.704572:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1746065154.704578:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881263365632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704607:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881263365632:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.704613:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00080000:0.0:1746065154.704628:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746065154.704630:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065154.704648:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881263365120:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704658:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881263365632:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.704666:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3762:1830881263365248:0@lo:400:kworker.0 00000100:00100000:1.0:1746065154.705216:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881263364224:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.705501:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.705612:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364736 00000100:00100000:2.0:1746065154.705618:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364736 00000100:00100000:2.0:1746065154.705652:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364608 00000100:00100000:2.0:1746065154.705657:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364608 00000100:00100000:2.0:1746065154.705677:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263601920 00000100:00100000:2.0:1746065154.705680:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263601920 00000100:00080000:0.0:1746065154.705918:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065154.705921:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065154.706543:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1746065154.706551:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263364736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065154.706595:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263364736:12345-0@lo:400:kworker.0 Request processed in 44us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.706600:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1746065154.706612:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1746065154.706616:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263364608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065154.706635:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263364608:12345-0@lo:400:kworker.0 Request processed in 19us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.706639:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1746065154.706648:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13360 00000100:00100000:2.0:1746065154.706652:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+9:32353:x1830881263601920:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.706660:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.706675:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c3c expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.706695:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.706701:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.706703:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.706706:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.706728:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.706738:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 28 pid: 12258 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.706747:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263365760:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.706814:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.706869:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263364608:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.706879:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263364736:0@lo:400:kworker.0 00000100:00100000:0.0:1746065154.709859:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.709917:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263602048 00000100:00100000:2.0:1746065154.709924:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263602048 00000100:00100000:2.0:1746065154.709964:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13361 00000100:00100000:2.0:1746065154.709971:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+26:32349:x1830881263602048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.709985:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.709999:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c43 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.710017:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.710020:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.710026:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.710038:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.710045:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:2.0:1746065154.711330:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+27:32349:x1830881263602048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1355us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.711338:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13361 00000100:00100000:2.0:1746065154.711508:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263365760:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.711528:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.711539:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c285800, rc 0) 00000100:00100000:2.0:1746065154.711558:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+10:32353:x1830881263601920:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4905us (6061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.711563:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13360 00000100:00100000:1.0:1746065154.711813:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.711870:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263602176 00000100:00100000:3.0:1746065154.711874:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263602176 00002000:00100000:3.0:1746065154.711907:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1875968->2080767) req@ffff88009aceea00 x1830881263602176/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.711915:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceea00 with x1830881263602176 ext(1875968->2080767) 00010000:00010000:3.0:1746065154.711920:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 29 pid: 12258 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.712002:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 29 pid: 12258 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746065154.712010:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aceea00 00000100:00100000:3.0:1746065154.712026:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1329 00000100:00100000:3.0:1746065154.712032:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263602176:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065154.724999:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.725040:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.725095:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263602432 00000100:00100000:1.0:1746065154.725102:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263602432 00002000:00100000:1.0:1746065154.725136:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88009aec9180 x1830881263602432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.725145:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881263602432 ext(2097152->3145727) 00002000:00010000:1.0:1746065154.725149:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9180 00000100:00100000:1.0:1746065154.725163:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263602688 00000100:00100000:1.0:1746065154.725165:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263602688 00000100:00100000:3.0:1746065154.725169:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263602176:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13137us (13359us total) trans 17179873483 rc 0/0 00002000:00100000:1.0:1746065154.725174:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88009aec8380 x1830881263602688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065154.725177:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1329 00002000:00100000:1.0:1746065154.725179:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8380 with x1830881263602688 ext(2097152->3145727) 00002000:00010000:1.0:1746065154.725182:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8380 00002000:00100000:3.0:1746065154.725183:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1875968->2080767) req@ffff88009aceea00 x1830881263602176/t17179873483(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.725189:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceea00 with x1830881263602176 ext(1875968->2080767) 00010000:00010000:3.0:1746065154.725195:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 32 pid: 12258 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746065154.725199:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3837 00000100:00100000:1.0:1746065154.725204:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263602432:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:3.0:1746065154.725207:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 32 pid: 12258 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746065154.725213:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aceea00 00000100:00100000:3.0:1746065154.725225:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3838 00000100:00100000:3.0:1746065154.725229:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263602688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065154.740311:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.740987:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263602816 00000100:00100000:3.0:1746065154.740996:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263602816 00010000:00010000:3.0:1746065154.741025:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 33 pid: 12258 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.741051:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6052 00000100:00100000:3.0:1746065154.741058:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263602816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.741068:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065154.741081:0:9565:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065151 -> 1746065154 00002000:00010000:3.0:1746065154.741083:0:9565:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065151 -> 1746065154 00002000:00010000:3.0:1746065154.741085:0:9565:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065151 -> 1746065154 00010000:00010000:3.0:1746065154.741089:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 33 pid: 12258 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.741099:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 33 pid: 12258 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.741118:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835da00/0xad6b7ddc146fc1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c19 expref: 33 pid: 12258 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.741146:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.741148:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.741154:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.741161:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.741188:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.741199:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263365888:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065154.741274:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065154.742940:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263602688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17702us (17891us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.742948:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3838 00002000:00100000:3.0:1746065154.742957:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88009aec8380 x1830881263602688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.742965:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8380 with x1830881263602688 ext(2097152->3145727) 00002000:00010000:3.0:1746065154.742969:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8380 00000100:00100000:3.0:1746065154.743597:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263365888:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065154.743610:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.743630:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263602816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2573us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.743638:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6052 00000100:00100000:0.0:1746065154.750545:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.750757:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263603072 00000100:00100000:3.0:1746065154.750768:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263603072 00002000:00100000:3.0:1746065154.750847:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009aecaa00 x1830881263603072/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.750857:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecaa00 with x1830881263603072 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.750862:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecaa00 00000100:00100000:3.0:1746065154.750884:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3839 00000100:00100000:3.0:1746065154.750892:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263603072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065154.751973:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263602432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26766us (26978us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065154.751980:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3837 00002000:00100000:1.0:1746065154.751986:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88009aec9180 x1830881263602432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.751993:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881263602432 ext(2097152->3145727) 00002000:00010000:1.0:1746065154.751996:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9180 00000100:00100000:3.0:1746065154.765423:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263603072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14523us (14880us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.765433:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3839 00002000:00100000:3.0:1746065154.765443:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009aecaa00 x1830881263603072/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.765451:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecaa00 with x1830881263603072 ext(1048576->2097151) 00002000:00010000:3.0:1746065154.765458:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecaa00 00000100:00100000:2.0:1746065154.765647:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065154.765660:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263366016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065154.765672:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.765694:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065154.765725:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263603200 00000100:00100000:0.0:1746065154.765731:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263603200 00000100:00100000:2.0:1746065154.765743:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366016 00000100:00100000:2.0:1746065154.765746:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366016 00000100:00100000:0.0:1746065154.765756:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13362 00000100:00100000:2.0:1746065154.765762:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1746065154.765762:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+27:32349:x1830881263603200:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065154.765766:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881263366016:12345-0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1746065154.765787:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00000024:2.0:1746065154.765800:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445654528 avail 1316192256 00010000:00010000:0.0:1746065154.765801:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c4a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.765819:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.765826:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881263366016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (131us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065154.765827:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065154.765828:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746065154.765831:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00010000:00010000:0.0:1746065154.765831:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.765849:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.765857:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263366016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1746065154.765858:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 28 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.765866:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263366144:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.765911:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.772679:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.772737:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263603456 00000100:00100000:3.0:1746065154.772744:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263603456 00000100:00100000:2.0:1746065154.772795:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263366144:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065154.772797:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13363 00000100:00100000:3.0:1746065154.772803:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:32344:x1830881263603456:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065154.772816:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.772820:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.772828:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c58 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.772832:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e800, rc 0) 00010000:00010000:3.0:1746065154.772845:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.772852:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.772856:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.772858:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.772861:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1859584->2097151] (req 1859584->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.772887:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.772909:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 11 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.772919:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263366272:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.774857:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+28:32349:x1830881263603200:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9087us (9177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.774864:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13362 00010000:00010000:3.0:1746065154.774879:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.774889:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 29 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.774907:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263366400:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065154.774938:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.775748:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.776665:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263603328 00000100:00100000:2.0:1746065154.776672:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263603328 00000100:00100000:2.0:1746065154.776716:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13364 00000100:00100000:2.0:1746065154.776723:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+10:32353:x1830881263603328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.776736:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.776748:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c51 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.777035:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.777037:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.777044:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.777057:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.777071:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baea00, rc 0) 00000100:00100000:2.0:1746065154.777100:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+11:32353:x1830881263603328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 378us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.777105:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13364 00000100:00100000:1.0:1746065154.777251:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.777550:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263603584 00000100:00100000:3.0:1746065154.777554:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263603584 00002000:00100000:3.0:1746065154.777577:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3276800->3485695) req@ffff88009acef800 x1830881263603584/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.777586:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef800 with x1830881263603584 ext(3276800->3485695) 00010000:00010000:3.0:1746065154.777592:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 28 pid: 3067 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.777602:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 28 pid: 3067 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746065154.777608:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009acef800 00000100:00100000:3.0:1746065154.777621:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1330 00000100:00100000:3.0:1746065154.777626:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263603584:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065154.780972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.781108:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263603840 00000100:00100000:3.0:1746065154.781116:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263603840 00000100:00100000:3.0:1746065154.781154:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13674 00000100:00100000:3.0:1746065154.781161:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+35:32357:x1830881263603840:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065154.781180:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.781192:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146fc63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c5f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.781246:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.781256:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.781264:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.781274:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.781279:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.781284:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782172:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782179:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782185:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065154.782191:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065154.782246:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782252:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782257:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782261:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782265:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.782268:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782273:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782281:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065154.782284:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.782286:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782294:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc146fc6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782338:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782342:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782346:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782349:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.782351:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782355:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782359:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e1fc300) 00010000:00010000:3.0:1746065154.782361:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.782363:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782366:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc146fc71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.782395:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc146fc63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 38 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.782403:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 37 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.782412:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065154.782414:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065154.782416:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30e00, rc 0) 00000100:00100000:3.0:1746065154.784300:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+37:32357:x1830881263603840:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3135us (3330us total) trans 8589936010 rc 0/0 00000100:00100000:3.0:1746065154.784308:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13674 00000100:00100000:2.0:1746065154.786500:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.786771:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.786919:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263604224 00000100:00100000:0.0:1746065154.786926:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263604224 00002000:00100000:0.0:1746065154.786958:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880092747800 x1830881263604224/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.786966:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747800 with x1830881263604224 ext(2097152->3145727) 00002000:00010000:0.0:1746065154.786970:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747800 00000100:00100000:0.0:1746065154.786981:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263604352 00000100:00100000:0.0:1746065154.786983:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263604352 00002000:00100000:0.0:1746065154.786991:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880092746d80 x1830881263604352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.786998:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746d80 with x1830881263604352 ext(2097152->3145727) 00002000:00010000:0.0:1746065154.787001:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092746d80 00000100:00100000:0.0:1746065154.787016:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3840 00000100:00100000:0.0:1746065154.787021:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263604224:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065154.790203:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3841 00000100:00100000:2.0:1746065154.790218:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263604352:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065154.791872:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.791892:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263604480 00000100:00100000:2.0:1746065154.791911:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263604480 00010000:00010000:2.0:1746065154.791935:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.791964:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6053 00000100:00100000:2.0:1746065154.791970:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263604480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.791980:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065154.791991:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065154.791994:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.792003:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263604608 00010000:00010000:2.0:1746065154.792004:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.792006:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263604608 00010000:00010000:0.0:1746065154.792019:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 14 pid: 3067 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.792023:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.792048:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6054 00000100:00100000:0.0:1746065154.792053:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263604608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.792059:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.792067:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 14 pid: 3067 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.792075:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 14 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.792088:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263604480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (218us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065154.792088:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.792090:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065154.792094:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6053 00010000:00010000:0.0:1746065154.792096:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.792102:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.792126:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.792134:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.792136:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263366528:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065154.792151:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263604736 00000100:00100000:2.0:1746065154.792154:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263604736 00010000:00010000:3.0:1746065154.792157:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc146fc39 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c35 expref: 14 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.792169:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065154.792170:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263366272:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.792171:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13365 00000100:00100000:2.0:1746065154.792175:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:32357:x1830881263604736:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065154.792179:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc146fc32 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c2e expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.792185:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263366400:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.792185:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.792195:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c66 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.792202:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.792209:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31c00, rc 0) 00010000:00010000:2.0:1746065154.792209:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.792216:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.792222:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.792227:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+13:32344:x1830881263603456:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 19424us (19556us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065154.792228:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.792229:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065154.792233:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13363 00010000:00010000:2.0:1746065154.792246:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3608576->3641343] (req 3608576->3641343) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.792263:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.792276:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.792283:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263366656:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.792309:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.792316:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 7 pid: 10219 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746065154.792323:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263366784:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.792464:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.792835:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 12 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.792843:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263366912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.792882:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.795609:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263603584:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17976us (18351us total) trans 21474840940 rc 0/0 00000100:00100000:0.0:1746065154.795620:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1330 00002000:00100000:0.0:1746065154.795631:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3276800->3485695) req@ffff88009acef800 x1830881263603584/t21474840940(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.795638:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef800 with x1830881263603584 ext(3276800->3485695) 00010000:00010000:0.0:1746065154.795647:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.795658:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746065154.795663:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009acef800 00000100:00100000:3.0:1746065154.797010:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263367040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746065154.797055:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065154.797166:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367040 00000100:00100000:1.0:1746065154.797303:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367040 00000100:00100000:1.0:1746065154.797334:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1746065154.797341:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263367040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746065154.797358:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1205302720 pending 966656 free 3903262720 avail 3671740416 00000100:00100000:1.0:1746065154.797670:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263367040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 329us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.797676:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1746065154.798056:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263366528:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065154.798071:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.798097:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263604608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6044us (6106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.798104:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6054 00000100:00100000:1.0:1746065154.798427:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263604224:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11404us (11930us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065154.798434:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3840 00002000:00100000:1.0:1746065154.798440:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880092747800 x1830881263604224/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.798448:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747800 with x1830881263604224 ext(2097152->3145727) 00002000:00010000:1.0:1746065154.798452:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747800 00000100:00100000:2.0:1746065154.798742:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263367040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065154.803069:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.803177:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263366784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.803187:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263366912:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.803483:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.803505:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263605120 00000100:00100000:0.0:1746065154.803510:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263605120 00010000:00010000:0.0:1746065154.803537:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.803572:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6055 00000100:00100000:0.0:1746065154.803579:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263605120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.803591:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.803607:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.803616:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.803635:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abade00/0xad6b7ddc146fb36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [3276800->3485695] (req 3276800->3485695) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b9b expref: 30 pid: 3067 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.803651:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.803653:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.803659:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.803667:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.803689:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.803698:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263367168:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065154.803713:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263366656:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.803738:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3608576->3641343] (req 3608576->3641343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.803747:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bae600, rc 0) 00000100:00100000:0.0:1746065154.803759:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.803770:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:32357:x1830881263604736:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11593us (11635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.803799:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13365 00000100:00100000:0.0:1746065154.803811:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.803844:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.803954:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263605248 00000100:00100000:2.0:1746065154.803958:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263605248 00010000:00010000:2.0:1746065154.803970:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 8 pid: 10219 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746065154.803976:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263604352:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13764us (17205us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065154.803983:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3841 00000100:00100000:2.0:1746065154.803986:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263605376 00000100:00100000:2.0:1746065154.803987:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263605376 00002000:00100000:0.0:1746065154.803989:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880092746d80 x1830881263604352/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065154.803992:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6056 00010000:00010000:2.0:1746065154.803995:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.804000:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263605248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.804008:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065154.804009:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6057 00002000:00100000:0.0:1746065154.804009:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746d80 with x1830881263604352 ext(2097152->3145727) 00000100:00100000:2.0:1746065154.804013:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263605376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.804015:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 10 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.804018:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 8 pid: 10219 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.804021:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.804022:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 10 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.804028:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 8 pid: 10219 timeout: 850 lvb_type: 1 00002000:00010000:0.0:1746065154.804028:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092746d80 00010000:00010000:2.0:1746065154.804039:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.804043:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30000/0xad6b7ddc146fae9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b78 expref: 8 pid: 10219 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746065154.804046:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.804057:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065154.804064:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc146fabf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b63 expref: 30 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.804074:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263605248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (262us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065154.804076:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.804081:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6056 00000100:00100000:2.0:1746065154.804092:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263605376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.804097:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6057 00000100:00100000:1.0:1746065154.804173:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263604992 00000100:00100000:1.0:1746065154.804178:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263604992 00002000:00100000:1.0:1746065154.804202:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1859584->1863679) req@ffff88009aec9880 x1830881263604992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.804208:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9880 with x1830881263604992 ext(1859584->1863679) 00002000:00010000:1.0:1746065154.804211:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec9880 00000100:00100000:1.0:1746065154.804229:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3842 00000100:00100000:1.0:1746065154.804234:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263604992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065154.804308:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263604992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 73us (1246us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065154.804313:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3842 00002000:00100000:1.0:1746065154.804318:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1859584->1863679) req@ffff88009aec9880 x1830881263604992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065154.804325:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9880 with x1830881263604992 ext(1859584->1863679) 00002000:00010000:1.0:1746065154.804328:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec9880 00000100:00100000:2.0:1746065154.807387:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.807481:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263367168:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065154.807687:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065154.807698:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263605504 00000100:00100000:0.0:1746065154.807704:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263605504 00000100:00100000:1.0:1746065154.807738:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263605120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4158us (4255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.807743:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13366 00000100:00100000:1.0:1746065154.807746:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6055 00000100:00100000:0.0:1746065154.807750:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+10:32353:x1830881263605504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065154.807764:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.807796:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c6d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.807815:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.807817:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.807823:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.807835:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.807843:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01a00, rc 0) 00000100:00100000:0.0:1746065154.807859:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+11:32353:x1830881263605504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 110us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.807870:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13366 00000100:00100000:2.0:1746065154.811363:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.811435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.811727:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263605888 00000100:00100000:3.0:1746065154.811733:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263605888 00002000:00100000:3.0:1746065154.811768:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880092744a80 x1830881263605888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.811794:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744a80 with x1830881263605888 ext(3145728->4194303) 00002000:00010000:3.0:1746065154.811798:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092744a80 00000100:00100000:3.0:1746065154.811815:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3843 00000100:00100000:3.0:1746065154.811821:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263605888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065154.813245:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263605632 00000100:00100000:0.0:1746065154.813251:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263605632 00000100:00100000:2.0:1746065154.813324:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.813365:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13367 00000100:00100000:2.0:1746065154.813373:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.813373:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+11:32344:x1830881263605632:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065154.813385:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065154.813389:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263606272 00010000:00010000:0.0:1746065154.813398:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c74 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.813419:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.813425:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.813426:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.813429:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->1769471] (req 1048576->1769471) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.813453:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.813463:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 12 pid: 13375 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.813472:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263367296:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.813526:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065154.813658:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263606016 00000100:00100000:1.0:1746065154.813662:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263606016 00010000:00010000:1.0:1746065154.813678:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 13 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746065154.813696:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6058 00000100:00100000:1.0:1746065154.813701:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263606016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065154.813709:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065154.813723:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 13 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.813732:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 13 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.813746:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc146fab8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b5c expref: 13 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.813766:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065154.813767:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065154.813789:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.813796:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.813815:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065154.813823:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263367424:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065154.813853:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.813931:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263606272 00002000:00100000:2.0:1746065154.813950:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800a4e51880 x1830881263606272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.813958:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51880 with x1830881263606272 ext(2097152->3145727) 00002000:00010000:2.0:1746065154.813961:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e51880 00000100:00100000:2.0:1746065154.813974:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3844 00000100:00100000:2.0:1746065154.813979:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263606272:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065154.816883:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263367296:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065154.816917:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->1769471] (req 1048576->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.816920:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065154.816932:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01400, rc 0) 00000100:00100000:0.0:1746065154.816941:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263606528 00000100:00100000:0.0:1746065154.816946:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263606528 00000100:00100000:1.0:1746065154.816965:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+14:32344:x1830881263605632:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3593us (5611us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.816973:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13367 00000100:00100000:1.0:1746065154.817005:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263367424:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065154.817013:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065154.817029:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263606016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3328us (3708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.817036:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6058 00000100:00100000:2.0:1746065154.817869:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263367552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065154.817914:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065154.817960:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367552 00000100:00100000:1.0:1746065154.817965:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367552 00000100:00100000:1.0:1746065154.818002:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1746065154.818008:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263367552:12345-0@lo:13:osp-pre-1-0.0 00002000:00100000:0.0:1746065154.818012:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3608576->3612671) req@ffff880091b67100 x1830881263606528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.818021:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67100 with x1830881263606528 ext(3608576->3612671) 00002000:00000024:1.0:1746065154.818023:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 491520 granted 1135208768 pending 1867776 free 3910807552 avail 3679285248 00002000:00010000:0.0:1746065154.818025:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b67100 00000100:00100000:0.0:1746065154.818039:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3845 00000100:00100000:0.0:1746065154.818045:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263606528:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065154.818052:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263367552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.818056:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1746065154.818396:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263367552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065154.818747:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263606528:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 701us (1827us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065154.818753:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3845 00002000:00100000:0.0:1746065154.818759:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (3608576->3612671) req@ffff880091b67100 x1830881263606528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.818765:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67100 with x1830881263606528 ext(3608576->3612671) 00002000:00010000:0.0:1746065154.818770:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b67100 00000100:00100000:0.0:1746065154.818832:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.818864:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263606656 00000100:00100000:1.0:1746065154.818868:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263606656 00010000:00010000:1.0:1746065154.818882:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 13 pid: 13375 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746065154.818909:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6059 00000100:00100000:1.0:1746065154.818914:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263606656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065154.818922:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065154.818933:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 13 pid: 13375 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.818942:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 13 pid: 13375 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.818958:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc146fc40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c3c expref: 13 pid: 13375 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.818970:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065154.818971:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065154.818977:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.818985:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.819003:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263605888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 7180us (7567us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746065154.819006:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.819008:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3843 00002000:00100000:0.0:1746065154.819013:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880092744a80 x1830881263605888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065154.819015:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263367680:192.168.202.27@tcp:105: 00002000:00100000:0.0:1746065154.819019:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744a80 with x1830881263605888 ext(3145728->4194303) 00002000:00010000:0.0:1746065154.819023:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092744a80 00000100:00100000:1.0:1746065154.819052:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.825339:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263606272:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11351us (11958us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065154.825349:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3844 00000100:00100000:0.0:1746065154.825357:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:2.0:1746065154.825358:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff8800a4e51880 x1830881263606272/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.825366:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51880 with x1830881263606272 ext(2097152->3145727) 00002000:00010000:2.0:1746065154.825371:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e51880 00000100:00100000:0.0:1746065154.825380:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263606912 00000100:00100000:0.0:1746065154.825385:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263606912 00002000:00100000:0.0:1746065154.825415:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3637248->3641343) req@ffff880091b66d80 x1830881263606912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.825422:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66d80 with x1830881263606912 ext(3637248->3641343) 00002000:00010000:0.0:1746065154.825425:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b66d80 00000100:00100000:0.0:1746065154.825435:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3846 00000100:00100000:0.0:1746065154.825440:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263606912:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065154.825517:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263606912:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 77us (162us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065154.825523:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3846 00002000:00100000:0.0:1746065154.825527:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3637248->3641343) req@ffff880091b66d80 x1830881263606912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065154.825533:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66d80 with x1830881263606912 ext(3637248->3641343) 00002000:00010000:0.0:1746065154.825535:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b66d80 00000100:00100000:1.0:1746065154.825668:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263367680:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065154.825682:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065154.825702:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263606656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6787us (6870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.825708:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6059 00000100:00100000:0.0:1746065154.827721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.827800:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263607168 00000100:00100000:2.0:1746065154.827809:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263607168 00002000:00100000:2.0:1746065154.827835:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1765376->1769471) req@ffff880091b66300 x1830881263607168/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.827841:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66300 with x1830881263607168 ext(1765376->1769471) 00002000:00010000:2.0:1746065154.827844:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b66300 00000100:00100000:2.0:1746065154.827861:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3847 00000100:00100000:2.0:1746065154.827867:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263607168:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065154.827984:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263607168:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 116us (266us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065154.828057:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3847 00002000:00100000:2.0:1746065154.828062:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1765376->1769471) req@ffff880091b66300 x1830881263607168/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.828069:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66300 with x1830881263607168 ext(1765376->1769471) 00002000:00010000:2.0:1746065154.828071:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b66300 00000100:00100000:2.0:1746065154.832577:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.832613:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.832644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.832695:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263607424 00000100:00100000:1.0:1746065154.832703:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263607424 00000100:00100000:1.0:1746065154.832733:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263607680 00000100:00100000:1.0:1746065154.832735:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263607680 00000100:00100000:1.0:1746065154.832746:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4941 00000100:00100000:1.0:1746065154.832751:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+37:32357:x1830881263607424:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065154.832975:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+38:32357:x1830881263607424:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 221us (403us total) trans 8589936011 rc 0/0 00000100:00100000:1.0:1746065154.832981:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4941 00000100:00100000:1.0:1746065154.833016:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4942 00000100:00100000:1.0:1746065154.833021:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+17:32344:x1830881263607680:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065154.833079:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+18:32344:x1830881263607680:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 57us (465us total) trans 8589936012 rc 0/0 00000100:00100000:1.0:1746065154.833084:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4942 00000100:00100000:1.0:1746065154.833099:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263607808 00000100:00100000:1.0:1746065154.833102:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263607808 00000100:00100000:1.0:1746065154.833119:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13368 00000100:00100000:1.0:1746065154.833124:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:32349:x1830881263607808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065154.833131:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.833144:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c7b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.833164:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.833171:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065154.833172:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065154.833175:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.833196:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.833206:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 30 pid: 9550 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746065154.833216:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263367808:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065154.833259:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.834302:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.834431:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263607936 00000100:00100000:2.0:1746065154.834436:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263607936 00000100:00100000:2.0:1746065154.834469:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13369 00000100:00100000:2.0:1746065154.834474:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+11:32353:x1830881263607936:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.834483:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.834492:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c82 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.834505:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.834506:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.834512:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.834523:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.834530:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2da00, rc 0) 00000100:00100000:2.0:1746065154.834564:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+12:32353:x1830881263607936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 90us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.834569:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13369 00000100:00100000:0.0:1746065154.835628:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.835708:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263367808:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065154.835731:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.835741:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46000, rc 0) 00000100:00100000:2.0:1746065154.835753:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263608064 00000100:00100000:2.0:1746065154.835758:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263608064 00000100:00100000:1.0:1746065154.835765:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:32349:x1830881263607808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2640us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.835770:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13368 00002000:00100000:2.0:1746065154.835802:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3608576->3641343) req@ffff880091b67480 x1830881263608064/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.835810:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67480 with x1830881263608064 ext(3608576->3641343) 00010000:00010000:2.0:1746065154.835816:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 30 pid: 9550 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.835835:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 30 pid: 9550 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746065154.835841:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b67480 00000100:00100000:2.0:1746065154.835861:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1331 00000100:00100000:2.0:1746065154.835867:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263608064:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065154.838187:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.838271:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263608320 00000100:00100000:3.0:1746065154.838278:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263608320 00002000:00100000:3.0:1746065154.838308:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880091b67b80 x1830881263608320/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.838708:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67b80 with x1830881263608320 ext(3145728->4194303) 00002000:00010000:3.0:1746065154.838715:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b67b80 00000100:00100000:3.0:1746065154.838740:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3848 00000100:00100000:3.0:1746065154.838748:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263608320:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065154.842370:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263608064:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 6492us (6733us total) trans 17179873484 rc 0/0 00000100:00100000:2.0:1746065154.842381:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1331 00002000:00100000:2.0:1746065154.842391:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3608576->3641343) req@ffff880091b67480 x1830881263608064/t17179873484(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065154.842400:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67480 with x1830881263608064 ext(3608576->3641343) 00010000:00010000:2.0:1746065154.842409:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 32 pid: 9550 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.842423:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 32 pid: 9550 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746065154.842429:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b67480 00000100:00100000:3.0:1746065154.846044:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263608320:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 7289us (7856us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.846055:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3848 00002000:00100000:3.0:1746065154.846064:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880091b67b80 x1830881263608320/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.846073:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67b80 with x1830881263608320 ext(3145728->4194303) 00002000:00010000:3.0:1746065154.846078:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b67b80 00000100:00100000:0.0:1746065154.846099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.846500:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263608448 00000100:00100000:2.0:1746065154.846507:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263608448 00010000:00010000:2.0:1746065154.846531:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 32 pid: 9550 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.846602:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6060 00000100:00100000:2.0:1746065154.846610:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263608448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065154.846622:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065154.847005:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065154 -> 1746065155 00002000:00010000:2.0:1746065154.847009:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065154 -> 1746065155 00010000:00010000:2.0:1746065154.847014:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 32 pid: 9550 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.847025:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 32 pid: 9550 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.847042:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc146fc86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [3608576->18446744073709551615] (req 3608576->3641343) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c66 expref: 32 pid: 9550 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746065154.847430:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.847432:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.847438:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.847445:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.847473:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.847492:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263367936:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065154.847565:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.852924:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263367936:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065154.852948:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065154.853125:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263608448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6513us (7025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.853136:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6060 00000100:00100000:1.0:1746065154.853892:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.854194:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263608704 00000100:00100000:3.0:1746065154.854200:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263608704 00000100:00100000:1.0:1746065154.854204:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065154.854232:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009aced880 x1830881263608704/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065154.854235:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263608832 00000100:00100000:0.0:1746065154.854239:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263608832 00002000:00100000:3.0:1746065154.854241:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aced880 with x1830881263608704 ext(3145728->4194303) 00002000:00010000:3.0:1746065154.854245:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aced880 00000100:00100000:0.0:1746065154.854265:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13370 00000100:00100000:0.0:1746065154.854269:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+10:32353:x1830881263608832:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065154.854273:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3849 00000100:00100000:3.0:1746065154.854278:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263608704:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:0.0:1746065154.854279:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065154.854291:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c89 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.854305:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.854306:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065154.854311:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.854319:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065154.854324:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:0.0:1746065154.854353:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+11:32353:x1830881263608832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065154.854356:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13370 00000100:00100000:0.0:1746065154.861047:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.861248:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263609088 00000100:00100000:3.0:1746065154.861255:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263609088 00002000:00100000:3.0:1746065154.861290:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88008c52b480 x1830881263609088/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.861299:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52b480 with x1830881263609088 ext(3145728->4194303) 00002000:00010000:3.0:1746065154.861303:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c52b480 00000100:00100000:3.0:1746065154.861330:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3850 00000100:00100000:3.0:1746065154.861338:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263609088:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065154.864194:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263608704:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9907us (10296us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.864203:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3849 00002000:00100000:3.0:1746065154.864211:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88009aced880 x1830881263608704/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.864219:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aced880 with x1830881263608704 ext(3145728->4194303) 00002000:00010000:3.0:1746065154.864223:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aced880 00000100:00100000:3.0:1746065154.866483:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263609088:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 5138us (5437us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065154.866492:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3850 00002000:00100000:3.0:1746065154.866500:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff88008c52b480 x1830881263609088/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.866509:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52b480 with x1830881263609088 ext(3145728->4194303) 00002000:00010000:3.0:1746065154.866514:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c52b480 00000100:00100000:0.0:1746065154.878365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.878734:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.878804:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.878889:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263609472 00000100:00100000:2.0:1746065154.878912:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263609600 00000100:00100000:2.0:1746065154.878919:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263609600 00000100:00100000:1.0:1746065154.878920:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263609472 00000100:00100000:3.0:1746065154.879163:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263609344 00000100:00100000:3.0:1746065154.879172:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263609344 00002000:00100000:3.0:1746065154.879199:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5017599) req@ffff88008c528000 x1830881263609344/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065154.879208:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13371 00000100:00100000:1.0:1746065154.879212:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13372 00002000:00100000:3.0:1746065154.879213:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528000 with x1830881263609344 ext(4194304->5017599) 00000100:00100000:2.0:1746065154.879215:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263609600:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065154.879217:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263609472:12345-192.168.202.27@tcp:101:cat.0 00002000:00010000:3.0:1746065154.879221:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528000 00010000:00010000:2.0:1746065154.879231:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.879231:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065154.879234:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3851 00000100:00100000:3.0:1746065154.879240:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263609344:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065154.879244:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146fcb0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c97 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.879244:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146fcb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c90 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.879281:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263368192:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065154.879281:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263368064:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065154.879351:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065154.879363:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00002000:00010000:2.0:1746065154.882946:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065154 -> 1746065155 00002000:00010000:2.0:1746065154.882952:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065154 -> 1746065155 00002000:00010000:2.0:1746065154.882954:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065154 -> 1746065155 00000100:00100000:2.0:1746065154.882971:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263368064:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065154.882996:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146fcb7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c90 expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.883013:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc146fcb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c90 expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.883037:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44200, rc 0) 00000100:00100000:2.0:1746065154.883074:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263609472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3855us (4340us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065154.883082:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13372 00002000:00010000:1.0:1746065154.883435:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime: 1746065154 -> 1746065155 00002000:00010000:1.0:1746065154.883439:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime: 1746065154 -> 1746065155 00002000:00010000:1.0:1746065154.883440:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime: 1746065154 -> 1746065155 00000100:00100000:1.0:1746065154.883448:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263368192:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065154.883463:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146fcb0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c97 expref: 32 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.883471:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146fcb0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c97 expref: 32 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.883482:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf200, rc 0) 00000100:00100000:1.0:1746065154.883511:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263609600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4297us (4707us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065154.883516:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13371 00000100:00100000:3.0:1746065154.885500:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263609344:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6254us (7136us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746065154.885509:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3851 00002000:00100000:3.0:1746065154.885517:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5017599) req@ffff88008c528000 x1830881263609344/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.885525:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528000 with x1830881263609344 ext(4194304->5017599) 00002000:00010000:3.0:1746065154.885529:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528000 00000100:00100000:2.0:1746065154.887217:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.887598:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263609856 00000100:00100000:3.0:1746065154.887605:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263609856 00002000:00100000:3.0:1746065154.887803:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5017599) req@ffff88009a6de300 x1830881263609856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.887811:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6de300 with x1830881263609856 ext(4194304->5017599) 00002000:00010000:3.0:1746065154.887816:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6de300 00000100:00100000:3.0:1746065154.888120:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3852 00000100:00100000:3.0:1746065154.888128:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263609856:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065154.893665:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263609856:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5529us (6443us total) trans 0 rc 823296/823296 00000100:00100000:3.0:1746065154.893674:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3852 00002000:00100000:3.0:1746065154.893683:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5017599) req@ffff88009a6de300 x1830881263609856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:70/0 lens 488/440 e 0 to 0 dl 1746065165 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065154.893691:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6de300 with x1830881263609856 ext(4194304->5017599) 00002000:00010000:3.0:1746065154.893697:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6de300 00000100:00100000:0.0:1746065154.898195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.898245:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.898279:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263610112 00000100:00100000:1.0:1746065154.898288:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263610112 00000100:00100000:2.0:1746065154.898298:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263609984 00000100:00100000:2.0:1746065154.898302:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263609984 00000100:00100000:1.0:1746065154.898346:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13373 00000100:00100000:1.0:1746065154.898353:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263610112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065154.898370:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.898388:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc146fcbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ca5 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.898419:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13374 00000100:00100000:2.0:1746065154.898425:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263609984:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.898432:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065154.898438:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263368320:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065154.898439:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146fcc5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933c9e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.898462:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263368448:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065154.898518:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.898547:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065154.900768:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263368320:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065154.900823:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc146fcbe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ca5 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.900836:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc146fcbe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ca5 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.900853:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488a00, rc 0) 00000100:00100000:1.0:1746065154.900890:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263610112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2537us (2703us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065154.900906:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13373 00000100:00100000:2.0:1746065154.901079:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263368448:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065154.901094:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146fcc5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c9e expref: 32 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.901103:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc146fcc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c9e expref: 32 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.901849:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf200, rc 0) 00000100:00100000:2.0:1746065154.901870:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263609984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3445us (3624us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065154.901876:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13374 00000100:00100000:0.0:1746065154.904684:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.904822:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263610240 00000100:00100000:2.0:1746065154.904830:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263610240 00000100:00100000:2.0:1746065154.904874:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13375 00000100:00100000:2.0:1746065154.904881:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263610240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065154.904906:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.904922:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146fccc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cac expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.904976:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263368576:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065154.905106:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.905356:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.905573:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263610368 00000100:00100000:1.0:1746065154.905577:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263610368 00000100:00100000:1.0:1746065154.905607:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13376 00000100:00100000:1.0:1746065154.905613:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263610368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065154.905619:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065154.905625:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc146fcd3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cb3 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065154.905647:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263368704:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065154.905671:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.907682:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263368576:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065154.907713:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146fccc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cac expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.907976:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc146fccc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cac expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.907985:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae23c00, rc 0) 00000100:00100000:1.0:1746065154.908162:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263368704:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065154.908171:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263610240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3290us (3493us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065154.908177:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc146fcd3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cb3 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065154.908181:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13375 00010000:00010000:1.0:1746065154.908184:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc146fcd3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cb3 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.908192:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:1.0:1746065154.908206:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263610368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2594us (2852us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065154.908212:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13376 00010000:00010000:2.0:1746065154.918879:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065154.927056:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.927116:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263610496 00000100:00100000:3.0:1746065154.927125:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263610496 00000100:00100000:3.0:1746065154.927176:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13675 00000100:00100000:3.0:1746065154.927184:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32362:x1830881263610496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065154.927205:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.927220:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146fcda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cba expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.927268:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927279:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927288:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927298:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927303:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927307:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927361:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927370:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927376:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065154.927405:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065154.927409:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065154.927421:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927429:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927436:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927440:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927444:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927449:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927453:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.927456:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927461:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927469:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065154.927471:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.927474:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927477:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc146fce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927500:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927504:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927509:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927512:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065154.927515:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927519:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927525:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009554f500) 00010000:00010000:3.0:1746065154.927527:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065154.927529:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927534:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc146fce8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.927557:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc146fcda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.927566:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.927630:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065154.927632:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065154.927634:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71ba00, rc 0) 00000100:00100000:3.0:1746065154.928120:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32362:x1830881263610496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 507us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.928127:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13675 00000100:00100000:0.0:1746065154.931041:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.931076:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.931104:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.931130:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.931160:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263610752 00000100:00100000:0.0:1746065154.931166:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263610752 00000100:00100000:0.0:1746065154.931199:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263611008 00000100:00100000:0.0:1746065154.931201:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263611008 00000100:00100000:0.0:1746065154.931489:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263610624 00000100:00100000:0.0:1746065154.931492:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263610624 00000100:00100000:3.0:1746065154.931544:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263610880 00000100:00100000:3.0:1746065154.931547:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263610880 00000100:00100000:2.0:1746065154.931566:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13377 00000100:00100000:2.0:1746065154.931576:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263610752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065154.931592:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.931606:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b52b0400/0xad6b7ddc146fcf6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cc8 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.931638:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13378 00000100:00100000:3.0:1746065154.931646:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263611008:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065154.931650:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263368832:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065154.931652:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.931659:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cd6 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.931670:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.931672:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.931678:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.931690:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.931698:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b200, rc 0) 00000100:00100000:2.0:1746065154.931711:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065154.931720:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263611008:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 76us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.931727:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13378 00000100:00100000:3.0:1746065154.931746:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13379 00000100:00100000:3.0:1746065154.931751:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263610624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065154.931759:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.931764:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146fd04 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cc1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.931807:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263368960:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065154.931827:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065154.931844:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13380 00000100:00100000:3.0:1746065154.931848:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263610880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065154.931854:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.931862:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ccf expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.931872:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.931874:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065154.931879:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 13 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.931886:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 13 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.931892:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a600, rc 0) 00000100:00100000:3.0:1746065154.931916:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263610880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 67us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.931921:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13380 00000100:00100000:3.0:1746065154.935426:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263368960:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065154.935465:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146fd04 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cc1 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.935480:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc146fd04 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cc1 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.935492:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71be00, rc 0) 00000100:00100000:2.0:1746065154.935533:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263368832:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065154.935549:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b52b0400/0xad6b7ddc146fcf6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cc8 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.935559:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b52b0400/0xad6b7ddc146fcf6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cc8 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.935572:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52b0400, rc 0) 00000100:00100000:2.0:1746065154.935736:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263610752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4162us (4703us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065154.935741:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263610624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3986us (4632us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065154.935743:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13377 00000100:00100000:3.0:1746065154.935747:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13379 00000100:00100000:0.0:1746065154.941359:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.941547:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263611264 00000100:00100000:2.0:1746065154.941556:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263611264 00000100:00100000:2.0:1746065154.941594:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13676 00000100:00100000:2.0:1746065154.941601:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32362:x1830881263611264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065154.941622:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.941637:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fd12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cdd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.941719:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.941731:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.941737:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 37 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.941743:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.941748:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.941789:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.941804:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 10 pid: 7203 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.941814:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263369088:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.941908:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 37 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.941915:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 37 pid: 7203 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.941923:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263369216:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.941946:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.941953:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 17 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.941960:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263369344:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.941975:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.943670:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263369088:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065154.943986:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.944021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.944047:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.944083:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263611392 00000100:00100000:0.0:1746065154.944089:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263611392 00000100:00100000:1.0:1746065154.944096:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263611648 00000100:00100000:1.0:1746065154.944105:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263611648 00010000:00010000:0.0:1746065154.944123:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 11 pid: 7203 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.944132:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 38 pid: 7203 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746065154.944146:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263611520 00000100:00100000:0.0:1746065154.944148:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263611520 00010000:00010000:0.0:1746065154.944158:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 18 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746065154.944162:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6061 00000100:00100000:1.0:1746065154.944171:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263611392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065154.944177:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6062 00010000:00010000:1.0:1746065154.944184:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065154.944184:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881263611648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065154.944190:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 11 pid: 7203 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.944193:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.944199:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 38 pid: 7203 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.944200:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 11 pid: 7203 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746065154.944210:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 38 pid: 7203 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.944266:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc146fcef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cba expref: 11 pid: 7203 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.944271:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6063 00000100:00100000:3.0:1746065154.944278:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263611520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065154.944284:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065154.944286:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065154.944287:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.944291:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 18 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746065154.944294:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065154.944299:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065154.944302:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 18 pid: 13395 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.944318:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065154.944322:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.944329:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.944334:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.944372:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263611520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.944382:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6063 00010000:00010000:0.0:1746065154.944511:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065154.944515:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065154.944523:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065154.944529:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065154.944599:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263611392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 428us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065154.944608:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6061 00010000:00010000:2.0:1746065154.944612:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30e00/0xad6b7ddc146fc78 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c5f expref: 38 pid: 7203 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.944627:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263369216:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.944636:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc146fc16 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c12 expref: 17 pid: 13395 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.944645:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263369344:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.944670:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.944759:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.944797:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263611648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 613us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.944803:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6062 00010000:00010000:2.0:1746065154.944856:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.944863:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065154.944890:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065154.945058:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fd12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.945072:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.945079:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.945081:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065154.945083:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1a00, rc 0) 00000100:00100000:2.0:1746065154.945116:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32362:x1830881263611264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3515us (3763us total) trans 8589936013 rc 0/0 00000100:00100000:2.0:1746065154.945122:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13676 00000100:00100000:0.0:1746065154.951313:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.951408:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263611776 00000100:00100000:2.0:1746065154.951416:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263611776 00000100:00100000:2.0:1746065154.951457:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13677 00000100:00100000:2.0:1746065154.951463:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32362:x1830881263611776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065154.951484:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.951500:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc146fd27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ce4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.951571:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.951583:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.951588:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.951615:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.951629:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 11 pid: 7203 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.951638:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263369472:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.951980:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.954732:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.955570:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263611904 00000100:00100000:3.0:1746065154.955582:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263611904 00010000:00010000:3.0:1746065154.955628:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 12 pid: 7203 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746065154.955683:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6064 00000100:00100000:3.0:1746065154.955691:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263611904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065154.955706:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065154.955712:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 12 pid: 7203 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.955724:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 12 pid: 7203 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065154.955749:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065154.955753:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.955763:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.955770:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065154.955833:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065154.955885:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263611904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 194us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065154.955892:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6064 00010000:00010000:2.0:1746065154.958282:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd19 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cdd expref: 11 pid: 7203 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.958320:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263369472:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.958338:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.958345:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.958349:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065154.958392:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065154.958395:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065154.958408:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.958436:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc146fd27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ce4 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.958448:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ce4 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.958455:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.958458:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065154.958460:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683bc00, rc 0) 00000100:00100000:2.0:1746065154.958516:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32362:x1830881263611776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7052us (7211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065154.958523:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13677 00000100:00100000:0.0:1746065154.961459:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065154.961544:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263612032 00000100:00100000:3.0:1746065154.961554:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263612032 00000100:00100000:3.0:1746065154.961687:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13381 00000100:00100000:3.0:1746065154.961904:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263612032:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065154.961925:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065154.961943:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a000/0xad6b7ddc146fd35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ceb expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065154.962001:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263369600:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065154.963604:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.963700:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263612160 00000100:00100000:2.0:1746065154.963706:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263612160 00000100:00100000:2.0:1746065154.963741:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13382 00000100:00100000:2.0:1746065154.963747:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263612160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065154.963758:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.963768:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683a200/0xad6b7ddc146fd3c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cf2 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.963819:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263369728:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065154.964028:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.964070:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065154.968238:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263369600:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065154.968280:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a000/0xad6b7ddc146fd35 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ceb expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.968295:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a000/0xad6b7ddc146fd35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ceb expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.968327:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a000, rc 0) 00000100:00100000:3.0:1746065154.969170:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263612032:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7276us (7716us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065154.969181:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13381 00000100:00100000:2.0:1746065154.969740:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263369728:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065154.969764:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683a200/0xad6b7ddc146fd3c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cf2 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.969795:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a200/0xad6b7ddc146fd3c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cf2 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.969816:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a200, rc 0) 00000100:00100000:2.0:1746065154.969843:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263612160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6096us (6243us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065154.969850:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13382 00000100:00100000:0.0:1746065154.972833:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.972924:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263612416 00000100:00100000:2.0:1746065154.972934:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263612416 00000100:00100000:2.0:1746065154.972979:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13678 00000100:00100000:2.0:1746065154.972987:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32362:x1830881263612416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065154.973006:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065154.973025:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a000/0xad6b7ddc146fd43 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933cf9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.973123:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc146fd4a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.973137:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc146fd4a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065154.973148:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc146fd4a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065154.973157:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065154.973245:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a000/0xad6b7ddc146fd43 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cf9 expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.973261:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc146fd4a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cf9 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.973269:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065154.973272:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065154.973274:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683ac00, rc 0) 00000100:00100000:2.0:1746065154.973323:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32362:x1830881263612416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 337us (499us total) trans 8589936014 rc 0/0 00000100:00100000:2.0:1746065154.973329:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13678 00000100:00100000:2.0:1746065154.980032:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.980071:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263612672 00000100:00100000:2.0:1746065154.980080:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263612672 00000100:00100000:2.0:1746065154.981251:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13383 00000100:00100000:2.0:1746065154.981263:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263612672:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065154.981309:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.981329:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.981336:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.981338:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.981341:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.981374:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.981387:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 10 pid: 3068 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746065154.981401:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097240700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263369856:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.981560:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065154.981605:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.981718:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.981734:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.981751:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263612928 00000100:00100000:2.0:1746065154.981756:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263612928 00000100:00100000:2.0:1746065154.981791:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263613184 00000100:00100000:2.0:1746065154.981793:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263613184 00000100:00100000:2.0:1746065154.981803:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263612544 00000100:00100000:2.0:1746065154.981805:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263612544 00000100:00100000:2.0:1746065154.981816:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13384 00000100:00100000:2.0:1746065154.981821:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263612928:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065154.981840:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.981851:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.981859:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.981866:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.981871:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.981872:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.981874:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.981890:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982144:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 28 pid: 9548 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065154.982160:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263369984:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065154.982182:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13385 00000100:00100000:1.0:1746065154.982190:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263613184:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065154.982208:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.982218:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.982225:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.982231:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.982237:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.982242:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065154.982243:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065154.982245:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.982261:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.982269:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 10 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065154.982278:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263370112:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.982285:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982294:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 11 pid: 13375 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065154.982302:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263370240:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065154.982316:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065154.982325:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 9 pid: 3067 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746065154.982332:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263370368:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.982336:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982345:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 14 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065154.982352:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263370496:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065154.982361:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065154.982369:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 30 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065154.982371:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065154.982375:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263370624:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065154.982400:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065154.982405:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13386 00010000:00010000:1.0:1746065154.982406:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 10 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065154.982413:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263370752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.982416:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263612544:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:1.0:1746065154.982425:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065154.982451:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.982468:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982475:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982481:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982486:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.982488:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065154.982491:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.982508:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982515:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 28 pid: 9548 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065154.982522:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263370880:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.982548:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982556:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 11 pid: 13375 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065154.982567:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263371008:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.982584:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065154.982590:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 14 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065154.982596:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263371136:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.982606:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065154.983622:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065154.983682:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.986536:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263612800 00000100:00100000:2.0:1746065154.986550:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263612800 00000100:00100000:3.0:1746065154.986624:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263613056 00000100:00100000:3.0:1746065154.986629:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263613056 00000100:00100000:2.0:1746065154.986756:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13387 00000100:00100000:2.0:1746065154.986962:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263612800:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065154.987013:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.987033:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.987041:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.987043:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065154.987046:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.987083:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065154.987096:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 10 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065154.987109:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263371264:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065154.987192:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065154.987615:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13388 00000100:00100000:3.0:1746065154.987623:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263613056:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065154.987645:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987656:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987662:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.987669:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 11 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987676:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987683:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987691:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987698:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 11 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987708:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:3.0:1746065154.987709:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:3.0:1746065154.987711:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 10/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987730:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 11 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987739:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 11 pid: 12258 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065154.987751:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371392:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.987797:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987807:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 28 pid: 10219 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065154.987814:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371520:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.987836:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987843:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 11 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065154.987854:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371648:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.987875:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987882:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 28 pid: 3068 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065154.987889:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371776:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.987923:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 11 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987930:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 11 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065154.987937:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371904:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.987958:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065154.987965:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 15 pid: 9550 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065154.987972:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097faad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263372032:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065154.987991:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065154.987998:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 28 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065154.988005:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263372160:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065154.988018:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065154.999347:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.999451:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.999469:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.999489:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.999505:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065154.999548:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097240700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263369856:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065154.999573:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065154.999699:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065154.999723:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263614720 00000100:00100000:0.0:1746065154.999730:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263614720 00010000:00010000:0.0:1746065154.999765:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 29 pid: 10219 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065154.999802:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263614976 00000100:00100000:0.0:1746065154.999805:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263614976 00010000:00010000:0.0:1746065154.999814:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 30 pid: 3068 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065154.999825:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263614336 00000100:00100000:0.0:1746065154.999827:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263614336 00010000:00010000:0.0:1746065154.999838:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 16 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065154.999846:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263614592 00000100:00100000:0.0:1746065154.999847:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263614592 00010000:00010000:0.0:1746065154.999855:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 12 pid: 12258 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065154.999866:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6065 00000100:00100000:0.0:1746065154.999872:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263614720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065154.999885:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065154.999918:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 10 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 30 pid: 10219 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065154.999929:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 10 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 30 pid: 10219 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065154.999959:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065155.000049:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263614720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 126us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.000058:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6065 00000100:00100000:0.0:1746065155.000149:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6066 00000100:00100000:0.0:1746065155.000156:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263614976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065155.000162:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065155.000170:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 29 pid: 3068 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.000184:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 29 pid: 3068 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.000188:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6067 00010000:00010000:0.0:1746065155.000195:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.000196:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263614336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.000204:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065155.000210:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263614976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (720us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065155.000214:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 16 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.000215:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6066 00010000:00010000:1.0:1746065155.000222:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 16 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.000233:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.000248:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263614336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.000254:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6067 00000100:00100000:1.0:1746065155.000264:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6068 00000100:00100000:1.0:1746065155.000269:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263614592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.000276:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.000282:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 10 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 12 pid: 12258 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.000289:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 10 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 12 pid: 12258 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.000299:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.000311:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263614592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.000316:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6068 00000100:00100000:1.0:1746065155.000357:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263370112:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065155.000361:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.000366:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263370368:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065155.000373:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263370624:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065155.000380:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263370752:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065155.000400:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.000418:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.000427:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263614848 00000100:00100000:0.0:1746065155.000430:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263614848 00010000:00010000:0.0:1746065155.000440:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 12 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.000458:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263615232 00000100:00100000:0.0:1746065155.000460:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263615232 00000100:00100000:1.0:1746065155.000465:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6069 00010000:00010000:0.0:1746065155.000468:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 13 pid: 13375 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746065155.000469:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263614848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.000476:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065155.000478:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6070 00010000:00010000:1.0:1746065155.000482:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 13 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.000482:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263615232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065155.000486:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.000489:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 13 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.000492:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 13 pid: 13375 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.000499:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065155.000499:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 13 pid: 13375 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.000509:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.000514:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263614848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.000519:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6069 00000100:00100000:0.0:1746065155.000519:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263615232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.000523:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6070 00000100:00100000:0.0:1746065155.000575:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263371264:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065155.000586:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.000602:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263613312 00000100:00100000:0.0:1746065155.000605:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263613312 00002000:00100000:0.0:1746065155.000630:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1859584->2097151) req@ffff880099ec4000 x1830881263613312/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065155.000638:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263369984:192.168.202.27@tcp:104: 00002000:00100000:0.0:1746065155.000639:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4000 with x1830881263613312 ext(1859584->2097151) 00010000:00010000:0.0:1746065155.000645:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 11 pid: 3068 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746065155.000649:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc146fa41 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933af3 expref: 11 pid: 13375 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.000655:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 11 pid: 3068 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746065155.000661:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec4000 00000100:00100000:3.0:1746065155.000664:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263370240:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.000673:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263370496:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065155.000676:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263614464 00000100:00100000:0.0:1746065155.000677:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263614464 00002000:00100000:0.0:1746065155.000689:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1769471) req@ffff880099ec6a00 x1830881263614464/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/0 e 0 to 0 dl 1746065165 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065155.000695:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065155.000695:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6a00 with x1830881263614464 ext(1048576->1769471) 00010000:00010000:0.0:1746065155.000699:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.000706:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746065155.000711:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec6a00 00000100:00100000:0.0:1746065155.000720:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1332 00010000:00010000:3.0:1746065155.000724:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc146fb67 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 9 type: EXT [5017600->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bc5 expref: 10 pid: 12258 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.000725:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263613312:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065155.000732:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371392:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.000740:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc146fb52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 8 type: EXT [3485696->18446744073709551615] (req 5017600->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933bb0 expref: 28 pid: 10219 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.000747:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371520:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.000756:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc146fc5c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c51 expref: 9 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.000762:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371648:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.000770:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc146fc47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c43 expref: 27 pid: 3068 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.000793:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371776:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.000802:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263371904:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.000809:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097faad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263372032:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.000815:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263372160:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.000839:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.000856:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1333 00000100:00100000:3.0:1746065155.000862:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263614464:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065155.001093:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263370880:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.001101:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263371008:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.001109:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc146f93e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a83 expref: 15 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.001120:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263371136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.001133:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.012376:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.012457:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263615360 00000100:00100000:2.0:1746065155.012470:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263615360 00010000:00010000:2.0:1746065155.012530:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 9 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.012570:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6071 00000100:00100000:2.0:1746065155.012580:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263615360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065155.012596:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.012617:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 9 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.012628:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 9 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.012653:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2da00/0xad6b7ddc146fca2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c82 expref: 9 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.012683:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.012743:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+8:2007:x1830881263615360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 163us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.012750:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6071 00000100:00080000:0.0:1746065155.014201:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065155.019760:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.019824:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.019854:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.019877:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.019886:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263613568 00000100:00100000:1.0:1746065155.019907:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263613568 00000100:00100000:2.0:1746065155.019908:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263613824 00000100:00100000:3.0:1746065155.019911:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263614080 00000100:00100000:3.0:1746065155.019914:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263614080 00000100:00100000:2.0:1746065155.019914:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263613824 00010000:00010000:3.0:1746065155.019949:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 16 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.019949:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 15 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.019952:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 16 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.019977:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6072 00000100:00100000:2.0:1746065155.019985:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263613824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065155.020001:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.020024:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 15 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.020034:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 15 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.020060:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b000/0xad6b7ddc146f953 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933a98 expref: 15 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.020078:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.020124:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263613824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 139us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.020130:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6072 00000100:00100000:2.0:1746065155.020146:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263615104 00000100:00100000:2.0:1746065155.020149:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263615104 00010000:00010000:2.0:1746065155.020158:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 14 pid: 9550 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.020212:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6073 00000100:00100000:2.0:1746065155.020218:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263614080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065155.020220:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6074 00010000:00010000:2.0:1746065155.020225:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065155.020226:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263613568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065155.020227:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6075 00010000:00010000:2.0:1746065155.020237:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 16 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.020238:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065155.020238:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263615104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.020245:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 16 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.020246:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 16 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.020252:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.020253:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 16 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.020267:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc146fc8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c6d expref: 16 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.020272:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc146fca9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c89 expref: 16 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.020275:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 14 pid: 9550 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.020277:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065155.020283:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065155.020287:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 14 pid: 9550 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.020292:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263614080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.020295:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263613568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.020298:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6073 00000100:00100000:3.0:1746065155.020300:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6074 00000100:00100000:2.0:1746065155.020334:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.020366:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263613440 00000100:00100000:3.0:1746065155.020369:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263613440 00000100:00100000:2.0:1746065155.020373:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.020381:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263613696 00010000:00010000:3.0:1746065155.020382:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 27 pid: 9548 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.020383:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263613696 00000100:00100000:3.0:1746065155.020392:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6076 00010000:00010000:2.0:1746065155.020393:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 11 pid: 3067 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.020396:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263613440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.020402:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.020409:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 27 pid: 9548 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.020418:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 27 pid: 9548 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.020418:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6077 00000100:00100000:2.0:1746065155.020422:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263613696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065155.020428:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.020430:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc146fa09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ae5 expref: 27 pid: 9548 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.020433:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 11 pid: 3067 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.020439:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.020440:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 11 pid: 3067 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.020441:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.020445:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020449:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc146fcfd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cd6 expref: 11 pid: 3067 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.020453:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020455:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.020468:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263613696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.020473:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6077 00010000:00010000:3.0:1746065155.020477:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.020489:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263613440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.020493:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.020494:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6076 00000100:00100000:3.0:1746065155.020500:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263613952 00000100:00100000:3.0:1746065155.020503:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263613952 00000100:00100000:2.0:1746065155.020511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065155.020513:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 31 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.020518:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263614208 00000100:00100000:2.0:1746065155.020520:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263614208 00000100:00100000:0.0:1746065155.020526:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6078 00010000:00010000:2.0:1746065155.020528:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 26 pid: 9548 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.020536:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263613952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.020539:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.020540:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6079 00000100:00100000:2.0:1746065155.020544:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263614208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065155.020545:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.020547:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020551:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.020558:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 26 pid: 9548 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.020558:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 31 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.020563:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.020566:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 31 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.020567:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 26 pid: 9548 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.020571:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.020577:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020577:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc146f9fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ac2 expref: 26 pid: 9548 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.020583:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065155.020583:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc146fc9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c7b expref: 31 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.020587:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020587:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065155.020595:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.020599:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263614208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (88us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065155.020600:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.020602:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.020604:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.020604:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6079 00010000:00010000:0.0:1746065155.020606:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.020609:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1a00/0xad6b7ddc146fd5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.020618:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.020626:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.020634:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263615488 00010000:00010000:0.0:1746065155.020636:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.020637:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263615488 00010000:00010000:2.0:1746065155.020646:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 8 pid: 13375 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.020649:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263612928:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 38828us (39045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.020656:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6080 00000100:00100000:3.0:1746065155.020658:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13384 00000100:00100000:2.0:1746065155.020660:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263615488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065155.020665:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.020670:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 8 pid: 13375 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.020675:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263613952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (180us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065155.020678:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 8 pid: 13375 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.020683:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6078 00010000:00010000:2.0:1746065155.020688:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc146fa25 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ad7 expref: 8 pid: 13375 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.020697:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.020698:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.020701:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020706:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020720:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.020733:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263615488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 72us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.020738:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6080 00010000:00010000:2.0:1746065155.020755:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.020760:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065155.020762:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020792:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020798:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020805:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020809:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065155.020812:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020818:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020826:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020831:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539000/0xad6b7ddc146fd6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.020841:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263615616 00000100:00100000:3.0:1746065155.020844:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263615616 00010000:00010000:3.0:1746065155.020854:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 25 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.020866:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263612544:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 38454us (39130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.020871:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13386 00000100:00100000:3.0:1746065155.020876:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6081 00000100:00100000:3.0:1746065155.020880:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263615616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.020886:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.020936:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020943:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020954:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020960:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020965:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020970:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065155.020972:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020977:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020986:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.020992:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488400/0xad6b7ddc146fd66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.021030:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263613184:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 38841us (39312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.021036:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13385 00010000:00010000:1.0:1746065155.021186:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a600/0xad6b7ddc146fd0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ccf expref: 12 pid: 9550 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.022998:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065155.023006:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 25 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.023021:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 25 pid: 13375 timeout: 851 lvb_type: 0 00000100:00080000:2.0:1746065155.023029:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746065155.023033:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065155.023039:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e800/0xad6b7ddc146fc4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c4a expref: 25 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.023045:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263615104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2809us (3165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.023052:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6075 00010000:00010000:3.0:1746065155.023053:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.023054:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.023058:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.023064:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.023087:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065155.023094:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.023101:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.023116:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263615616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2234us (2355us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065155.023119:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.023124:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6081 00010000:00010000:2.0:1746065155.023126:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.023132:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.023138:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065155.023141:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.023154:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.023163:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.023168:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc146fd7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.023209:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263613056:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 35587us (39526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.023217:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13388 00000100:00100000:0.0:1746065155.027099:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263614464:12345-192.168.202.27@tcp:4:cat.0 Request processed in 26229us (27640us total) trans 17179873485 rc 0/0 00000100:00100000:0.0:1746065155.027110:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1333 00002000:00100000:0.0:1746065155.027120:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1769471) req@ffff880099ec6a00 x1830881263614464/t17179873485(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065155.027128:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6a00 with x1830881263614464 ext(1048576->1769471) 00010000:00010000:0.0:1746065155.027137:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 15 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.027148:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 15 pid: 9550 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746065155.027154:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec6a00 00000100:00100000:1.0:1746065155.027273:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263613312:12345-192.168.202.27@tcp:4:cat.0 Request processed in 26547us (27939us total) trans 17179873486 rc 0/0 00000100:00100000:1.0:1746065155.027279:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1332 00002000:00100000:1.0:1746065155.027284:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1859584->2097151) req@ffff880099ec4000 x1830881263613312/t17179873486(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:70/0 lens 488/448 e 0 to 0 dl 1746065165 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.027291:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4000 with x1830881263613312 ext(1859584->2097151) 00010000:00010000:1.0:1746065155.027296:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 13 pid: 3068 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.027310:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 13 pid: 3068 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746065155.027315:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec4000 00000100:00100000:3.0:1746065155.032135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.032179:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.032211:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263615872 00000100:00100000:1.0:1746065155.032220:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263615872 00010000:00010000:1.0:1746065155.032248:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 13 pid: 3068 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.032271:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263615744 00000100:00100000:1.0:1746065155.032272:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263615744 00010000:00010000:1.0:1746065155.032281:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 14 pid: 9550 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.032854:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6082 00000100:00100000:1.0:1746065155.032862:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263615872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.032875:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.032891:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 14 pid: 3068 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.032910:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 14 pid: 3068 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.032929:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc146fc55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c58 expref: 14 pid: 3068 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.032949:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.032950:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.032953:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.032960:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.032983:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.033026:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263615872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 165us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.033032:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6082 00000100:00100000:1.0:1746065155.033048:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6083 00000100:00100000:1.0:1746065155.033053:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263615744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.033059:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.033067:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.033395:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.033406:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc146fc94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1769471) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c74 expref: 12 pid: 9550 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.033510:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.033512:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.033514:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.033520:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.033535:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.033553:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263615744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 500us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.033559:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6083 00010000:00010000:2.0:1746065155.033657:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.033673:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.033696:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.033703:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.033710:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.033722:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065155.033726:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.033732:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.033746:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.033750:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc146fd58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.033828:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263612672:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 52567us (53805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.033837:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13383 00010000:00010000:0.0:1746065155.034038:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.034046:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.034272:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.034280:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.034285:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.034290:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065155.034293:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.034298:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.034307:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.034312:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539600/0xad6b7ddc146fd74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.034358:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2005:x1830881263612800:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 47594us (50740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.034364:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13387 00000100:00100000:1.0:1746065155.036482:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.036635:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263616128 00000100:00100000:0.0:1746065155.036643:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263616128 00000100:00100000:0.0:1746065155.036718:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13679 00000100:00100000:0.0:1746065155.036725:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32362:x1830881263616128:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065155.036764:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065155.036800:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc146fd2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ce4 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.036813:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065155.036816:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065155.036835:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065155.036845:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 16 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.036851:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.036856:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.036861:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.036866:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065155.036887:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.036915:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 16 pid: 9571 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.036925:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263372288:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065155.037001:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.037008:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 36 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.037014:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263372416:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065155.037030:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 16 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.037035:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 16 pid: 7203 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.037041:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263372544:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065155.037054:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 16 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.037059:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 16 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.037065:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263372672:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065155.037077:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd180 going to sleep for 11 seconds 00000100:00080000:2.0:1746065155.037152:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065155.040510:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.040542:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.040571:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263616512 00000100:00100000:0.0:1746065155.040580:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263616512 00000100:00100000:0.0:1746065155.040659:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4943 00000100:00100000:0.0:1746065155.040668:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+17:30398:x1830881263616512:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065155.040812:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263616384 00000100:00100000:1.0:1746065155.040824:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263616384 00010000:00010000:1.0:1746065155.040864:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 37 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.040911:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6084 00000100:00100000:1.0:1746065155.040918:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263616384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065155.040928:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+18:30398:x1830881263616512:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 260us (383us total) trans 8589936015 rc 0/0 00010000:00010000:1.0:1746065155.040931:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065155.040936:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4943 00010000:00010000:1.0:1746065155.040937:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 37 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.040947:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 37 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.040965:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065155.040970:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065155.040981:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065155.040992:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.041022:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263616384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 104us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.041028:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6084 00000100:00100000:1.0:1746065155.041043:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263616768 00000100:00100000:1.0:1746065155.041045:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263616768 00010000:00010000:1.0:1746065155.041053:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 18 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.041069:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6085 00000100:00100000:1.0:1746065155.041073:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263616768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.041078:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.041087:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 18 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.041094:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 18 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.041103:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065155.041106:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065155.041110:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.041153:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263372288:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.041166:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc146fa64 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b24 expref: 36 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.041183:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263372416:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.041191:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263372544:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.041199:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718a00/0xad6b7ddc146fa56 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b16 expref: 18 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.041212:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263372672:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.041235:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00080000:3.0:1746065155.041911:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065155.042971:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.043240:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263616768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2160us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.043250:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6085 00000100:00100000:1.0:1746065155.044495:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263616640 00000100:00100000:1.0:1746065155.044502:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263616640 00010000:00010000:1.0:1746065155.044526:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 17 pid: 7203 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.044572:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6086 00000100:00100000:0.0:1746065155.044585:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263616640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065155.044600:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065155.044609:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 17 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.044620:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 17 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.044642:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc146fa5d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933b1d expref: 17 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.044659:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065155.044664:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065155.044673:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065155.044721:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263616640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 140us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.044727:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6086 00000100:00100000:0.0:1746065155.047868:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.047954:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263616896 00000100:00100000:1.0:1746065155.047964:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263616896 00010000:00010000:1.0:1746065155.047996:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 16 pid: 9571 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.048027:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6087 00000100:00100000:1.0:1746065155.048033:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263616896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.048044:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.048049:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 16 pid: 9571 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.048058:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 16 pid: 9571 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.048075:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc146fbfa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933c04 expref: 16 pid: 9571 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.048091:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065155.048095:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065155.048103:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065155.048107:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065155.048444:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.048497:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263616896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 462us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.048504:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6087 00010000:00010000:2.0:1746065155.050614:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.050626:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000040:00080000:2.0:1746065155.050845:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].577, 88 off58840 00000004:00080000:2.0:1746065155.050853:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069078589ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.050879:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].517, 88 off53552 00000004:00080000:2.0:1746065155.050884:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751069110806ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.050908:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].518, 88 off53640 00000004:00080000:2.0:1746065155.050911:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751069137658ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.050920:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].578, 88 off58928 00000004:00080000:2.0:1746065155.050922:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069148876ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.050929:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].579, 88 off59016 00000004:00080000:2.0:1746065155.050930:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069156958ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.050936:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].519, 88 off53728 00000004:00080000:2.0:1746065155.050938:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751069165009ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.050944:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].520, 88 off53816 00000004:00080000:2.0:1746065155.050946:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751069173008ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.050953:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].521, 88 off53904 00000004:00080000:2.0:1746065155.050956:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751069182808ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.050964:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].580, 88 off59104 00000004:00080000:2.0:1746065155.050967:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069193149ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.050974:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].522, 88 off53992 00000004:00080000:2.0:1746065155.050976:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751069202619ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.050983:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].581, 88 off59192 00000004:00080000:2.0:1746065155.050986:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069212141ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.050992:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].523, 88 off54080 00000004:00080000:2.0:1746065155.050994:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751069220786ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.051001:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].582, 88 off59280 00000004:00080000:2.0:1746065155.051003:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069229488ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.051010:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].583, 88 off59368 00000004:00080000:2.0:1746065155.051012:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069238946ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.051019:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].584, 88 off59456 00000004:00080000:2.0:1746065155.051021:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069247555ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.051027:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].585, 88 off59544 00000004:00080000:2.0:1746065155.051030:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751069256445ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.051037:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].524, 88 off54168 00000004:00080000:2.0:1746065155.051039:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751069265635ns, next at 615601404258ns, rc = 0 00000001:00080000:2.0:1746065155.064788:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936016 is committed 00000004:00080000:2.0:1746065155.064800:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 518 committed 00000004:00080000:2.0:1746065155.064813:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 577 committed 00000004:00080000:2.0:1746065155.064822:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 576 committed 00000004:00080000:2.0:1746065155.064824:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 575 committed 00000004:00080000:2.0:1746065155.064825:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 574 committed 00000004:00080000:2.0:1746065155.064826:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 517 committed 00000004:00080000:2.0:1746065155.064827:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 573 committed 00000004:00080000:2.0:1746065155.064829:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 516 committed 00000004:00080000:2.0:1746065155.064830:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 572 committed 00000004:00080000:2.0:1746065155.064831:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 515 committed 00000004:00080000:2.0:1746065155.064833:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 514 committed 00000004:00080000:2.0:1746065155.064835:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 513 committed 00000004:00080000:2.0:1746065155.064836:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 571 committed 00000004:00080000:2.0:1746065155.064838:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 570 committed 00000004:00080000:2.0:1746065155.064839:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 512 committed 00000004:00080000:2.0:1746065155.064841:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 511 committed 00000004:00080000:2.0:1746065155.064842:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 569 committed 00000001:00080000:2.0:1746065155.064846:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936015 is committed 00000001:00080000:2.0:1746065155.064853:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936011 is committed 00000100:00100000:1.0:1746065155.065014:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263372928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.065065:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.065108:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263373440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.065129:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.065148:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065155.065152:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263372800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.065165:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.065175:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263373312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.065191:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.065212:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372928 00000100:00100000:1.0:1746065155.065218:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372928 00000004:00010000:3.0:1746065155.065236:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009834fb80 reply state ffff88008f1dac00 transno 8589936016 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.065252:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065155.065252:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373440 00000100:00100000:1.0:1746065155.065254:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373440 00010000:00010000:3.0:1746065155.065259:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.065261:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065155.065264:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065155.065266:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372800 00000100:00100000:1.0:1746065155.065267:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372800 00000100:00100000:2.0:1746065155.065270:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263373056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.065275:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373312 00000100:00100000:1.0:1746065155.065277:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373312 00000100:00100000:1.0:1746065155.065288:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13389 00000100:00100000:2.0:1746065155.065290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.065293:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3762:x1830881263372928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065303:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263373568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1746065155.065332:0:7231:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065155.065338:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065155.065342:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32362:x1830881263616128:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 28616us (28865us total) trans 8589936016 rc 0/0 00000100:00100000:2.0:1746065155.065342:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263373184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.065348:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13679 00000100:00100000:2.0:1746065155.065354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.065363:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263373696:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065155.065370:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065155.065373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065155.065377:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.065382:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.065387:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.065390:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065155.065390:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373056 00000100:00100000:2.0:1746065155.065392:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373056 00010000:00010000:3.0:1746065155.065396:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065155.065402:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373568 00000100:00100000:2.0:1746065155.065403:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373568 00010000:00010000:3.0:1746065155.065404:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.065406:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065155.065408:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065155.065408:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373184 00000100:00100000:1.0:1746065155.065408:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263372928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (343us total) trans 21474840941 rc 0/0 00000100:00100000:2.0:1746065155.065410:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373184 00010000:00010000:3.0:1746065155.065413:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45c00/0xad6b7ddc146fd82 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065155.065414:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13389 00000100:00100000:2.0:1746065155.065417:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373696 00000100:00100000:2.0:1746065155.065418:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373696 00000100:00100000:1.0:1746065155.065423:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13390 00000100:00100000:2.0:1746065155.065426:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13391 00000100:00100000:1.0:1746065155.065427:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263373440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065429:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263372800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.065434:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13392 00000100:00100000:3.0:1746065155.065441:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263373312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065467:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13393 00000100:00100000:2.0:1746065155.065472:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263373056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.065479:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3762:x1830881263373440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (349us total) trans 21474840942 rc 0/0 00002000:00010000:3.0:1746065155.065484:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00000100:00100000:1.0:1746065155.065484:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13390 00002000:00010000:3.0:1746065155.065486:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065155.065487:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065155.065489:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065155.065490:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:3.0:1746065155.065505:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3762:x1830881263373312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (313us total) trans 21474840944 rc 0/0 00000100:00100000:3.0:1746065155.065509:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13392 00000100:00100000:3.0:1746065155.065516:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13394 00000100:00100000:3.0:1746065155.065519:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263373568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065531:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263373056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (240us total) trans 21474840945 rc 0/0 00000100:00100000:2.0:1746065155.065536:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13393 00002000:00010000:3.0:1746065155.065543:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065155.065545:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.065546:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746065155.065546:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13395 00002000:00010000:3.0:1746065155.065547:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.065548:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:2.0:1746065155.065549:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263373184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.065559:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263373568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (232us total) trans 21474840946 rc 0/0 00000100:00100000:3.0:1746065155.065562:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13394 00000100:00100000:3.0:1746065155.065568:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13396 00000100:00100000:3.0:1746065155.065571:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881263373696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065155.065580:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065155.065583:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065155.065585:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065155.065586:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065155.065588:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746065155.065602:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263373184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (247us total) trans 21474840947 rc 0/0 00000100:00100000:2.0:1746065155.065607:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13395 00000004:00080000:1.0:1746065155.065607:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834e680/2, rc 0, transno 21474840944 00000100:00100000:1.0:1746065155.065613:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263373312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065155.065620:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834df80/2, rc 0, transno 21474840941 00000100:00100000:1.0:1746065155.065623:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263372928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065155.065628:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834dc00/2, rc 0, transno 21474840942 00000100:00100000:1.0:1746065155.065631:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263373440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065636:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263372800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (470us total) trans 21474840943 rc 0/0 00000004:00080000:1.0:1746065155.065637:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834d180/2, rc 0, transno 21474840943 00000100:00100000:1.0:1746065155.065639:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263372800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065640:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13391 00000004:00080000:2.0:1746065155.065655:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834c380/2, rc 0, transno 21474840947 00000100:00100000:2.0:1746065155.065658:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263373184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.065661:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1746065155.065664:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834e300/2, rc 0, transno 21474840945 00000100:00100000:1.0:1746065155.065665:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263373824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065666:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263373056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065155.065671:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834c000/2, rc 0, transno 21474840946 00000100:00100000:2.0:1746065155.065674:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263373568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.065679:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.065691:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373824 00000100:00100000:2.0:1746065155.065693:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373824 00000100:00100000:2.0:1746065155.065705:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13397 00000100:00100000:2.0:1746065155.065709:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263373824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.065784:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3762:x1830881263373824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (90us total) trans 21474840948 rc 0/0 00000100:00100000:2.0:1746065155.065789:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13397 00000004:00080000:1.0:1746065155.065801:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8700/2, rc 0, transno 21474840948 00000100:00100000:1.0:1746065155.065805:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263373824:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065155.065821:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:3.0:1746065155.065824:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.065825:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065155.065827:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.065829:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:3.0:1746065155.065857:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263373696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 285us (483us total) trans 21474840949 rc 0/0 00000100:00100000:3.0:1746065155.065861:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13396 00000100:00100000:1.0:1746065155.065909:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263373952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065155.065927:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.065943:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263374208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065155.065949:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263374464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.065953:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373952 00000100:00100000:3.0:1746065155.065956:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373952 00000100:00100000:2.0:1746065155.065960:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.065971:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263374720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.065972:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374208 00000100:00100000:3.0:1746065155.065974:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374208 00000100:00100000:1.0:1746065155.065975:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.065983:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374464 00000100:00100000:2.0:1746065155.065983:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.065984:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374464 00000100:00100000:1.0:1746065155.065986:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065155.065990:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263374336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.065991:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746065155.065992:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374720 00000100:00100000:3.0:1746065155.065994:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374720 00000100:00100000:2.0:1746065155.065994:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263374080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065155.066001:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.066003:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13398 00000100:00100000:3.0:1746065155.066007:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3762:x1830881263373952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065155.066012:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263374848:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065155.066013:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834ed80/2, rc 0, transno 21474840949 00000100:00100000:2.0:1746065155.066016:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263373696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.066023:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.066029:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374336 00000100:00100000:1.0:1746065155.066032:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374336 00000100:00100000:2.0:1746065155.066033:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263374592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065155.066044:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374080 00000100:00100000:2.0:1746065155.066045:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.066045:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374080 00000100:00100000:1.0:1746065155.066050:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374592 00000100:00100000:1.0:1746065155.066052:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374592 00000100:00100000:2.0:1746065155.066056:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13399 00000100:00100000:2.0:1746065155.066060:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263374208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065155.066060:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13400 00000100:00100000:1.0:1746065155.066064:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263374464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.066069:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263373952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (141us total) trans 17179873487 rc 0/0 00000100:00100000:3.0:1746065155.066074:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13398 00000100:00100000:3.0:1746065155.066083:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13401 00000100:00100000:3.0:1746065155.066086:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3760:x1830881263374720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065155.066096:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13402 00000100:00100000:1.0:1746065155.066101:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263374336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.066103:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13403 00000100:00100000:3.0:1746065155.066107:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263374080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.066115:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263374208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (154us total) trans 17179873488 rc 0/0 00000100:00100000:2.0:1746065155.066120:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13399 00000100:00100000:2.0:1746065155.066135:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13404 00002000:00010000:1.0:1746065155.066136:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065155.066138:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00000100:00100000:2.0:1746065155.066139:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881263374592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065155.066140:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065155.066142:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065155.066143:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065155.066158:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881263374080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (133us total) trans 17179873491 rc 0/0 00000100:00100000:1.0:1746065155.066162:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3762:x1830881263374336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (160us total) trans 17179873490 rc 0/0 00000100:00100000:3.0:1746065155.066163:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13403 00000100:00100000:1.0:1746065155.066167:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13402 00000100:00100000:2.0:1746065155.066404:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263374592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 264us (357us total) trans 17179873492 rc 0/0 00000100:00100000:2.0:1746065155.066409:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13404 00000100:00100000:2.0:1746065155.066462:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263374464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 397us (485us total) trans 17179873489 rc 0/0 00000100:00100000:2.0:1746065155.066467:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13400 00000004:00080000:2.0:1746065155.066486:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f1c00/2, rc 0, transno 17179873491 00000100:00100000:2.0:1746065155.066489:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263374080:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065155.066495:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f0700/2, rc 0, transno 17179873492 00000100:00100000:2.0:1746065155.066497:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263374592:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065155.066503:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f1180/2, rc 0, transno 17179873488 00000100:00100000:2.0:1746065155.066505:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263374208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.066515:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065155.066542:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f2a00/2, rc 0, transno 17179873487 00000100:00100000:2.0:1746065155.066545:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263373952:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065155.066550:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f3800/2, rc 0, transno 17179873489 00000100:00100000:2.0:1746065155.066552:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263374464:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065155.066558:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f3100/2, rc 0, transno 17179873490 00000100:00100000:2.0:1746065155.066560:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263374336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.066692:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263374720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 604us (707us total) trans 17179873493 rc 0/0 00000100:00100000:3.0:1746065155.066697:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13401 00000004:00080000:2.0:1746065155.066748:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f0e00/2, rc 0, transno 17179873493 00000100:00100000:2.0:1746065155.066752:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263374720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.067222:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374848 00000100:00100000:3.0:1746065155.067225:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374848 00000100:00100000:3.0:1746065155.067249:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13405 00000100:00100000:3.0:1746065155.067254:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263374848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.067319:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263374848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (802us total) trans 17179873494 rc 0/0 00000100:00100000:3.0:1746065155.067324:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13405 00000004:00080000:0.0:1746065155.067509:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f1f80/2, rc 0, transno 17179873494 00000100:00100000:0.0:1746065155.067512:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263374848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.067798:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.067927:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263617024 00000100:00100000:2.0:1746065155.067932:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263617024 00000100:00100000:2.0:1746065155.067955:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13680 00000100:00100000:2.0:1746065155.067959:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32362:x1830881263617024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065155.067974:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.067986:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d00 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.068022:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.068032:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.068045:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.068047:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065155.068049:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66600, rc 0) 00000100:00100000:2.0:1746065155.068075:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32362:x1830881263617024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.068081:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13680 00000100:00100000:3.0:1746065155.070665:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.070712:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263617152 00000100:00100000:0.0:1746065155.070718:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263617152 00000100:00100000:0.0:1746065155.070751:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13681 00000100:00100000:0.0:1746065155.070757:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32362:x1830881263617152:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065155.070770:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.070808:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44200/0xad6b7ddc146fd90 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d07 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.070875:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146fd97 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065155.070886:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146fd97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065155.070905:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146fd97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065155.070926:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:0.0:1746065155.070929:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065155.070942:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146fd97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065155.070966:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44200/0xad6b7ddc146fd90 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d07 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.070993:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146fd97 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d07 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.071047:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065155.071051:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065155.071054:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45400, rc 0) 00000100:00100000:0.0:1746065155.071087:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32362:x1830881263617152:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 330us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.071092:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13681 00000100:00100000:0.0:1746065155.072852:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.072884:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.072912:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.072913:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263617408 00000100:00100000:2.0:1746065155.072919:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263617408 00000100:00100000:0.0:1746065155.072938:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.073201:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263617664 00000100:00100000:2.0:1746065155.073204:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263617664 00000100:00100000:0.0:1746065155.073211:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263617920 00000100:00100000:0.0:1746065155.073214:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263617920 00000100:00100000:2.0:1746065155.073220:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263617280 00000100:00100000:2.0:1746065155.073222:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263617280 00000100:00100000:0.0:1746065155.073233:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13406 00000100:00100000:2.0:1746065155.073238:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13407 00000100:00100000:0.0:1746065155.073239:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2004:x1830881263617408:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065155.073242:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263617664:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065155.073249:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.073249:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.073262:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d23 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.073262:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d15 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065155.073278:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d700, atime: 0x6812d6ff, ctime: 0x6812d700, blocks: 0x808 00002000:00010000:0.0:1746065155.073278:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d703, atime: 0x6812d702, ctime: 0x6812d703, blocks: 0x808 00010000:00010000:2.0:1746065155.073290:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.073290:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.073291:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.073292:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.073298:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.073298:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.073308:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.073309:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.073315:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f877000, rc 0) 00010000:00010000:0.0:1746065155.073316:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45c00, rc 0) 00000100:00100000:2.0:1746065155.073345:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263617664:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 102us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.073345:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263617408:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 106us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.073350:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13407 00000100:00100000:2.0:1746065155.073361:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13408 00000100:00100000:2.0:1746065155.073365:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263617920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065155.073370:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.073376:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d31 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065155.073384:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d703, atime: 0x6812d702, ctime: 0x6812d703, blocks: 0x1000 00010000:00010000:2.0:1746065155.073391:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.073392:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.073395:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.073402:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.073411:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67e00, rc 0) 00000100:00100000:2.0:1746065155.073421:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263617920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 56us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.073425:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13408 00000100:00100000:2.0:1746065155.073433:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13409 00000100:00100000:2.0:1746065155.073437:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263617280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065155.073440:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.073446:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d0e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065155.073453:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d700, atime: 0x6812d700, ctime: 0x6812d700, blocks: 0x7f8 00010000:00010000:2.0:1746065155.073458:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.073460:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.073463:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065155.073467:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065155.073469:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.073474:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae22600, rc 0) 00000100:00100000:2.0:1746065155.073486:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263617280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 49us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.073500:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263617536 00000100:00100000:1.0:1746065155.073503:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263617536 00000100:00100000:3.0:1746065155.073524:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.073626:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13406 00000100:00100000:2.0:1746065155.073631:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13409 00000100:00100000:0.0:1746065155.073637:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263617792 00000100:00100000:0.0:1746065155.073639:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263617792 00000100:00100000:0.0:1746065155.073651:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13410 00000100:00100000:0.0:1746065155.073655:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263617792:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065155.073661:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.073669:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d2a expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065155.073680:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d702, atime: 0x6812d702, ctime: 0x6812d702, blocks: 0x1650 00010000:00010000:0.0:1746065155.073686:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.073687:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.073691:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.073699:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.073709:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683b800, rc 0) 00000100:00100000:1.0:1746065155.073761:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13411 00000100:00100000:1.0:1746065155.073767:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263617536:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065155.073791:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.073799:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d1c expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065155.073810:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d703, atime: 0x6812d702, ctime: 0x6812d703, blocks: 0x800 00010000:00010000:1.0:1746065155.073817:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.073818:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.073822:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.073830:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.073835:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:1.0:1746065155.074102:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263617536:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 334us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.074102:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263617792:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 445us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.074107:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13410 00000100:00100000:1.0:1746065155.074113:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13411 00000100:00100000:0.0:1746065155.077231:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.077245:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.077264:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.077265:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263618048 00000100:00100000:1.0:1746065155.077272:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263618048 00000100:00100000:0.0:1746065155.077277:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.077289:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263618176 00000100:00100000:0.0:1746065155.077289:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.077293:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263618176 00000100:00100000:1.0:1746065155.077313:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263618304 00000100:00100000:1.0:1746065155.077316:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263618304 00000100:00100000:2.0:1746065155.077319:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263618432 00000100:00100000:2.0:1746065155.077322:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263618432 00000100:00100000:1.0:1746065155.077331:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263618560 00000100:00100000:1.0:1746065155.077333:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263618560 00000100:00100000:2.0:1746065155.077338:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13412 00000100:00100000:3.0:1746065155.077343:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13413 00000100:00100000:2.0:1746065155.077344:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263618048:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065155.077349:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263618176:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065155.077350:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13414 00000100:00100000:1.0:1746065155.077355:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263618304:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065155.077414:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.077415:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263618304:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.077421:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13414 00000100:00100000:1.0:1746065155.077433:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263618688 00000100:00100000:1.0:1746065155.077435:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263618688 00000100:00100000:1.0:1746065155.077443:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13415 00000100:00100000:1.0:1746065155.077447:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263618432:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065155.077515:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263618048:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 170us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.077516:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13416 00000100:00100000:2.0:1746065155.077520:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13412 00000100:00100000:0.0:1746065155.077522:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263618560:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065155.077529:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13417 00000100:00100000:2.0:1746065155.077533:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263618688:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065155.077570:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263618176:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 221us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.077574:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13413 00000100:00100000:1.0:1746065155.077587:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263618432:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 138us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.077593:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13415 00000100:00100000:2.0:1746065155.077628:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263618688:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 93us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.077628:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263618560:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.077632:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13417 00000100:00100000:0.0:1746065155.077637:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13416 00000100:00100000:0.0:1746065155.081983:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.082032:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263618816 00000100:00100000:1.0:1746065155.082039:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263618816 00000100:00100000:0.0:1746065155.082242:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.082535:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.082698:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263619072 00000100:00100000:1.0:1746065155.082702:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263619072 00000100:00100000:0.0:1746065155.082704:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.082832:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.082844:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263619328 00000100:00100000:2.0:1746065155.082847:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263619328 00000100:00100000:2.0:1746065155.082865:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263618944 00000100:00100000:2.0:1746065155.082867:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263618944 00000100:00100000:2.0:1746065155.083032:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263619200 00000100:00100000:2.0:1746065155.083036:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263619200 00000100:00100000:1.0:1746065155.083193:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13418 00000100:00100000:1.0:1746065155.083205:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263618816:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065155.083248:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.083298:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263618816:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 95us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.083305:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13418 00000100:00100000:3.0:1746065155.083329:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13419 00000100:00100000:3.0:1746065155.083336:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263619072:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065155.083375:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263619072:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 39us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.083379:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13419 00000100:00100000:1.0:1746065155.084290:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263619456 00000100:00100000:1.0:1746065155.084295:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263619456 00000100:00100000:1.0:1746065155.084310:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13420 00000100:00100000:1.0:1746065155.084314:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263619328:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065155.084349:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263619328:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 34us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.084355:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13420 00000100:00100000:1.0:1746065155.084365:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13421 00000100:00100000:1.0:1746065155.084370:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263618944:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065155.084379:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13422 00000100:00100000:2.0:1746065155.084386:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263619200:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065155.084400:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263618944:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 29us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.084408:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13421 00000100:00100000:1.0:1746065155.084417:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13423 00000100:00100000:1.0:1746065155.084421:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263619456:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065155.084425:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263619200:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 39us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.084431:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13422 00000100:00100000:1.0:1746065155.084448:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2007:x1830881263619456:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 26us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.084453:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13423 00000100:00100000:0.0:1746065155.089337:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.089393:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263619584 00000100:00100000:3.0:1746065155.089401:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263619584 00000100:00100000:3.0:1746065155.089444:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13424 00000100:00100000:3.0:1746065155.089450:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263619584:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:3.0:1746065155.089588:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065155.089591:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065155.089593:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065155.089594:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065155.089597:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065155.089648:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263619584:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 197us (319us total) trans 17179873495 rc 0/0 00000100:00100000:3.0:1746065155.089654:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13424 00000100:00100000:0.0:1746065155.091620:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.091665:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263619712 00000100:00100000:3.0:1746065155.091766:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263619712 00000100:00100000:3.0:1746065155.091835:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13425 00000100:00100000:3.0:1746065155.091845:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263619712:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:3.0:1746065155.091973:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065155.091976:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.091978:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065155.091979:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.091981:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:3.0:1746065155.092021:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263619712:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 179us (405us total) trans 21474840950 rc 0/0 00000100:00100000:3.0:1746065155.092028:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13425 00000100:00100000:0.0:1746065155.096758:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.096847:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263619968 00000100:00100000:1.0:1746065155.096854:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263619968 00000100:00100000:1.0:1746065155.096909:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3853 00000100:00100000:1.0:1746065155.096915:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263619968:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065155.096943:0:29488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.096955:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.096956:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.096960:0:29488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.096970:0:29488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.102412:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.102504:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263620224 00000100:00100000:2.0:1746065155.102511:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263620224 00000100:00100000:2.0:1746065155.102699:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3854 00000100:00100000:2.0:1746065155.102707:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263620224:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065155.102736:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.102747:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.102748:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.102752:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.102761:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.104926:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.104958:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.105052:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263620480 00000100:00100000:2.0:1746065155.105058:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263620480 00000100:00100000:2.0:1746065155.105093:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263620736 00000100:00100000:2.0:1746065155.105095:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263620736 00000100:00100000:2.0:1746065155.105363:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3855 00000100:00100000:1.0:1746065155.105368:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3856 00000100:00100000:2.0:1746065155.105370:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263620480:12345-192.168.202.27@tcp:3:lfs.0 00000100:00100000:1.0:1746065155.105374:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263620736:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065155.105396:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.105396:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.105407:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.105407:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.105408:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.105408:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.105411:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.105411:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.105421:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.105421:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.106102:0:29488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.106111:0:29488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.106117:0:29488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.106123:0:29488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065155.106127:0:29488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.106133:0:29488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.106147:0:29488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.106152:0:29488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc146fdc8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.106295:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.108880:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263619968:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 11957us (12120us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746065155.108900:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3853 00000100:00100000:1.0:1746065155.108927:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263620992 00000100:00100000:1.0:1746065155.108933:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263620992 00000100:00100000:1.0:1746065155.108974:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3857 00000100:00100000:1.0:1746065155.108980:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263620992:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065155.109004:0:29488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.109016:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.109018:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.109021:0:29488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.109032:0:29488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.113364:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.113410:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.113461:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263621248 00000100:00100000:1.0:1746065155.113469:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263621248 00000100:00100000:1.0:1746065155.113511:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263621504 00000100:00100000:1.0:1746065155.113513:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263621504 00000100:00100000:1.0:1746065155.113529:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3858 00000100:00100000:1.0:1746065155.113537:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263621248:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065155.113568:0:9553:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.113583:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.113585:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.113589:0:9553:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.113599:0:9553:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.114370:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3859 00000100:00100000:2.0:1746065155.114381:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2007:x1830881263621504:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065155.114402:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.114412:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.114413:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.114417:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.114425:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.117444:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.117460:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.117469:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.117475:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065155.117478:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.117485:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.117500:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.117506:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047e00/0xad6b7ddc146fdcf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.117595:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263620224:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 14883us (15184us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065155.117604:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3854 00000100:00100000:1.0:1746065155.117644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.119251:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263621760 00000100:00100000:2.0:1746065155.119260:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263621760 00000100:00100000:2.0:1746065155.119315:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3860 00000100:00100000:2.0:1746065155.119323:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263621760:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065155.119349:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.119361:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.119362:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.119367:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.119377:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.124712:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.124727:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.124734:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.124740:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065155.124743:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.124750:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.124765:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.124803:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc146fdd6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.124878:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2006:x1830881263620736:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 19500us (19915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.124886:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3856 00010000:00010000:2.0:1746065155.126883:0:9555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.126903:0:9555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.126916:0:9555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.126924:0:9555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065155.126928:0:9555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.126934:0:9555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.126951:0:9555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.126956:0:9555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046c00/0xad6b7ddc146fddd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.127041:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263620480:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 21667us (22117us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065155.127049:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3855 00010000:00010000:1.0:1746065155.131333:0:29488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.131348:0:29488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.131355:0:29488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.131360:0:29488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065155.131364:0:29488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.131371:0:29488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.131387:0:29488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.131392:0:29488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc146fde4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.133560:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263620992:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 24568us (27254us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.133572:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3857 00010000:00010000:0.0:1746065155.134916:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.134929:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.134936:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.134942:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065155.134946:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.134952:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.134969:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.134975:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc146fdf2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.135038:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263621504:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 20657us (21625us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065155.135045:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3859 00010000:00010000:1.0:1746065155.138099:0:9553:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.138114:0:9553:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.138121:0:9553:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.138127:0:9553:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065155.138130:0:9553:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.138136:0:9553:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.138151:0:9553:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.138156:0:9553:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc146fdeb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.138238:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263621248:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 24698us (24881us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.138251:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3858 00010000:00010000:3.0:1746065155.142019:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.142036:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.142044:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.142060:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065155.142063:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.142072:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.142089:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.142095:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc146fdf9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.142196:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263621760:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 22869us (24548us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065155.142206:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3860 00000100:00100000:0.0:1746065155.148300:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.148392:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263622016 00000100:00100000:2.0:1746065155.148399:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263622016 00000100:00100000:2.0:1746065155.148445:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13682 00000100:00100000:2.0:1746065155.148450:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32362:x1830881263622016:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065155.148487:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.148507:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45400/0xad6b7ddc146fd97 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d07 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.148530:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.148534:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065155.148571:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.148582:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.148637:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00010000:2.0:1746065155.148713:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099e13100 reply state ffff8800997f5000 transno 8589936017 ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.148718:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.148721:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.148723:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065155.148725:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065155.148798:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32362:x1830881263622016:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 346us (504us total) trans 8589936017 rc 0/0 00000100:00100000:2.0:1746065155.148803:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13682 00000100:00100000:1.0:1746065155.152250:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.152289:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.152316:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.152331:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.152344:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.152368:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.152386:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263622528 00000100:00100000:1.0:1746065155.152386:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263622272 00000100:00100000:3.0:1746065155.152392:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263622528 00000100:00100000:1.0:1746065155.152392:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263622272 00000100:00100000:1.0:1746065155.152980:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263622784 00000100:00100000:1.0:1746065155.152983:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263622784 00000100:00100000:3.0:1746065155.153383:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263622400 00000100:00100000:3.0:1746065155.153386:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263622400 00000100:00100000:3.0:1746065155.153402:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263622656 00000100:00100000:3.0:1746065155.153404:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263622656 00000100:00100000:2.0:1746065155.153409:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263622144 00000100:00100000:2.0:1746065155.153413:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263622144 00000100:00100000:3.0:1746065155.153419:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13426 00000100:00100000:3.0:1746065155.153425:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263622272:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:2.0:1746065155.153436:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13427 00000100:00100000:2.0:1746065155.153441:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263622528:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:1.0:1746065155.153471:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13428 00000100:00100000:1.0:1746065155.153476:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263622784:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:3.0:1746065155.153515:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13429 00000100:00100000:3.0:1746065155.153520:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263622400:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065155.153531:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065155.153531:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065155.153533:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065152 -> 1746065155 00002000:00010000:1.0:1746065155.153533:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:1.0:1746065155.153535:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065154 -> 1746065155 00002000:00010000:2.0:1746065155.153536:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065151 -> 1746065155 00002000:00010000:2.0:1746065155.153537:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065152 -> 1746065155 00002000:00010000:1.0:1746065155.153537:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:1.0:1746065155.153538:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00002000:00010000:2.0:1746065155.153539:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746065155.153554:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065155.153556:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.153558:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065154 -> 1746065155 00002000:00010000:3.0:1746065155.153560:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.153561:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065155.153576:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263622400:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 55us (1244us total) trans 17179873498 rc 0/0 00000100:00100000:2.0:1746065155.153576:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263622528:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 134us (1286us total) trans 21474840951 rc 0/0 00000100:00100000:1.0:1746065155.153576:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263622784:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 100us (1260us total) trans 17179873496 rc 0/0 00000100:00100000:2.0:1746065155.153581:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13427 00000100:00100000:3.0:1746065155.154236:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13429 00000100:00100000:1.0:1746065155.154241:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13428 00000100:00100000:3.0:1746065155.154249:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13430 00000100:00100000:3.0:1746065155.154255:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263622656:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:2.0:1746065155.154267:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13431 00002000:00010000:3.0:1746065155.154300:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:3.0:1746065155.154302:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065154 -> 1746065155 00002000:00010000:3.0:1746065155.154304:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065154 -> 1746065155 00002000:00010000:3.0:1746065155.154306:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065154 -> 1746065155 00002000:00010000:3.0:1746065155.154307:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:3.0:1746065155.154322:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263622656:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 68us (1978us total) trans 21474840952 rc 0/0 00000100:00100000:3.0:1746065155.154327:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13430 00002000:00010000:3.0:1746065155.154351:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065155.154353:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.154354:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065154 -> 1746065155 00002000:00010000:3.0:1746065155.154355:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.154357:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065155.154369:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263622272:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 945us (2130us total) trans 17179873497 rc 0/0 00000100:00100000:3.0:1746065155.154374:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13426 00000100:00100000:2.0:1746065155.154493:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263622144:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065155.154535:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065155.154537:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065152 -> 1746065155 00002000:00010000:2.0:1746065155.154539:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065152 -> 1746065155 00002000:00010000:2.0:1746065155.154540:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065152 -> 1746065155 00002000:00010000:2.0:1746065155.154542:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:2.0:1746065155.154567:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263622144:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 77us (2198us total) trans 21474840953 rc 0/0 00000100:00100000:2.0:1746065155.154571:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13431 00000100:00100000:0.0:1746065155.157676:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.157818:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263623040 00000100:00100000:2.0:1746065155.157824:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263623040 00000100:00100000:2.0:1746065155.157859:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4944 00000100:00100000:2.0:1746065155.157867:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32362:x1830881263623040:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065155.157925:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc146fd4a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cf9 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.157960:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065155.157975:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.157981:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065155.158016:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.158024:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 10 pid: 7231 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.158033:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16721:1830881263374976:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.158103:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.160248:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16721:1830881263374976:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.160267:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00000100:00100000:0.0:1746065155.160646:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.160868:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263623168 00000100:00100000:1.0:1746065155.160874:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263623168 00010000:00010000:1.0:1746065155.160911:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 11 pid: 7231 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.160933:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6088 00000100:00100000:1.0:1746065155.160939:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263623168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.160949:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.160954:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 11 pid: 7231 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.160963:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 11 pid: 7231 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.160979:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc146fd89 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d00 expref: 11 pid: 7231 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.161003:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065155.161007:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065155.161015:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065155.161020:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT0 00010000:00010000:1.0:1746065155.161046:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.161075:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263623168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 136us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.161081:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6088 00010000:00010000:3.0:1746065155.161539:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.161547:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00000040:00080000:3.0:1746065155.161806:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].586, 88 off59632 00000004:00080000:3.0:1746065155.161812:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180037534ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.161847:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].525, 88 off54256 00000004:00080000:3.0:1746065155.161850:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751180076840ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065155.161862:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].526, 88 off54344 00000004:00080000:3.0:1746065155.161865:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751180091234ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065155.161872:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].587, 88 off59720 00000004:00080000:3.0:1746065155.161874:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180100997ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.161881:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].588, 88 off59808 00000004:00080000:3.0:1746065155.161884:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180110162ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.161902:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].527, 88 off54432 00000004:00080000:3.0:1746065155.161906:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751180132282ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065155.161915:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].528, 88 off54520 00000004:00080000:3.0:1746065155.161917:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751180143844ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065155.161924:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].529, 88 off54608 00000004:00080000:3.0:1746065155.161927:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751180153664ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065155.161934:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].589, 88 off59896 00000004:00080000:3.0:1746065155.161936:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180163020ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.161942:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].530, 88 off54696 00000004:00080000:3.0:1746065155.161945:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751180171072ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065155.161951:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].590, 88 off59984 00000004:00080000:3.0:1746065155.161954:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180180232ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.161961:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].531, 88 off54784 00000004:00080000:3.0:1746065155.161965:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751180191683ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065155.161971:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].591, 88 off60072 00000004:00080000:3.0:1746065155.161974:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180200164ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.161980:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].592, 88 off60160 00000004:00080000:3.0:1746065155.161982:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180208690ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.161988:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].593, 88 off60248 00000004:00080000:3.0:1746065155.161990:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180216697ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.161997:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].594, 88 off60336 00000004:00080000:3.0:1746065155.161998:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751180225047ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065155.162006:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].532, 88 off54872 00000004:00080000:3.0:1746065155.162008:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751180234480ns, next at 615601404258ns, rc = 0 00000001:00080000:2.0:1746065155.164767:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936018 is committed 00000004:00080000:2.0:1746065155.164798:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 526 committed 00000004:00080000:2.0:1746065155.164805:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 586 committed 00000004:00080000:2.0:1746065155.164816:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 585 committed 00000004:00080000:2.0:1746065155.164817:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 584 committed 00000004:00080000:2.0:1746065155.164819:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 583 committed 00000004:00080000:2.0:1746065155.164820:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 525 committed 00000004:00080000:2.0:1746065155.164822:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 582 committed 00000004:00080000:2.0:1746065155.164825:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 524 committed 00000004:00080000:2.0:1746065155.164826:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 581 committed 00000004:00080000:2.0:1746065155.164827:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 523 committed 00000004:00080000:2.0:1746065155.164829:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 522 committed 00000004:00080000:2.0:1746065155.164831:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 521 committed 00000004:00080000:2.0:1746065155.164833:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 580 committed 00000004:00080000:2.0:1746065155.164834:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 579 committed 00000004:00080000:2.0:1746065155.164836:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 520 committed 00000004:00080000:2.0:1746065155.164837:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 519 committed 00000004:00080000:2.0:1746065155.164839:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 578 committed 00000100:00100000:0.0:1746065155.165002:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263375104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.165064:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.165089:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263375616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.165101:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.165116:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065155.165120:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263375488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.165130:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.165167:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263375232:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065155.165171:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.165184:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065155.165189:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263375360:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065155.165190:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.165194:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.165199:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.165204:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.165220:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.165222:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.165226:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.165230:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc146fe00 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065155.165241:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263376000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.165254:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.165261:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375104 00000100:00100000:3.0:1746065155.165268:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375104 00000100:00100000:0.0:1746065155.165275:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375616 00000100:00100000:0.0:1746065155.165280:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375616 00000100:00100000:3.0:1746065155.165303:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375488 00000100:00100000:3.0:1746065155.165305:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375488 00000100:00100000:2.0:1746065155.165324:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.165430:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263376128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.166151:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376000 00000100:00100000:0.0:1746065155.166155:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376000 00000100:00100000:0.0:1746065155.166174:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375360 00000100:00100000:0.0:1746065155.166176:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375360 00000100:00100000:0.0:1746065155.166190:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13432 00000100:00100000:0.0:1746065155.166198:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3762:x1830881263375104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065155.166345:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065155.166348:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.166350:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.166352:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.166353:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065155.166362:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13433 00000100:00100000:3.0:1746065155.166372:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13434 00000100:00100000:1.0:1746065155.166372:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3762:x1830881263375616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.166379:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3762:x1830881263375488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.166457:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13435 00000100:00100000:3.0:1746065155.166462:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263376000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.168284:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263375872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.169762:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.169792:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263376000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3306us (4513us total) trans 17179873502 rc 0/0 00000100:00100000:0.0:1746065155.169792:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263375104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3592us (4724us total) trans 17179873499 rc 0/0 00000100:00100000:3.0:1746065155.169802:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13435 00000100:00100000:0.0:1746065155.169808:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13432 00000100:00100000:2.0:1746065155.169828:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263376384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.169830:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375872 00000100:00100000:3.0:1746065155.169835:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13436 00000100:00100000:0.0:1746065155.169838:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375872 00000100:00100000:3.0:1746065155.169844:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3760:x1830881263375360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.169854:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.169863:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376384 00000100:00100000:0.0:1746065155.169865:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376384 00000100:00100000:2.0:1746065155.169866:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263376896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.169875:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13437 00000100:00100000:0.0:1746065155.169880:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3760:x1830881263375872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.169885:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.169907:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746065155.169913:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263376256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.169961:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065155.169966:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065155.169969:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00000100:00100000:2.0:1746065155.169970:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263376768:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065155.169971:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.169974:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.169975:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746065155.169984:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.170013:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.170026:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263375744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.170044:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.170053:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263375616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3683us (4949us total) trans 17179873501 rc 0/0 00000100:00100000:1.0:1746065155.170061:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13433 00000100:00100000:1.0:1746065155.170081:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376896 00000100:00100000:1.0:1746065155.170084:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376896 00000100:00100000:1.0:1746065155.170239:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376256 00000100:00100000:1.0:1746065155.170242:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376256 00000100:00100000:2.0:1746065155.170249:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263376512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.170251:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376768 00000100:00100000:1.0:1746065155.170253:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376768 00000100:00100000:3.0:1746065155.170259:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3760:x1830881263375360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 417us (4932us total) trans 17179873503 rc 0/0 00000100:00100000:1.0:1746065155.170259:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375232 00000100:00100000:1.0:1746065155.170261:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375232 00000100:00100000:3.0:1746065155.170265:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13436 00000100:00100000:1.0:1746065155.170271:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375744 00000100:00100000:2.0:1746065155.170272:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.170272:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375744 00000100:00100000:3.0:1746065155.170279:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376512 00000100:00100000:1.0:1746065155.170282:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13438 00000100:00100000:2.0:1746065155.170283:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263377024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.170284:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376512 00000100:00100000:1.0:1746065155.170287:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3760:x1830881263376384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065155.170297:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.170313:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377024 00000100:00100000:3.0:1746065155.170316:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377024 00000100:00100000:2.0:1746065155.170324:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13439 00000100:00100000:2.0:1746065155.170331:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3760:x1830881263376896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.170354:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3760:x1830881263375872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 474us (595us total) trans 17179873504 rc 0/0 00002000:00010000:2.0:1746065155.170393:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065155.170396:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065155.170398:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065155.170400:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065155.170402:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:2.0:1746065155.170422:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3760:x1830881263376896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (540us total) trans 21474840954 rc 0/0 00000100:00100000:3.0:1746065155.170648:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13440 00000100:00100000:3.0:1746065155.170655:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3760:x1830881263376256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065155.170709:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065155.170712:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.170714:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.170716:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.170717:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065155.170738:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3760:x1830881263376256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (777us total) trans 21474840955 rc 0/0 00000100:00100000:3.0:1746065155.170743:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13440 00000100:00100000:3.0:1746065155.170755:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13441 00000100:00100000:3.0:1746065155.170759:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3760:x1830881263376768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.170823:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3760:x1830881263376768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (837us total) trans 21474840956 rc 0/0 00000100:00100000:3.0:1746065155.170828:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13441 00000100:00100000:3.0:1746065155.170837:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13442 00000100:00100000:3.0:1746065155.170841:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881263375232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065155.170879:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065155.170881:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.170883:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.170884:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.170886:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065155.170920:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881263375232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (907us total) trans 17179873505 rc 0/0 00000100:00100000:3.0:1746065155.170925:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13442 00000100:00100000:3.0:1746065155.170934:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13443 00000100:00100000:3.0:1746065155.170938:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881263375744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.170985:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881263375744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (940us total) trans 17179873506 rc 0/0 00000100:00100000:3.0:1746065155.170989:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13443 00000100:00100000:3.0:1746065155.170998:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13444 00000100:00100000:3.0:1746065155.171001:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3761:x1830881263376512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065155.171035:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746065155.171037:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.171038:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065155.171040:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.171042:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746065155.171060:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3761:x1830881263376512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (789us total) trans 21474840957 rc 0/0 00000100:00100000:3.0:1746065155.171065:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13444 00000100:00100000:3.0:1746065155.171073:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13445 00000100:00100000:3.0:1746065155.171077:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3761:x1830881263377024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065155.171109:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:3.0:1746065155.171111:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.171113:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065155.171114:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.171116:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:3.0:1746065155.171131:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3761:x1830881263377024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (833us total) trans 21474840958 rc 0/0 00000100:00100000:3.0:1746065155.171136:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13445 00000004:00010000:3.0:1746065155.171174:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099e11880 reply state ffff88009aa0c000 transno 8589936018 ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.171188:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.171195:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.171197:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065155.171200:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065155.171205:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.171207:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065155.171211:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc146fd4a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933cf9 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746065155.171270:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065155.171277:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32362:x1830881263623040:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 13410us (13609us total) trans 8589936018 rc 0/0 00000100:00100000:3.0:1746065155.171284:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4944 00010000:00010000:3.0:1746065155.171301:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.171307:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.171312:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.171317:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.171320:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.171326:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.171333:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.171335:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065155.171337:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065155.171341:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe07 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 00002000:00010000:3.0:1746065155.171482:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065155.171484:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065155.171486:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065155.171487:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065155.171489:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065155.171509:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881263375488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5131us (6377us total) trans 17179873500 rc 0/0 00000100:00100000:3.0:1746065155.171514:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13434 00002000:00010000:1.0:1746065155.171805:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:1.0:1746065155.171810:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:1.0:1746065155.171812:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:1.0:1746065155.171814:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:1.0:1746065155.171816:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000004:00080000:3.0:1746065155.171825:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52b100/2, rc 0, transno 21474840957 00000100:00100000:3.0:1746065155.171833:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263376512:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065155.171839:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092746300/2, rc 0, transno 21474840958 00000100:00100000:3.0:1746065155.171841:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263377024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.171849:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3760:x1830881263376384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1560us (1992us total) trans 21474840959 rc 0/0 00000100:00100000:1.0:1746065155.171856:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13438 00000100:00100000:3.0:1746065155.171875:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065155.171881:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263377152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.171887:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.171915:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.171926:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263376640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.171935:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376128 00000100:00100000:3.0:1746065155.171937:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376128 00000100:00100000:1.0:1746065155.171946:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.171959:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377152 00000100:00100000:3.0:1746065155.171961:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377152 00000100:00100000:3.0:1746065155.171966:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376640 00000100:00100000:3.0:1746065155.171967:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376640 00000100:00100000:3.0:1746065155.171975:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13446 00000100:00100000:3.0:1746065155.171979:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881263376128:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065155.171982:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e10e00/2, rc 0, transno 17179873500 00000100:00100000:1.0:1746065155.171987:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263375488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065155.171997:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06a00/2, rc 0, transno 17179873502 00000100:00100000:1.0:1746065155.172001:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263376000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065155.172009:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e11c00/2, rc 0, transno 17179873499 00000100:00100000:1.0:1746065155.172012:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263375104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065155.172020:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d04a80/2, rc 0, transno 17179873501 00000100:00100000:1.0:1746065155.172022:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263375616:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065155.172028:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065155.172031:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.172032:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.172034:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.172036:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:1.0:1746065155.172048:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13447 00000100:00100000:1.0:1746065155.172056:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3762:x1830881263376640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.172062:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3762:x1830881263376128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (175us total) trans 21474840960 rc 0/0 00000100:00100000:3.0:1746065155.172068:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13446 00000100:00100000:3.0:1746065155.172090:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13448 00000100:00100000:3.0:1746065155.172094:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3761:x1830881263377152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065155.172121:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:1.0:1746065155.172124:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065155.172126:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065155.172128:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065155.172130:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:1.0:1746065155.172148:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3762:x1830881263376640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (200us total) trans 21474840961 rc 0/0 00000100:00100000:1.0:1746065155.172153:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13447 00000100:00100000:3.0:1746065155.172169:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3761:x1830881263377152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (252us total) trans 21474840962 rc 0/0 00000100:00100000:3.0:1746065155.172174:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13448 00000004:00080000:3.0:1746065155.172194:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a90700/2, rc 0, transno 21474840962 00000100:00100000:3.0:1746065155.172197:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263377152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065155.172270:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf5c00/2, rc 0, transno 21474840960 00000100:00100000:1.0:1746065155.172274:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263376128:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065155.172284:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834c700/2, rc 0, transno 21474840961 00000100:00100000:1.0:1746065155.172287:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263376640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.172364:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13437 00000100:00100000:2.0:1746065155.172374:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13439 00000004:00080000:2.0:1746065155.172412:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e12a00/2, rc 0, transno 17179873505 00000100:00100000:2.0:1746065155.172416:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263375232:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065155.172425:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d04000/2, rc 0, transno 17179873506 00000100:00100000:2.0:1746065155.172428:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263375744:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065155.172449:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf6a00/2, rc 0, transno 21474840955 00000100:00100000:2.0:1746065155.172456:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263376256:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065155.172465:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834d880/2, rc 0, transno 21474840956 00000100:00100000:2.0:1746065155.172468:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263376768:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065155.172474:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52aa00/2, rc 0, transno 21474840959 00000100:00100000:2.0:1746065155.172477:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263376384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065155.172484:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092745f80/2, rc 0, transno 21474840954 00000100:00100000:2.0:1746065155.172486:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263376896:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065155.172495:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e10700/2, rc 0, transno 17179873503 00000100:00100000:2.0:1746065155.172497:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263375360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065155.172504:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d05880/2, rc 0, transno 17179873504 00000100:00100000:2.0:1746065155.172506:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263375872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.175689:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.175799:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263623296 00000100:00100000:3.0:1746065155.175807:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263623296 00000100:00100000:3.0:1746065155.175847:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13683 00000100:00100000:3.0:1746065155.175854:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:32362:x1830881263623296:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065155.175870:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.175884:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d38 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.175935:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.175945:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.175957:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.175959:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065155.175962:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538800, rc 0) 00000100:00100000:3.0:1746065155.176008:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32362:x1830881263623296:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 155us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.176013:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13683 00000100:00100000:0.0:1746065155.179325:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.179413:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263623552 00000100:00100000:3.0:1746065155.179424:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263623552 00000100:00100000:3.0:1746065155.179485:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4945 00000100:00100000:3.0:1746065155.179493:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32362:x1830881263623552:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065155.179694:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32362:x1830881263623552:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 201us (378us total) trans 8589936019 rc 0/0 00000100:00100000:3.0:1746065155.179700:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4945 00000100:00100000:0.0:1746065155.208566:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.208615:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.208944:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263623808 00000100:00100000:3.0:1746065155.208953:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263623808 00000100:00100000:2.0:1746065155.209012:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263624064 00000100:00100000:2.0:1746065155.209017:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263624064 00000100:00100000:2.0:1746065155.209048:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13684 00000100:00100000:2.0:1746065155.209054:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+7:32372:x1830881263624064:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065155.209075:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.209090:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146fe15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d46 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.209153:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209164:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209176:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209187:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209192:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209197:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209281:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209289:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209295:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065155.209302:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:3.0:1746065155.209321:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13685 00000100:00100000:3.0:1746065155.209327:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+27:32373:x1830881263623808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.209336:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.209342:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146fe38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d3f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.209361:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209367:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.209368:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.209371:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209376:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.209377:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209382:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.209383:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065155.209385:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.209388:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.209391:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.209392:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209396:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.209399:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065155.209402:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.209428:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209433:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209437:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065155.209446:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065155.209469:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209474:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209478:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209482:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209485:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.209487:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209491:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209496:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065155.209498:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.209500:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209504:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc146fe3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209524:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209528:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209535:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209539:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.209541:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.209545:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.209547:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.209550:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880095561a00) 00010000:00010000:3.0:1746065155.209551:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.209553:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.209556:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.209557:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc146fe46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.209570:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209574:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209578:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209581:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.209583:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc146fe38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.209583:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209587:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.209592:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880095561a00) 00010000:00010000:3.0:1746065155.209593:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.209594:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065155.209596:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.209599:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.209599:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.209601:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065155.209603:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538400, rc 0) 00010000:00010000:2.0:1746065155.209622:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047400/0xad6b7ddc146fe15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d46 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.209630:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d46 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.209639:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.209641:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065155.209643:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047800, rc 0) 00000100:00100000:2.0:1746065155.209673:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ccc4a269-0136-4970-860c-c944630694a4+9:32372:x1830881263624064:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 619us (1058us total) trans 8589936020 rc 0/0 00000100:00100000:2.0:1746065155.209678:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13684 00000100:00100000:3.0:1746065155.210010:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32373:x1830881263623808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 681us (1450us total) trans 8589936021 rc 0/0 00000100:00100000:3.0:1746065155.210016:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13685 00000100:00100000:0.0:1746065155.214615:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.215004:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263624320 00000100:00100000:2.0:1746065155.215013:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263624320 00000100:00100000:2.0:1746065155.215056:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4946 00000100:00100000:2.0:1746065155.215064:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32373:x1830881263624320:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065155.215221:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32373:x1830881263624320:12345-192.168.202.27@tcp:35:cat.0 Request processed in 156us (612us total) trans 8589936022 rc 0/0 00000100:00100000:2.0:1746065155.215226:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4946 00000100:00100000:0.0:1746065155.217290:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.217446:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263624576 00000100:00100000:3.0:1746065155.217451:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263624576 00000100:00100000:3.0:1746065155.217491:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13686 00000100:00100000:3.0:1746065155.217496:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+9:32372:x1830881263624576:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065155.217518:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.217521:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065155.217543:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc146fe2a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d46 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.217558:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.217562:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065155.217573:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc146fe5b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d4d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.217613:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.217623:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.217630:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.217635:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.217669:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.217680:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 7 pid: 7203 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.217691:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263377280:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.217813:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.217820:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 29 pid: 7203 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.217827:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263377408:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.217854:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.223476:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.223496:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263377280:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.223507:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263377408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.223540:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065155.223608:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263624704 00000100:00100000:1.0:1746065155.223614:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263624704 00010000:00010000:1.0:1746065155.223642:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 8 pid: 7203 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.223677:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6089 00000100:00100000:1.0:1746065155.223684:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263624704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.223696:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.223700:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 8 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.223708:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 8 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.223725:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc146fe0e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d38 expref: 8 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.223739:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065155.223743:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065155.223754:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065155.223758:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.223815:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:2007:x1830881263624704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 131us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.223821:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6089 00000100:00100000:1.0:1746065155.224529:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.224549:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.224587:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263625088 00000100:00100000:3.0:1746065155.224590:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263625088 00000100:00100000:1.0:1746065155.224603:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.224608:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263624960 00000100:00100000:3.0:1746065155.224610:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263624960 00000100:00100000:1.0:1746065155.224617:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263625472 00000100:00100000:1.0:1746065155.224620:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263625472 00000100:00100000:3.0:1746065155.224623:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13687 00000100:00100000:3.0:1746065155.224628:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+31:32373:x1830881263625088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.224633:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 31 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.224644:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065155.224654:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6090 00000100:00100000:1.0:1746065155.224658:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881263625472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.224664:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146fe69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d5b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.224667:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.224670:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 31 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.224679:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 32 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.224690:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538400/0xad6b7ddc146fe4d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d3f expref: 32 pid: 7203 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.224698:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065155.224701:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.224705:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065155.224707:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065155.224713:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065155.224821:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.224988:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263625344 00000100:00100000:2.0:1746065155.224991:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263625344 00000100:00100000:2.0:1746065155.225008:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13688 00000100:00100000:2.0:1746065155.225012:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+10:32369:x1830881263624960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.225020:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.225026:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d54 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.225066:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225073:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225080:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225090:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225095:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225100:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065155.225350:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13689 00000100:00100000:0.0:1746065155.225357:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+32:32371:x1830881263625344:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065155.225363:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.225369:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9400/0xad6b7ddc146fe8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d62 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.225405:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065155.225543:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.225567:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881263625472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 908us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.225573:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6090 00010000:00010000:2.0:1746065155.225676:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225684:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225690:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065155.225697:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065155.225753:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225759:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225763:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225767:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065155.225770:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225794:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225802:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.225804:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746065155.225807:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225811:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc146fe9a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225826:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225830:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225833:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225837:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225841:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131046400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065155.225843:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225846:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225852:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065155.225853:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065155.225855:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225860:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc146fe7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225866:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225871:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225874:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225877:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065155.225879:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225884:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225888:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880095561500) 00010000:00010000:2.0:1746065155.225890:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065155.225902:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225906:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc146fe85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065155.225935:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d54 expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.225941:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc146fe77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d54 expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.225950:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046c00, rc 0) 00000100:00100000:2.0:1746065155.225972:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+11:32369:x1830881263624960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 959us (1422us total) trans 8589936023 rc 301/301 00000100:00100000:2.0:1746065155.225977:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13688 00010000:00010000:2.0:1746065155.226037:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065155.226043:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:02000000:2.0:1746065155.226069:0:7203:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:2.0:1746065155.226234:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].595, 88 off60424 00000004:00080000:2.0:1746065155.226240:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244466452ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226264:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].533, 88 off54960 00000004:00080000:2.0:1746065155.226268:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751244494404ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.226280:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].534, 88 off55048 00000004:00080000:2.0:1746065155.226282:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751244508524ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.226289:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].596, 88 off60512 00000004:00080000:2.0:1746065155.226292:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244518054ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226298:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].597, 88 off60600 00000004:00080000:2.0:1746065155.226300:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244526604ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226306:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].535, 88 off55136 00000004:00080000:2.0:1746065155.226309:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751244535141ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.226315:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].536, 88 off55224 00000004:00080000:2.0:1746065155.226318:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751244544219ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.226324:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].537, 88 off55312 00000004:00080000:2.0:1746065155.226326:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751244552907ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.226334:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].598, 88 off60688 00000004:00080000:2.0:1746065155.226336:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244562512ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226343:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].538, 88 off55400 00000004:00080000:2.0:1746065155.226346:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751244572108ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.226352:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].599, 88 off60776 00000004:00080000:2.0:1746065155.226354:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244580441ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226360:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].539, 88 off55488 00000004:00080000:2.0:1746065155.226363:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751244589351ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065155.226369:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].600, 88 off60864 00000004:00080000:2.0:1746065155.226371:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244597269ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226378:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].601, 88 off60952 00000004:00080000:2.0:1746065155.226380:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244606852ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226386:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].602, 88 off61040 00000004:00080000:2.0:1746065155.226389:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244615198ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226395:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].603, 88 off61128 00000004:00080000:2.0:1746065155.226397:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751244623627ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065155.226404:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].540, 88 off55576 00000004:00080000:2.0:1746065155.226406:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751244632597ns, next at 615601404258ns, rc = 0 00010000:00010000:3.0:1746065155.226797:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.226803:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065155.226813:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065155.226824:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065155.227108:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065155.227118:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.227127:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065155.227133:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065155.228717:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.228799:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263625600 00000100:00100000:2.0:1746065155.228806:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263625600 00000100:00100000:2.0:1746065155.229159:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13690 00000100:00100000:2.0:1746065155.229167:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+12:32369:x1830881263625600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.229182:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.229193:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc146fea8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d69 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.229251:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.229259:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065155.229263:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.229274:0:13395:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065155.229279:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000001:00080000:2.0:1746065155.234247:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936024 is committed 00000004:00080000:2.0:1746065155.234255:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 534 committed 00000004:00080000:2.0:1746065155.234270:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 595 committed 00000100:00100000:0.0:1746065155.235679:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263377664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.235739:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065155.236335:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 594 committed 00000004:00080000:2.0:1746065155.236339:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 593 committed 00000004:00080000:2.0:1746065155.236341:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 592 committed 00000004:00080000:2.0:1746065155.236342:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 533 committed 00000004:00080000:2.0:1746065155.236344:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 591 committed 00000004:00080000:2.0:1746065155.236345:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 532 committed 00000004:00080000:2.0:1746065155.236346:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 590 committed 00000004:00080000:2.0:1746065155.236348:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 531 committed 00000004:00080000:2.0:1746065155.236349:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 530 committed 00000004:00080000:2.0:1746065155.236350:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 529 committed 00000004:00080000:2.0:1746065155.236351:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 589 committed 00000004:00080000:2.0:1746065155.236356:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 588 committed 00000004:00080000:2.0:1746065155.236357:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 528 committed 00000004:00080000:2.0:1746065155.236358:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 527 committed 00000004:00080000:2.0:1746065155.236359:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 587 committed 00000001:00080000:2.0:1746065155.236371:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936022 is committed 00000001:00080000:2.0:1746065155.236377:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936019 is committed 00000100:00100000:2.0:1746065155.236392:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263377536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065155.236413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065155.236441:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377664 00000100:00100000:2.0:1746065155.236446:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377664 00000100:00100000:2.0:1746065155.236471:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377536 00000100:00100000:2.0:1746065155.236472:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377536 00000100:00100000:2.0:1746065155.236482:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13449 00000100:00100000:2.0:1746065155.236487:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3760:x1830881263377664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065155.236590:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065155.236592:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:2.0:1746065155.236594:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:2.0:1746065155.236596:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:2.0:1746065155.236597:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065155.236616:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3760:x1830881263377664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (878us total) trans 17179873507 rc 0/0 00000100:00100000:2.0:1746065155.236621:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13449 00000100:00100000:2.0:1746065155.236632:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13450 00000100:00100000:2.0:1746065155.236635:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881263377536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065155.236661:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065155.236663:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:2.0:1746065155.236665:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:2.0:1746065155.236667:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:2.0:1746065155.236668:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065155.236685:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881263377536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (271us total) trans 17179873508 rc 0/0 00000100:00100000:2.0:1746065155.236692:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13450 00000004:00080000:2.0:1746065155.236724:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577e300/2, rc 0, transno 17179873508 00000100:00100000:2.0:1746065155.236729:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263377536:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746065155.236790:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.236800:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.236803:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065155.236806:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x40 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.236815:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x53/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.236820:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x53/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.236825:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065155.236829:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.236834:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.236856:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc146fe5b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 11 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065155.236869:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.236902:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a24c00, rc 0) 00000100:00100000:2.0:1746065155.236934:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+10:32372:x1830881263624576:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 19438us (19649us total) trans 8589936024 rc 0/0 00000100:00100000:2.0:1746065155.236940:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13686 00010000:00010000:2.0:1746065155.236959:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x53/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.236965:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x53/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065155.236991:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065155.236994:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065155.237007:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x53/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.237016:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065155.237034:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc146fe69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d5b expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.237046:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d5b expref: 30 pid: 7231 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.237054:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d5b expref: 30 pid: 7231 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.237059:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131019c00, rc 0) 00000100:00100000:2.0:1746065155.237072:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:32373:x1830881263625088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12444us (12545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.237078:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13687 00000100:00100000:0.0:1746065155.238033:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263378176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.238067:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065155.238111:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577d180/2, rc 0, transno 17179873507 00000100:00100000:0.0:1746065155.238115:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263377664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.238120:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065155.238124:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263378048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.238138:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.238148:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263378560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.238159:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.238178:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378176 00000100:00100000:0.0:1746065155.238182:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378176 00000100:00100000:0.0:1746065155.238202:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378048 00000100:00100000:0.0:1746065155.238204:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378048 00000100:00100000:0.0:1746065155.238212:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378560 00000100:00100000:0.0:1746065155.238213:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378560 00000100:00100000:0.0:1746065155.238223:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13451 00000100:00100000:0.0:1746065155.238228:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881263378176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.238745:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263378176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 515us (676us total) trans 17179873509 rc 0/0 00000100:00100000:0.0:1746065155.238751:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13451 00000100:00100000:0.0:1746065155.238764:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13452 00000100:00100000:0.0:1746065155.238769:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881263378048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065155.238829:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065155.238832:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065155.238833:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065155.238835:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:0.0:1746065155.238837:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:0.0:1746065155.238853:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263378048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (714us total) trans 17179873510 rc 0/0 00000100:00100000:0.0:1746065155.238857:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13452 00000100:00100000:0.0:1746065155.238864:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13453 00000100:00100000:0.0:1746065155.238868:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881263378560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.238919:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881263378560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (758us total) trans 17179873511 rc 0/0 00000100:00100000:0.0:1746065155.238923:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13453 00000004:00080000:0.0:1746065155.238945:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577df80/2, rc 0, transno 17179873510 00000100:00100000:0.0:1746065155.238948:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263378048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065155.238953:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577fb80/2, rc 0, transno 17179873511 00000100:00100000:0.0:1746065155.238956:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263378560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065155.238960:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f800/2, rc 0, transno 17179873509 00000100:00100000:0.0:1746065155.238963:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263378176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.239000:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263377792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.239015:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.239034:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263378304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.239044:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.239054:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263378816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.239066:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.239075:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263379328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.239077:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263377920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.239085:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.239097:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377792 00000100:00100000:0.0:1746065155.239099:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377792 00000100:00100000:3.0:1746065155.239100:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.239111:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378304 00000100:00100000:0.0:1746065155.239113:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378304 00000100:00100000:3.0:1746065155.239116:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263378432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.239119:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378816 00000100:00100000:0.0:1746065155.239120:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378816 00000100:00100000:0.0:1746065155.239126:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379328 00000100:00100000:0.0:1746065155.239128:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379328 00000100:00100000:3.0:1746065155.239129:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.239133:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377920 00000100:00100000:0.0:1746065155.239134:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377920 00000100:00100000:3.0:1746065155.239136:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263378944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.239141:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378432 00000100:00100000:0.0:1746065155.239142:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378432 00000100:00100000:3.0:1746065155.239148:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.239150:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13454 00000100:00100000:0.0:1746065155.239153:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3761:x1830881263377792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.239155:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263379456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.239166:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.239184:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378944 00000100:00100000:3.0:1746065155.239187:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378944 00002000:00010000:0.0:1746065155.239193:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065155.239195:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.239197:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00000100:00100000:3.0:1746065155.239198:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379456 00002000:00010000:0.0:1746065155.239198:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00000100:00100000:3.0:1746065155.239200:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379456 00002000:00010000:0.0:1746065155.239200:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746065155.239208:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13455 00000100:00100000:3.0:1746065155.239212:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3761:x1830881263378304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.239218:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3761:x1830881263377792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (203us total) trans 17179873512 rc 0/0 00000100:00100000:0.0:1746065155.239223:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13454 00000100:00100000:0.0:1746065155.239231:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13456 00000100:00100000:0.0:1746065155.239234:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3761:x1830881263378816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.239272:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3761:x1830881263378304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (226us total) trans 17179873513 rc 0/0 00000100:00100000:3.0:1746065155.239280:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13455 00002000:00010000:0.0:1746065155.239282:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:0.0:1746065155.239284:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.239285:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.239287:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.239288:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:3.0:1746065155.239290:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13457 00000100:00100000:3.0:1746065155.239295:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3761:x1830881263379328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.239305:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3761:x1830881263378816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (237us total) trans 21474840963 rc 0/0 00000100:00100000:0.0:1746065155.239309:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13456 00000100:00100000:0.0:1746065155.239318:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13458 00000100:00100000:0.0:1746065155.239322:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263377920:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065155.239339:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800983b9500/2, rc 0, transno 21474840963 00002000:00010000:3.0:1746065155.239340:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065155.239343:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.239344:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746065155.239345:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263378816:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065155.239346:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.239348:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000004:00080000:0.0:1746065155.239351:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577d500/2, rc 0, transno 17179873512 00000100:00100000:0.0:1746065155.239353:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263377792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065155.239358:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f100/2, rc 0, transno 17179873513 00000100:00100000:0.0:1746065155.239360:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263378304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065155.239365:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3761:x1830881263379328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (279us total) trans 21474840964 rc 0/0 00000004:00080000:0.0:1746065155.239366:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800983baa00/2, rc 0, transno 21474840964 00000100:00100000:0.0:1746065155.239369:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263379328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.239370:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13457 00000100:00100000:3.0:1746065155.239379:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13459 00000100:00100000:0.0:1746065155.239383:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13460 00000100:00100000:3.0:1746065155.239384:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3762:x1830881263378432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065155.239389:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263378944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065155.239429:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065155.239431:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00000100:00100000:3.0:1746065155.239432:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3762:x1830881263378432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (301us total) trans 17179873514 rc 0/0 00002000:00010000:0.0:1746065155.239433:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065155.239434:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065155.239435:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746065155.239437:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13459 00000100:00100000:3.0:1746065155.239446:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13461 00000100:00100000:3.0:1746065155.239450:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3762:x1830881263379456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.239453:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3762:x1830881263378944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (304us total) trans 21474840965 rc 0/0 00000100:00100000:0.0:1746065155.239458:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13460 00002000:00010000:3.0:1746065155.239487:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:3.0:1746065155.239489:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.239491:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065155.239492:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065155.239494:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:3.0:1746065155.239510:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3762:x1830881263379456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (343us total) trans 21474840966 rc 0/0 00000100:00100000:3.0:1746065155.239515:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13461 00000004:00080000:3.0:1746065155.239533:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577e680/2, rc 0, transno 17179873514 00002000:00010000:0.0:1746065155.239535:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746065155.239536:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263378432:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065155.239537:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.239539:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.239541:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:0.0:1746065155.239542:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000004:00080000:3.0:1746065155.239543:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800983b8000/2, rc 0, transno 21474840965 00000100:00100000:3.0:1746065155.239545:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263378944:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065155.239550:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800983bad80/2, rc 0, transno 21474840966 00000100:00100000:3.0:1746065155.239552:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263379456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065155.239558:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a93480/2, rc 0, transno 21474840967 00000100:00100000:0.0:1746065155.239560:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3762:x1830881263377920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (459us total) trans 21474840967 rc 0/0 00000100:00100000:3.0:1746065155.239561:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263377920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.239565:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13458 00000100:00100000:0.0:1746065155.239580:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263378688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.239597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.239608:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263379200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065155.239613:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378688 00000100:00100000:3.0:1746065155.239615:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378688 00000100:00100000:0.0:1746065155.239620:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065155.239636:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379200 00000100:00100000:3.0:1746065155.239638:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379200 00000100:00100000:3.0:1746065155.239646:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13462 00000100:00100000:3.0:1746065155.239650:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3760:x1830881263378688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065155.239682:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065155.239684:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.239685:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.239687:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065155.239688:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065155.239705:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3760:x1830881263378688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (108us total) trans 21474840968 rc 0/0 00000100:00100000:3.0:1746065155.239710:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13462 00000100:00100000:1.0:1746065155.239801:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13463 00000100:00100000:1.0:1746065155.239809:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3760:x1830881263379200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065155.239864:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3760:x1830881263379200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (243us total) trans 21474840969 rc 0/0 00000100:00100000:1.0:1746065155.239869:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13463 00000004:00080000:0.0:1746065155.240474:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800983b9c00/2, rc 0, transno 21474840969 00000100:00100000:0.0:1746065155.240478:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263379200:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065155.240488:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a91500/2, rc 0, transno 21474840968 00000100:00100000:0.0:1746065155.240490:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263378688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.240495:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065155.240498:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263379072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.240514:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065155.242449:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379072 00000100:00100000:1.0:1746065155.242457:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379072 00000100:00100000:1.0:1746065155.242497:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13464 00000100:00100000:1.0:1746065155.242503:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3760:x1830881263379072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065155.242601:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:1.0:1746065155.242605:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065155.242606:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065155.242608:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065155.242610:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:1.0:1746065155.242642:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3760:x1830881263379072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 140us (2126us total) trans 21474840970 rc 0/0 00000100:00100000:1.0:1746065155.242648:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13464 00000004:00080000:0.0:1746065155.243127:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800983b8700/2, rc 0, transno 21474840970 00000100:00100000:0.0:1746065155.243133:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800983b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263379072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.243141:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263379584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.243165:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065155.243250:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.243622:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263625728 00000100:00100000:2.0:1746065155.243627:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263625728 00000100:00100000:2.0:1746065155.243654:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13691 00000100:00100000:2.0:1746065155.243659:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:32373:x1830881263625728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.243669:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.243683:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d70 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.243725:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379584 00000100:00100000:1.0:1746065155.243729:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379584 00010000:00010000:2.0:1746065155.243730:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.243740:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.243753:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13465 00010000:00010000:2.0:1746065155.243754:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.243757:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065155.243758:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3760:x1830881263379584:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065155.243760:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:2.0:1746065155.243804:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+31:32373:x1830881263625728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 144us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.243809:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13691 00000100:00100000:1.0:1746065155.243848:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3760:x1830881263379584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (682us total) trans 21474840971 rc 0/0 00000100:00100000:1.0:1746065155.243853:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13465 00000004:00080000:1.0:1746065155.243875:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a79880/2, rc 0, transno 21474840971 00000100:00100000:1.0:1746065155.243879:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263379584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065155.248207:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.248243:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263625856 00000100:00100000:0.0:1746065155.248249:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263625856 00010000:00010000:0.0:1746065155.248274:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d5b expref: 31 pid: 7231 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.248294:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6091 00000100:00100000:0.0:1746065155.248299:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263625856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065155.248308:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065155.248312:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d5b expref: 31 pid: 7231 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.248321:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d5b expref: 31 pid: 7231 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.248338:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc146fe70 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d5b expref: 31 pid: 7231 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.248356:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065155.248360:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.248369:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.248374:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.248379:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065155.248383:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065155.248387:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065155.248400:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065155.248441:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263625856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 140us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.248447:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6091 00010000:00010000:0.0:1746065155.248467:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.248473:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065155.248487:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065155.248585:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9400/0xad6b7ddc146fe8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d62 expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.248598:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d62 expref: 30 pid: 7205 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.248605:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d62 expref: 30 pid: 7205 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.248610:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:0.0:1746065155.248631:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+30:32371:x1830881263625344:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 23275us (23809us total) trans 8589936025 rc 0/0 00000100:00100000:0.0:1746065155.248636:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13689 00000100:00100000:1.0:1746065155.249675:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.249745:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263625984 00000100:00100000:0.0:1746065155.249749:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263625984 00000100:00100000:0.0:1746065155.249799:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13466 00000100:00100000:0.0:1746065155.249805:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+11:32372:x1830881263625984:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065155.249816:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.249827:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d77 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.249844:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.249851:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.249853:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.249856:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2125824->2310143] (req 2125824->2310143) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.249875:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.249888:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 13 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.249907:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263379712:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065155.252313:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.252335:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.252353:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.252364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.252374:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.252384:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.252393:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.252415:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.252436:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263626368 00000100:00100000:0.0:1746065155.252440:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263626368 00000100:00100000:0.0:1746065155.252463:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263626624 00000100:00100000:0.0:1746065155.252464:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263626624 00000100:00100000:0.0:1746065155.252471:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263626880 00000100:00100000:0.0:1746065155.252473:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263626880 00000100:00100000:0.0:1746065155.252479:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263626240 00000100:00100000:0.0:1746065155.252480:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263626240 00000100:00100000:0.0:1746065155.252487:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263626496 00000100:00100000:0.0:1746065155.252488:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263626496 00000100:00100000:0.0:1746065155.252492:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263626752 00000100:00100000:0.0:1746065155.252493:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263626752 00000100:00100000:0.0:1746065155.252500:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13467 00000100:00100000:0.0:1746065155.252506:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263626368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.252519:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.252532:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d85 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.252548:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252550:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252556:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252567:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252575:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6c00, rc 0) 00000100:00100000:0.0:1746065155.252605:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263626368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.252611:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13467 00000100:00100000:0.0:1746065155.252623:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13468 00000100:00100000:0.0:1746065155.252628:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263626624:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.252634:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.252642:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d93 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.252652:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252654:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252657:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252665:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252676:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6000, rc 0) 00000100:00100000:0.0:1746065155.252689:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263626624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.252693:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13468 00000100:00100000:0.0:1746065155.252702:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13469 00000100:00100000:0.0:1746065155.252706:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263626880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.252711:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.252717:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae7200/0xad6b7ddc146fed9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933da1 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.252724:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252731:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae7200/0xad6b7ddc146fed9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da1 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252738:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7200/0xad6b7ddc146fed9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da1 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252746:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7200, rc 0) 00000100:00100000:0.0:1746065155.252759:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263626880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (384us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065155.252763:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13469 00000100:00100000:0.0:1746065155.252791:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13470 00000100:00100000:0.0:1746065155.252797:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263626240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.252802:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.252809:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d7e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.252817:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252819:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252822:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252830:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252836:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7600, rc 0) 00000100:00100000:0.0:1746065155.252850:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263626240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.252855:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13470 00000100:00100000:0.0:1746065155.252864:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13471 00000100:00100000:0.0:1746065155.252869:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263626496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.252874:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.252879:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d8c expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.252887:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252888:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252904:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 32 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252912:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 32 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252922:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70a600, rc 0) 00000100:00100000:0.0:1746065155.252936:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263626496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.252941:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13471 00000100:00100000:0.0:1746065155.252951:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13472 00000100:00100000:0.0:1746065155.252955:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263626752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.252959:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.252964:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933d9a expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.252972:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252973:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.252977:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252984:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.252990:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70b400, rc 0) 00000100:00100000:0.0:1746065155.253002:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263626752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 47us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.253006:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13472 00000100:00100000:3.0:1746065155.253151:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263627008 00000100:00100000:3.0:1746065155.253155:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263627008 00010000:00010000:3.0:1746065155.253170:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 14 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.253190:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263626112 00000100:00100000:3.0:1746065155.253192:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263626112 00010000:00010000:3.0:1746065155.253203:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d62 expref: 30 pid: 7205 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.253217:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6092 00000100:00100000:3.0:1746065155.253221:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263627008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.253228:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.253244:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 14 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.253251:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 14 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.253262:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.253263:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.253267:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.253273:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.253293:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.253307:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263379840:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065155.253362:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6093 00000100:00100000:3.0:1746065155.253368:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263626112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.253375:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.253380:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d62 expref: 30 pid: 7205 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.253388:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d62 expref: 30 pid: 7205 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.253399:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fe93 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d62 expref: 30 pid: 7205 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.253411:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.253415:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.253422:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.253427:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.253439:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.253454:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263626112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.253459:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6093 00010000:00010000:3.0:1746065155.255396:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.255406:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065155.255447:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065155.255451:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065155.255465:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.255495:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc146fea8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.255509:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.255515:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.255517:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065155.255519:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2e00, rc 0) 00000100:00100000:3.0:1746065155.255558:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+9:32369:x1830881263625600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 26391us (26846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.255565:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13690 00000100:00100000:0.0:1746065155.256260:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065155.256284:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc146fdac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d31 expref: 14 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.257923:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263379712:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065155.257952:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.257962:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:0.0:1746065155.258008:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+12:32372:x1830881263625984:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8203us (8335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.258015:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13466 00000100:00100000:3.0:1746065155.258631:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.258650:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263379840:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065155.258660:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.258692:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263627008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5470us (6383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.258699:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6092 00000100:00100000:0.0:1746065155.261120:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.262824:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263627264 00000100:00100000:3.0:1746065155.262833:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263627264 00002000:00100000:3.0:1746065155.262874:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2125824->2129919) req@ffff880135220700 x1830881263627264/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.262882:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220700 with x1830881263627264 ext(2125824->2129919) 00002000:00010000:3.0:1746065155.262886:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220700 00000100:00100000:3.0:1746065155.263571:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3861 00000100:00100000:3.0:1746065155.263581:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263627264:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065155.264213:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+12:2006:x1830881263627264:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 632us (3096us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065155.264221:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3861 00002000:00100000:3.0:1746065155.264227:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2125824->2129919) req@ffff880135220700 x1830881263627264/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.264234:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220700 with x1830881263627264 ext(2125824->2129919) 00002000:00010000:3.0:1746065155.264237:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220700 00000100:00100000:0.0:1746065155.264620:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.264768:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.265019:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263627392 00000100:00100000:1.0:1746065155.265025:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263627392 00000100:00100000:1.0:1746065155.265052:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263627520 00000100:00100000:1.0:1746065155.265053:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263627520 00000100:00100000:1.0:1746065155.265067:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13473 00000100:00100000:1.0:1746065155.265072:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263627392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.265083:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.265097:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933da8 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.265113:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.265115:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.265121:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.265134:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 8 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.265142:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:1.0:1746065155.265169:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263627392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 97us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.265174:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13473 00000100:00100000:1.0:1746065155.265186:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13474 00000100:00100000:1.0:1746065155.265190:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263627520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.265196:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.265204:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933daf expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.265213:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.265215:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.265219:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.265226:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.265232:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9400, rc 0) 00000100:00100000:1.0:1746065155.265245:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263627520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.265249:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13474 00000100:00100000:2.0:1746065155.265538:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.265564:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.265573:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263627776 00000100:00100000:0.0:1746065155.265577:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263627776 00000100:00100000:2.0:1746065155.265582:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.265594:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263627648 00000100:00100000:0.0:1746065155.265596:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263627648 00000100:00100000:0.0:1746065155.265606:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263627904 00000100:00100000:0.0:1746065155.265607:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263627904 00000100:00100000:0.0:1746065155.265619:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13475 00000100:00100000:0.0:1746065155.265624:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263627776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.265632:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.265644:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933dbd expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.265656:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.265658:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.265662:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.265672:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.265679:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046c00, rc 0) 00000100:00100000:0.0:1746065155.265698:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263627776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.265703:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13475 00000100:00100000:0.0:1746065155.265713:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13476 00000100:00100000:0.0:1746065155.265718:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2004:x1830881263627648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.265723:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.265729:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933db6 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.265737:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.265738:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.265742:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.265749:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.265755:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046a00, rc 0) 00000100:00100000:0.0:1746065155.265767:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263627648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.265798:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13476 00000100:00100000:0.0:1746065155.265810:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13477 00000100:00100000:0.0:1746065155.265815:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263627904:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.265820:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.265826:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933dc4 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.265835:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.265837:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.265840:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.265848:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.265854:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047400, rc 0) 00000100:00100000:0.0:1746065155.265866:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263627904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.265871:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13477 00000100:00100000:0.0:1746065155.271022:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.271046:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.271240:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.271412:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263628160 00000100:00100000:3.0:1746065155.271420:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263628160 00002000:00100000:3.0:1746065155.271459:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2306048->2310143) req@ffff880135221500 x1830881263628160/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.271467:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221500 with x1830881263628160 ext(2306048->2310143) 00002000:00010000:3.0:1746065155.271472:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221500 00000100:00100000:3.0:1746065155.271488:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263628416 00000100:00100000:3.0:1746065155.271490:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263628416 00002000:00100000:3.0:1746065155.271501:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88013513bb80 x1830881263628416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.271506:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513bb80 with x1830881263628416 ext(0->1048575) 00002000:00010000:3.0:1746065155.271509:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513bb80 00000100:00100000:3.0:1746065155.271531:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263628672 00000100:00100000:3.0:1746065155.271534:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263628672 00002000:00100000:3.0:1746065155.271544:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880135138380 x1830881263628672/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.271549:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138380 with x1830881263628672 ext(1048576->2097151) 00002000:00010000:3.0:1746065155.271551:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138380 00000100:00100000:3.0:1746065155.271567:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3862 00000100:00100000:3.0:1746065155.271573:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263628160:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065155.271716:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263628160:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 140us (701us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065155.271723:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3862 00002000:00100000:3.0:1746065155.271729:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2306048->2310143) req@ffff880135221500 x1830881263628160/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.271735:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221500 with x1830881263628160 ext(2306048->2310143) 00002000:00010000:3.0:1746065155.271738:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221500 00000100:00100000:3.0:1746065155.271758:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3863 00000100:00100000:3.0:1746065155.271765:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263628416:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065155.273423:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3864 00000100:00100000:2.0:1746065155.273435:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263628672:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065155.274029:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.274311:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263628928 00000100:00100000:1.0:1746065155.274318:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263628928 00002000:00100000:1.0:1746065155.274345:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800907bfb80 x1830881263628928/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.274352:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bfb80 with x1830881263628928 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.274356:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bfb80 00000100:00100000:1.0:1746065155.274374:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3865 00000100:00100000:1.0:1746065155.274379:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263628928:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065155.277308:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.278820:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263629184 00000100:00100000:1.0:1746065155.278830:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263629184 00002000:00100000:1.0:1746065155.278869:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800907bdc00 x1830881263629184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.278879:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdc00 with x1830881263629184 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.278884:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bdc00 00000100:00100000:1.0:1746065155.278931:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3866 00000100:00100000:1.0:1746065155.278939:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263629184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065155.287846:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263628672:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14405us (16596us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065155.287858:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3864 00002000:00100000:2.0:1746065155.287867:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880135138380 x1830881263628672/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.287876:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138380 with x1830881263628672 ext(1048576->2097151) 00002000:00010000:2.0:1746065155.287882:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138380 00000100:00100000:0.0:1746065155.291549:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.291595:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.291669:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263629696 00000100:00100000:3.0:1746065155.291676:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263629696 00002000:00100000:3.0:1746065155.291710:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880135138000 x1830881263629696/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.291719:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138000 with x1830881263629696 ext(0->1048575) 00002000:00010000:3.0:1746065155.291724:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135138000 00000100:00100000:3.0:1746065155.291740:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3867 00000100:00100000:3.0:1746065155.291745:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263629696:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065155.292517:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263629440 00000100:00100000:2.0:1746065155.292521:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263629440 00000100:00100000:2.0:1746065155.292541:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4947 00000100:00100000:2.0:1746065155.292546:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32372:x1830881263629440:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065155.293151:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+10:32372:x1830881263629440:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 602us (1608us total) trans 8589936026 rc 0/0 00000100:00100000:2.0:1746065155.293157:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4947 00000100:00100000:0.0:1746065155.296437:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.296460:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263630080 00000100:00100000:0.0:1746065155.296469:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263630080 00002000:00100000:0.0:1746065155.296509:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880135139180 x1830881263630080/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065155.296524:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139180 with x1830881263630080 ext(1048576->2097151) 00002000:00010000:0.0:1746065155.296528:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135139180 00000100:00100000:0.0:1746065155.296546:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3868 00000100:00100000:0.0:1746065155.296553:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263630080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065155.296966:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263628928:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22586us (22937us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.296973:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3865 00002000:00100000:1.0:1746065155.296979:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff8800907bfb80 x1830881263628928/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.296985:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bfb80 with x1830881263628928 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.296989:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bfb80 00000100:00100000:1.0:1746065155.297025:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.297034:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263630208 00000100:00100000:1.0:1746065155.297036:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263630208 00002000:00100000:1.0:1746065155.297048:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009577ea00 x1830881263630208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.297054:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ea00 with x1830881263630208 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.297057:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577ea00 00000100:00100000:1.0:1746065155.297065:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3869 00000100:00100000:1.0:1746065155.297070:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263630208:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065155.297586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.297599:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263630464 00000100:00100000:1.0:1746065155.297601:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263630464 00002000:00100000:1.0:1746065155.297618:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009577c700 x1830881263630464/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.297624:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c700 with x1830881263630464 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.297627:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577c700 00000100:00100000:1.0:1746065155.297638:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3870 00000100:00100000:1.0:1746065155.297642:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+12:2004:x1830881263630464:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065155.311072:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263628416:12345-192.168.202.27@tcp:3:cat.0 Request processed in 39297us (40014us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065155.311084:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3863 00002000:00100000:3.0:1746065155.311096:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88013513bb80 x1830881263628416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.311105:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513bb80 with x1830881263628416 ext(0->1048575) 00002000:00010000:3.0:1746065155.311111:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513bb80 00000100:00100000:1.0:1746065155.318291:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263629184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 39343us (40983us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.318302:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3866 00002000:00100000:1.0:1746065155.318313:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff8800907bdc00 x1830881263629184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.318322:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdc00 with x1830881263629184 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.318326:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bdc00 00000100:00100000:3.0:1746065155.324020:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263629696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32265us (32416us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065155.324030:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3867 00002000:00100000:3.0:1746065155.324039:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880135138000 x1830881263629696/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.324048:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138000 with x1830881263629696 ext(0->1048575) 00002000:00010000:3.0:1746065155.324053:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135138000 00000100:00100000:1.0:1746065155.334755:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263630208:12345-192.168.202.27@tcp:3:cat.0 Request processed in 37676us (37720us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.334764:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3869 00002000:00100000:1.0:1746065155.334801:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009577ea00 x1830881263630208/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.334809:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ea00 with x1830881263630208 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.334814:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577ea00 00000100:00100000:0.0:1746065155.337084:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.340456:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263630720 00000100:00100000:1.0:1746065155.340467:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263630720 00002000:00100000:1.0:1746065155.340508:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880135139c00 x1830881263630720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.340517:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139c00 with x1830881263630720 ext(2097152->3145727) 00002000:00010000:1.0:1746065155.340522:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135139c00 00000100:00100000:1.0:1746065155.340551:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3871 00000100:00100000:1.0:1746065155.340558:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263630720:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065155.345594:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263630464:12345-192.168.202.27@tcp:3:cat.0 Request processed in 47940us (47999us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.345605:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3870 00002000:00100000:1.0:1746065155.345614:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009577c700 x1830881263630464/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.345623:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c700 with x1830881263630464 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.345627:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577c700 00000100:00100000:2.0:1746065155.351226:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263630080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 54660us (54783us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065155.351238:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3868 00002000:00100000:2.0:1746065155.351247:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880135139180 x1830881263630080/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.351257:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139180 with x1830881263630080 ext(1048576->2097151) 00002000:00010000:2.0:1746065155.351262:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135139180 00000100:00100000:2.0:1746065155.360989:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263630720:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20423us (23902us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065155.361000:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3871 00002000:00100000:2.0:1746065155.361011:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880135139c00 x1830881263630720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.361020:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139c00 with x1830881263630720 ext(2097152->3145727) 00002000:00010000:2.0:1746065155.361025:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135139c00 00000100:00100000:1.0:1746065155.366333:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.366537:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263630848 00000100:00100000:2.0:1746065155.366545:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263630848 00000100:00100000:2.0:1746065155.366675:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13478 00000100:00100000:2.0:1746065155.366683:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:32373:x1830881263630848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.366697:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.366711:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933dcb expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.366733:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 13 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.366739:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065155.366741:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065155.366743:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.366766:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 13 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.366793:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 13 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.366809:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263379968:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.366902:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.368472:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263379968:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.368491:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.368503:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718800, rc 0) 00000100:00100000:2.0:1746065155.368542:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:32373:x1830881263630848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1860us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.368549:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13478 00000100:00100000:0.0:1746065155.372301:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.372347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.372414:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263630976 00000100:00100000:0.0:1746065155.372415:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.372422:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263630976 00002000:00100000:3.0:1746065155.372461:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2125824->2310143) req@ffff88013513b800 x1830881263630976/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.372470:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881263630976 ext(2125824->2310143) 00010000:00010000:3.0:1746065155.372479:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 14 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.372496:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 14 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.372502:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013513b800 00000100:00100000:3.0:1746065155.372517:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263631232 00000100:00100000:3.0:1746065155.372520:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263631232 00002000:00100000:3.0:1746065155.372533:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88013513aa00 x1830881263631232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.372539:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513aa00 with x1830881263631232 ext(2097152->4194303) 00002000:00010000:3.0:1746065155.372541:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513aa00 00000100:00100000:3.0:1746065155.372550:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263631488 00000100:00100000:3.0:1746065155.372552:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263631488 00002000:00100000:3.0:1746065155.372560:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88013513a680 x1830881263631488/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 504/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.372566:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513a680 with x1830881263631488 ext(2097152->4194303) 00010000:00010000:3.0:1746065155.372569:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 15 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.372576:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 15 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.372581:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013513a680 00000100:00100000:3.0:1746065155.372591:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1334 00000100:00100000:3.0:1746065155.372597:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263630976:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065155.372711:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1335 00000100:00100000:3.0:1746065155.372716:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263631488:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065155.373033:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3872 00000100:00100000:1.0:1746065155.373044:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263631232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065155.383558:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263630976:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10948us (11254us total) trans 17179873515 rc 0/0 00000100:00100000:3.0:1746065155.383571:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1334 00002000:00100000:3.0:1746065155.383583:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2125824->2310143) req@ffff88013513b800 x1830881263630976/t17179873515(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/448 e 0 to 0 dl 1746065166 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.383592:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881263630976 ext(2125824->2310143) 00010000:00010000:3.0:1746065155.383603:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 18 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.383617:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 18 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.383623:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013513b800 00000100:00100000:3.0:1746065155.390176:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263631488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17448us (17751us total) trans 0 rc 1912832/1912832 00000100:00100000:3.0:1746065155.390187:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1335 00002000:00100000:3.0:1746065155.390196:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88013513a680 x1830881263631488/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 504/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:H/200/0 rc 1912832/1912832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.390205:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513a680 with x1830881263631488 ext(2097152->4194303) 00010000:00010000:3.0:1746065155.390214:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 16 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.390232:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 16 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.390238:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013513a680 00000100:00100000:1.0:1746065155.394886:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263631232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21837us (22531us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065155.394903:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3872 00002000:00100000:1.0:1746065155.394914:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88013513aa00 x1830881263631232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.394922:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513aa00 with x1830881263631232 ext(2097152->4194303) 00002000:00010000:1.0:1746065155.394926:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513aa00 00000100:00100000:0.0:1746065155.395465:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.395518:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263631616 00000100:00100000:3.0:1746065155.395524:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263631616 00010000:00010000:3.0:1746065155.395546:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 16 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.395572:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6094 00000100:00100000:3.0:1746065155.395579:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263631616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.395590:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.395603:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 16 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.395612:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 16 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.395629:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc146fec4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2310143) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d77 expref: 16 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.395767:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.395769:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.395790:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.395802:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.395829:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.395844:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263380096:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065155.395927:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.398427:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263380096:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065155.398445:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.398530:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263631616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2949us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.398540:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6094 00000100:00100000:0.0:1746065155.399624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.399760:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263631744 00000100:00100000:3.0:1746065155.399765:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263631744 00000100:00100000:3.0:1746065155.400255:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13479 00000100:00100000:3.0:1746065155.400262:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+15:32369:x1830881263631744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.400278:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.400292:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933dd2 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.400311:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.400313:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.400319:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 16 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.400336:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 16 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.400344:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112800, rc 0) 00000100:00100000:3.0:1746065155.400655:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+16:32369:x1830881263631744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 393us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.400660:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13479 00000100:00100000:0.0:1746065155.406434:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.406695:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.406825:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263632000 00000100:00100000:3.0:1746065155.406835:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263632000 00002000:00100000:3.0:1746065155.406879:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880135138a80 x1830881263632000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.406888:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138a80 with x1830881263632000 ext(2097152->4194303) 00002000:00010000:3.0:1746065155.406906:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138a80 00000100:00100000:3.0:1746065155.407233:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263632256 00000100:00100000:3.0:1746065155.407239:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263632256 00002000:00100000:3.0:1746065155.407258:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880135138e00 x1830881263632256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.407265:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138e00 with x1830881263632256 ext(3145728->4194303) 00002000:00010000:3.0:1746065155.407269:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135138e00 00000100:00100000:1.0:1746065155.407361:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3873 00000100:00100000:0.0:1746065155.407456:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263632000:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065155.408401:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3874 00000100:00100000:3.0:1746065155.408410:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263632256:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065155.414668:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.414724:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263632512 00000100:00100000:3.0:1746065155.414732:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263632512 00002000:00100000:3.0:1746065155.414763:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880135138700 x1830881263632512/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.414804:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138700 with x1830881263632512 ext(2097152->4194303) 00002000:00010000:3.0:1746065155.414809:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138700 00000100:00100000:3.0:1746065155.414840:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3875 00000100:00100000:3.0:1746065155.414848:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263632512:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065155.417541:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263632256:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9125us (10840us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065155.417550:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3874 00002000:00100000:3.0:1746065155.417559:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880135138e00 x1830881263632256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.417567:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138e00 with x1830881263632256 ext(3145728->4194303) 00002000:00010000:3.0:1746065155.417572:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135138e00 00000100:00100000:3.0:1746065155.426966:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263632000:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19584us (20529us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065155.426978:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3873 00002000:00100000:3.0:1746065155.426990:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880135138a80 x1830881263632000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.426999:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138a80 with x1830881263632000 ext(2097152->4194303) 00002000:00010000:3.0:1746065155.427004:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138a80 00000100:00100000:0.0:1746065155.429714:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.430223:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263632640 00000100:00100000:3.0:1746065155.430231:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263632640 00000100:00100000:3.0:1746065155.430443:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13480 00000100:00100000:3.0:1746065155.430450:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:32371:x1830881263632640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065155.430466:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.430480:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933dd9 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.430503:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.430511:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.430517:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 34 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.430521:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.430522:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.430525:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1630208->2097151] (req 1630208->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.430548:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 34 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.430556:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 34 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.430565:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380224:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.430922:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.430935:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 17 pid: 13375 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.430943:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380352:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.430969:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.430976:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 12 pid: 12260 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.430983:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380480:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.430999:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.435510:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263632512:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20653us (20839us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065155.435520:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3875 00002000:00100000:3.0:1746065155.435531:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880135138700 x1830881263632512/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.435539:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138700 with x1830881263632512 ext(2097152->4194303) 00002000:00010000:3.0:1746065155.435544:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138700 00000100:00100000:0.0:1746065155.440424:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.440458:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380480:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.440469:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380224:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.440477:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380352:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.440512:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1630208->2097151] (req 1630208->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.440527:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130113e00, rc 0) 00000100:00100000:3.0:1746065155.440565:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:32371:x1830881263632640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10116us (10860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.440574:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13480 00000100:00100000:2.0:1746065155.440648:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263632768 00000100:00100000:2.0:1746065155.440654:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263632768 00010000:00010000:2.0:1746065155.440675:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 13 pid: 12260 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.440924:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6095 00000100:00100000:2.0:1746065155.440932:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263632768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065155.440943:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.440958:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 13 pid: 12260 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.440967:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 13 pid: 12260 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.440988:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45c00/0xad6b7ddc146fda5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d15 expref: 13 pid: 12260 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.441010:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.441027:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263632768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.441032:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6095 00000100:00100000:0.0:1746065155.441215:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.441271:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263633024 00000100:00100000:1.0:1746065155.441274:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263633024 00010000:00010000:1.0:1746065155.441289:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 16 pid: 13375 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746065155.441308:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6096 00000100:00100000:1.0:1746065155.441313:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263633024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.441318:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.441325:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 16 pid: 13375 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.441332:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 16 pid: 13375 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.441342:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9400/0xad6b7ddc146fefc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933daf expref: 16 pid: 13375 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.441353:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.441367:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263633024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.441372:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6096 00000100:00100000:0.0:1746065155.442301:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.442691:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263633152 00000100:00100000:3.0:1746065155.442696:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263633152 00000100:00100000:3.0:1746065155.442731:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13481 00000100:00100000:3.0:1746065155.442737:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263633152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.442749:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.442759:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146ff2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933de0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.442801:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.442809:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146ff2d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933de0 expref: 35 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.442818:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc146ff2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933de0 expref: 35 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065155.443156:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.443172:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263632896 00000100:00100000:0.0:1746065155.443175:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263632896 00010000:00010000:0.0:1746065155.443189:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 36 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.443213:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6097 00000100:00100000:0.0:1746065155.443219:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881263632896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065155.443226:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065155.443237:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 36 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.443245:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 36 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.443258:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc146fecb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d85 expref: 36 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.443270:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.443272:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.443278:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.443742:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.443796:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.443807:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263380608:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065155.444166:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:3.0:1746065155.444204:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263633152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1465us (1903us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065155.444210:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13481 00000100:00100000:0.0:1746065155.445732:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.447735:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.447741:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263380608:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065155.447756:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065155.448121:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263633408 00000100:00100000:0.0:1746065155.448128:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263633408 00002000:00100000:0.0:1746065155.448263:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1630208->1634303) req@ffff880136a7b800 x1830881263633408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065155.448272:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b800 with x1830881263633408 ext(1630208->1634303) 00002000:00010000:0.0:1746065155.448277:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7b800 00000100:00100000:0.0:1746065155.448305:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3876 00000100:00100000:0.0:1746065155.448312:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263633408:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065155.448464:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263632896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5243us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.448473:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6097 00000100:00100000:0.0:1746065155.448755:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263633408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 443us (1026us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065155.448761:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3876 00002000:00100000:0.0:1746065155.448766:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1630208->1634303) req@ffff880136a7b800 x1830881263633408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065155.448792:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b800 with x1830881263633408 ext(1630208->1634303) 00002000:00010000:0.0:1746065155.448795:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7b800 00000100:00100000:3.0:1746065155.448808:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.448823:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263633664 00000100:00100000:0.0:1746065155.448826:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263633664 00002000:00100000:0.0:1746065155.448840:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880136a7a680 x1830881263633664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065155.448846:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7a680 with x1830881263633664 ext(4194304->5021695) 00002000:00010000:0.0:1746065155.448849:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a7a680 00000100:00100000:0.0:1746065155.448859:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3877 00000100:00100000:0.0:1746065155.448864:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263633664:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065155.450591:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.451367:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263633792 00000100:00100000:2.0:1746065155.451374:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263633792 00000100:00100000:2.0:1746065155.451406:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13482 00000100:00100000:2.0:1746065155.451412:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263633792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.451425:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.451439:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146ff34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933de7 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.451475:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380736:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065155.451520:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.463913:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380736:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065155.463943:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146ff34 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933de7 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.463958:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718400/0xad6b7ddc146ff34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933de7 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.463973:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718400, rc 0) 00000100:00100000:2.0:1746065155.464711:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263633664:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15843us (15900us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065155.464728:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3877 00000100:00100000:3.0:1746065155.464736:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263633792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 13322us (14147us total) trans 0 rc 301/301 00002000:00100000:2.0:1746065155.464739:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880136a7a680 x1830881263633664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065155.464743:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13482 00002000:00100000:2.0:1746065155.464747:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7a680 with x1830881263633664 ext(4194304->5021695) 00002000:00010000:2.0:1746065155.464752:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a7a680 00000100:00100000:3.0:1746065155.464835:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.464848:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263633920 00000100:00100000:3.0:1746065155.464852:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263633920 00000100:00100000:3.0:1746065155.465478:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13483 00000100:00100000:3.0:1746065155.465484:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:32371:x1830881263633920:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065155.465496:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.465508:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933dee expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.465528:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.465535:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.465546:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 34 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.465551:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.465552:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.465555:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1048576->1449983] (req 1048576->1449983) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.465575:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 34 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.465584:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 34 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.465593:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380864:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.465655:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.465661:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 14 pid: 9549 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.466410:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380992:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.467119:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.467322:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 11 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.467333:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263381120:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.467359:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.475081:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.475116:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.475136:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263634048 00000100:00100000:1.0:1746065155.475142:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263634048 00000100:00100000:1.0:1746065155.475184:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13484 00000100:00100000:1.0:1746065155.475190:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263634048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.475205:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.475218:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ff42 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933df5 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.475244:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.475253:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ff42 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933df5 expref: 36 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.475266:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc800/0xad6b7ddc146ff42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933df5 expref: 36 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.475278:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc800, rc 0) 00000100:00100000:1.0:1746065155.475312:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263634048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 122us (241us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.475318:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13484 00000100:00100000:3.0:1746065155.475362:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380864:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.475379:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263380992:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.476027:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.476187:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263381120:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.476209:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263634176 00010000:00010000:3.0:1746065155.476210:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1048576->1449983] (req 1048576->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.476214:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263634176 00010000:00010000:3.0:1746065155.476220:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00010000:00010000:2.0:1746065155.476234:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 35 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.476241:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:32371:x1830881263633920:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10757us (11406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.476247:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13483 00000100:00100000:2.0:1746065155.476253:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263634304 00000100:00100000:2.0:1746065155.476255:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263634304 00010000:00010000:2.0:1746065155.476264:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 15 pid: 9549 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.476273:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.476573:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263634560 00000100:00100000:2.0:1746065155.476577:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263634560 00000100:00100000:1.0:1746065155.476583:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6098 00010000:00010000:2.0:1746065155.476589:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 12 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746065155.476590:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263634176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.476599:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065155.476607:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6099 00000100:00100000:2.0:1746065155.476613:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263634304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.476614:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 34 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.476620:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.476623:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 34 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.476649:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6100 00000100:00100000:0.0:1746065155.476656:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263634560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065155.476663:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065155.476720:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.476742:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263634688 00000100:00100000:3.0:1746065155.476745:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263634688 00002000:00100000:3.0:1746065155.476768:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880135223100 x1830881263634688/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.476795:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223100 with x1830881263634688 ext(4194304->5021695) 00002000:00010000:3.0:1746065155.476799:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135223100 00000100:00100000:3.0:1746065155.476815:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3878 00000100:00100000:3.0:1746065155.476819:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263634688:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065155.477024:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 15 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.477038:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 15 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.477052:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc146ff0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933db6 expref: 15 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.477070:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.477089:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263634304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 476us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.477094:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6099 00010000:00010000:1.0:1746065155.477280:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f70a600/0xad6b7ddc146fee7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d8c expref: 34 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.477290:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.477311:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263634176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 722us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.477316:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6098 00010000:00010000:0.0:1746065155.477427:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 12 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.477435:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 12 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.477446:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc146fdc1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d1c expref: 12 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746065155.477468:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.477469:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.477475:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.477481:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.477505:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.477559:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263381248:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065155.477608:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.480368:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.480435:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263634816 00000100:00100000:3.0:1746065155.480443:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263634816 00000100:00100000:3.0:1746065155.481935:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13485 00000100:00100000:3.0:1746065155.481946:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263634816:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.481961:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.481976:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146ff49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933dfc expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.482023:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263381376:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065155.482109:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.485351:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263381248:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065155.485370:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.485408:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263634560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8752us (9132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.485418:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6100 00000100:00100000:3.0:1746065155.486543:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263634688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9720us (9820us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065155.486552:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3878 00002000:00100000:3.0:1746065155.486561:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880135223100 x1830881263634688/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.486570:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223100 with x1830881263634688 ext(4194304->5021695) 00002000:00010000:3.0:1746065155.486574:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135223100 00000100:00100000:3.0:1746065155.486615:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263381376:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065155.486635:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146ff49 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dfc expref: 34 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.486645:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30400/0xad6b7ddc146ff49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dfc expref: 34 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.486658:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30400, rc 0) 00000100:00100000:3.0:1746065155.487125:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263634816:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5180us (6763us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065155.487131:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13485 00000100:00100000:0.0:1746065155.490411:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.490461:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263635072 00000100:00100000:3.0:1746065155.490470:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263635072 00002000:00100000:3.0:1746065155.490505:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1445888->1449983) req@ffff88012edac380 x1830881263635072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.490514:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881263635072 ext(1445888->1449983) 00002000:00010000:3.0:1746065155.490519:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac380 00000100:00100000:3.0:1746065155.490545:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3879 00000100:00100000:3.0:1746065155.490552:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263635072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065155.490666:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263635072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 113us (261us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065155.490671:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3879 00002000:00100000:3.0:1746065155.490676:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1445888->1449983) req@ffff88012edac380 x1830881263635072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.490682:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881263635072 ext(1445888->1449983) 00002000:00010000:3.0:1746065155.490685:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac380 00000100:00100000:0.0:1746065155.497492:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.497553:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263635328 00000100:00100000:3.0:1746065155.497561:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263635328 00000100:00100000:0.0:1746065155.497561:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.497604:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263635200 00000100:00100000:3.0:1746065155.497606:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263635200 00000100:00100000:3.0:1746065155.497620:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13486 00000100:00100000:3.0:1746065155.497628:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263635328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.497643:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065155.497645:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13487 00000100:00100000:0.0:1746065155.497651:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263635200:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.497656:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.497658:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146ff50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e0a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.497662:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc146ff57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e03 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.497696:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263381632:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065155.497697:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263381504:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065155.497840:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.497935:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.502315:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.503205:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263635584 00000100:00100000:2.0:1746065155.503213:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263635584 00000100:00100000:2.0:1746065155.503263:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4948 00000100:00100000:2.0:1746065155.503271:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32371:x1830881263635584:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065155.503438:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32371:x1830881263635584:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 168us (1131us total) trans 8589936027 rc 0/0 00000100:00100000:2.0:1746065155.503444:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4948 00000100:00100000:2.0:1746065155.503503:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263381504:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065155.503590:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263381632:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065155.503615:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc146ff57 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e03 expref: 17 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.503631:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc146ff57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e03 expref: 17 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.504618:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07e00, rc 0) 00000100:00100000:0.0:1746065155.504657:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263635200:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7006us (7094us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065155.504664:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13487 00010000:00010000:2.0:1746065155.504807:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146ff50 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e0a expref: 15 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.504818:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc146ff50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e0a expref: 15 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.504829:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00000100:00100000:2.0:1746065155.504861:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263635328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7233us (7374us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.504866:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13486 00000100:00100000:0.0:1746065155.511184:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.511451:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.511499:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263635712 00000100:00100000:1.0:1746065155.511507:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263635712 00000100:00100000:2.0:1746065155.511511:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263635840 00000100:00100000:2.0:1746065155.511515:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263635840 00000100:00100000:1.0:1746065155.511555:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13488 00000100:00100000:2.0:1746065155.511560:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13489 00000100:00100000:1.0:1746065155.511562:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263635712:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065155.511565:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263635840:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.511583:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.511584:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.511597:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146ff65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e18 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.511597:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc146ff5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e11 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.511640:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263381760:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.511640:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263381888:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065155.511709:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.511887:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.514545:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263381760:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.514545:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263381888:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065155.514570:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146ff65 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e18 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.514570:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc146ff5e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e11 expref: 17 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.514582:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc146ff65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e18 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.514582:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc146ff5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e11 expref: 17 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.514595:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719800, rc 0) 00010000:00010000:1.0:1746065155.514608:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60e00, rc 0) 00000100:00100000:1.0:1746065155.514639:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263635712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3077us (3462us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.514646:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13488 00000100:00100000:2.0:1746065155.514681:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263635840:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3115us (3229us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.514690:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13489 00000100:00100000:0.0:1746065155.517974:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.518042:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263636096 00000100:00100000:2.0:1746065155.518050:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263636096 00000100:00100000:2.0:1746065155.518401:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4949 00000100:00100000:2.0:1746065155.518410:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+10:32369:x1830881263636096:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065155.519159:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+11:32369:x1830881263636096:12345-192.168.202.27@tcp:35:cat.0 Request processed in 748us (1191us total) trans 8589936028 rc 0/0 00000100:00100000:2.0:1746065155.519166:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4949 00000100:00100000:0.0:1746065155.523058:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.523128:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263636352 00000100:00100000:3.0:1746065155.523136:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263636352 00000100:00100000:3.0:1746065155.523177:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13692 00000100:00100000:3.0:1746065155.523184:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+11:32379:x1830881263636352:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065155.523203:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.523218:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ff6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e1f expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.523277:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523288:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523574:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523588:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523594:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523598:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523668:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523675:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523680:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065155.523687:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065155.523734:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523739:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523744:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523748:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.523750:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523755:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.523762:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065155.523765:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.523767:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524849:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ff73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524874:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524879:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524884:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524898:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.524901:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524906:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524914:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097e34900) 00010000:00010000:3.0:1746065155.524916:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.524918:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524922:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ff7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.524956:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ff6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.524966:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 13 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.524971:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.524973:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065155.524975:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:3.0:1746065155.525021:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+13:32379:x1830881263636352:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1836us (1968us total) trans 8589936029 rc 0/0 00000100:00100000:3.0:1746065155.525027:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13692 00000100:00100000:0.0:1746065155.540732:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.540832:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263636480 00000100:00100000:2.0:1746065155.540840:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263636480 00000100:00100000:2.0:1746065155.540883:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13490 00000100:00100000:2.0:1746065155.540900:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+14:32379:x1830881263636480:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065155.540916:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.540931:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e26 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.540960:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.540967:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.540973:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.540975:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.540977:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3391488->3751935] (req 3391488->3751935) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.541006:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.541016:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 15 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.541026:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263382016:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.541132:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.541140:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 32 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.541147:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263382144:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.541333:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.542733:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263382016:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.542748:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263382144:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.542770:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3391488->3751935] (req 3391488->3751935) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.542810:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166e00, rc 0) 00000100:00100000:2.0:1746065155.542839:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+15:32379:x1830881263636480:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1948us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.542849:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13490 00000100:00100000:0.0:1746065155.545261:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.545340:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.545427:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263636608 00000100:00100000:1.0:1746065155.545434:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263636608 00000100:00100000:2.0:1746065155.545451:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263636736 00000100:00100000:2.0:1746065155.545456:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263636736 00010000:00010000:1.0:1746065155.545464:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 33 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.545474:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 15 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.545504:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6101 00000100:00100000:2.0:1746065155.545510:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6102 00000100:00100000:1.0:1746065155.545511:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263636608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065155.545516:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263636736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065155.545522:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.545523:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.545538:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 33 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.545539:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 15 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.545551:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 15 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.545568:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130112800/0xad6b7ddc146ff1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd2 expref: 15 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.545574:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 33 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.545587:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc146ff18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dcb expref: 33 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.545607:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.545609:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.545615:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 14 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.545623:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 14 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.545641:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065155.545654:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 14 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.545809:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263382272:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065155.545812:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263636736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 295us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.545819:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6102 00000100:00100000:1.0:1746065155.545856:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.547066:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263382272:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065155.547083:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.547104:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263636608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1594us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.547110:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6101 00000100:00100000:2.0:1746065155.548013:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.548149:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263636992 00000100:00100000:0.0:1746065155.548154:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263636992 00002000:00100000:0.0:1746065155.548182:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3391488->3395583) req@ffff8800907bd500 x1830881263636992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065155.548191:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd500 with x1830881263636992 ext(3391488->3395583) 00002000:00010000:0.0:1746065155.548195:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bd500 00000100:00100000:0.0:1746065155.548216:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3880 00000100:00100000:0.0:1746065155.548222:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263636992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065155.548327:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263636992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 104us (316us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065155.548333:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3880 00002000:00100000:0.0:1746065155.548337:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3391488->3395583) req@ffff8800907bd500 x1830881263636992/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065155.548344:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd500 with x1830881263636992 ext(3391488->3395583) 00002000:00010000:0.0:1746065155.548347:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bd500 00000100:00100000:0.0:1746065155.552021:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.552176:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263637248 00000100:00100000:2.0:1746065155.552184:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263637248 00002000:00100000:2.0:1746065155.552222:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3747840->3751935) req@ffff880097a6fb80 x1830881263637248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.552231:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6fb80 with x1830881263637248 ext(3747840->3751935) 00002000:00010000:2.0:1746065155.552235:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6fb80 00000100:00100000:2.0:1746065155.552533:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3881 00000100:00100000:2.0:1746065155.552541:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263637248:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065155.552667:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263637248:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 126us (653us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065155.552673:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3881 00002000:00100000:2.0:1746065155.552678:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3747840->3751935) req@ffff880097a6fb80 x1830881263637248/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.552685:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6fb80 with x1830881263637248 ext(3747840->3751935) 00002000:00010000:2.0:1746065155.552688:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6fb80 00000100:00100000:0.0:1746065155.555365:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.555496:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263637504 00000100:00100000:2.0:1746065155.555502:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263637504 00000100:00100000:2.0:1746065155.555538:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4950 00000100:00100000:2.0:1746065155.555542:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+13:32379:x1830881263637504:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065155.555949:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+14:32379:x1830881263637504:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 405us (588us total) trans 8589936030 rc 0/0 00000100:00100000:2.0:1746065155.555954:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4950 00000100:00100000:0.0:1746065155.675399:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.675541:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263637760 00000100:00100000:3.0:1746065155.675584:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263637760 00000100:00100000:3.0:1746065155.675623:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13693 00000100:00100000:3.0:1746065155.675631:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+14:32384:x1830881263637760:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065155.675650:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.675666:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146ff96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e2d expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.675759:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.675792:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.675800:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.675805:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.675831:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.675840:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 15 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.675854:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263382400:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.675959:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.676138:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 15 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.676149:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263382528:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.676170:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.677701:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.677745:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.677935:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263637888 00000100:00100000:1.0:1746065155.677941:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263637888 00000100:00100000:3.0:1746065155.677957:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263382400:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065155.677963:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 16 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.677965:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263382528:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.677980:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065155.677982:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263638016 00000100:00100000:1.0:1746065155.677984:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263638016 00010000:00010000:1.0:1746065155.677990:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.678004:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6103 00000100:00100000:3.0:1746065155.678008:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6104 00000100:00100000:1.0:1746065155.678009:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263637888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065155.678012:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263638016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.678018:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.678018:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.678023:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.678023:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.678030:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.678212:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.678232:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc146feaf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d69 expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.678236:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc146ff81 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e1f expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.678259:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.678263:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.678270:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.678275:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.678289:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.678314:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263638016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 300us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.678320:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6104 00010000:00010000:3.0:1746065155.678338:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.678343:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065155.678354:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065155.678414:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065155.678417:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.678435:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263637888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 426us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.678439:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6103 00010000:00010000:3.0:1746065155.678443:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146ff96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 16 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.678453:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.678458:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.678460:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065155.678463:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30800, rc 0) 00000100:00100000:3.0:1746065155.678642:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+14:32384:x1830881263637760:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3012us (3251us total) trans 8589936031 rc 0/0 00000100:00100000:3.0:1746065155.678648:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13693 00000100:00100000:0.0:1746065155.682481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.682598:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263638144 00000100:00100000:2.0:1746065155.682606:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263638144 00000100:00100000:2.0:1746065155.682653:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13491 00000100:00100000:2.0:1746065155.682661:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+10:32384:x1830881263638144:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065155.682675:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.682688:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e34 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.682711:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.682717:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.682723:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 26 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.682728:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.682729:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.682732:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 11 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.682755:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 26 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.682764:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 26 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.682814:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263382656:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.682921:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.682928:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.682935:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263382784:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.682956:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.682962:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 16 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.682969:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263382912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.682980:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.685916:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.685962:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263382656:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.685972:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263382784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.685978:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263382912:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.686001:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [2080768->2097151] (req 2080768->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 11 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.686015:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167800, rc 0) 00000100:00100000:2.0:1746065155.686052:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+11:32384:x1830881263638144:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3391us (3577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.686059:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13491 00000100:00100000:1.0:1746065155.686144:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263638400 00000100:00100000:1.0:1746065155.686150:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263638400 00010000:00010000:1.0:1746065155.686171:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 17 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.686179:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.686908:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263638272 00000100:00100000:1.0:1746065155.686912:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263638272 00010000:00010000:1.0:1746065155.686925:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 27 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746065155.686933:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.687020:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263638528 00000100:00100000:3.0:1746065155.687023:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263638528 00010000:00010000:3.0:1746065155.687036:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746065155.687054:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6105 00000100:00100000:2.0:1746065155.687061:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6106 00000100:00100000:1.0:1746065155.687063:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263638400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065155.687066:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263638272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065155.687073:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.687073:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.687087:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 27 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746065155.687087:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 17 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.687096:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 27 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.687115:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6107 00000100:00100000:3.0:1746065155.687120:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263638528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.687127:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.687154:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 17 pid: 11461 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.687178:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc146fed2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d93 expref: 27 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.687179:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.687186:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.687192:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065155.687198:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc146ff03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dbd expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.687208:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065155.687237:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc146fd9e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d23 expref: 17 pid: 11461 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.687247:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263638272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 180us (1067us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065155.687249:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.687251:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065155.687252:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6106 00010000:00010000:1.0:1746065155.687255:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.687261:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.687283:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.687307:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263638528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 186us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.687312:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6107 00000100:00100000:1.0:1746065155.687359:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263383040:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065155.687397:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.688826:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263383040:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065155.688841:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065155.688871:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263638400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1807us (2964us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.688877:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6105 00000100:00100000:0.0:1746065155.689136:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.689192:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263638784 00000100:00100000:3.0:1746065155.689197:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263638784 00002000:00100000:3.0:1746065155.689224:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (2080768->2084863) req@ffff880098dd8000 x1830881263638784/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.689232:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8000 with x1830881263638784 ext(2080768->2084863) 00002000:00010000:3.0:1746065155.689236:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8000 00000100:00100000:3.0:1746065155.689433:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3882 00000100:00100000:3.0:1746065155.689440:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263638784:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065155.689547:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263638784:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 107us (412us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065155.689553:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3882 00002000:00100000:3.0:1746065155.689557:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (2080768->2084863) req@ffff880098dd8000 x1830881263638784/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.689564:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8000 with x1830881263638784 ext(2080768->2084863) 00002000:00010000:3.0:1746065155.689567:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8000 00000100:00100000:0.0:1746065155.691675:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.691729:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263638912 00000100:00100000:2.0:1746065155.691735:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263638912 00000100:00100000:2.0:1746065155.691805:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13492 00000100:00100000:2.0:1746065155.691812:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+10:32384:x1830881263638912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065155.691824:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.691867:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e3b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.691901:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.691909:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.691915:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 25 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.691922:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.691924:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.691927:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 11 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.691953:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 25 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.691964:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 25 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.691975:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263383168:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.692046:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.692053:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.692060:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263383296:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.692083:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.692090:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 15 pid: 12260 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746065155.692103:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263383424:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.692164:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.694074:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263383168:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.694082:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263383296:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.694088:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263383424:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.694109:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 11 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.694120:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167600, rc 0) 00000100:00100000:2.0:1746065155.694145:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+11:32384:x1830881263638912:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2334us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.694152:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13492 00000100:00100000:0.0:1746065155.697674:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.697702:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.697757:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.697850:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263639040 00000100:00100000:3.0:1746065155.697857:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263639040 00010000:00010000:3.0:1746065155.697900:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 26 pid: 12258 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.697922:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263639168 00000100:00100000:3.0:1746065155.697925:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263639168 00010000:00010000:3.0:1746065155.697935:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 16 pid: 12260 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.697944:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263639296 00000100:00100000:3.0:1746065155.697946:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263639296 00010000:00010000:3.0:1746065155.697952:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746065155.697964:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6108 00000100:00100000:3.0:1746065155.697970:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263639040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.697981:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.697997:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 26 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.698006:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 26 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.698024:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc146feee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d9a expref: 26 pid: 12258 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.698040:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.698073:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263639040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.698079:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6108 00000100:00100000:3.0:1746065155.698113:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6109 00000100:00100000:3.0:1746065155.698117:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263639168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.698122:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.698128:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 16 pid: 12260 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.698135:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 16 pid: 12260 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.698150:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683b800/0xad6b7ddc146fdba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d2a expref: 16 pid: 12260 timeout: 851 lvb_type: 1 00010000:00010000:3.0:1746065155.698163:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.698176:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263639168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.698181:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6109 00000100:00100000:2.0:1746065155.698190:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6110 00000100:00100000:2.0:1746065155.698198:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+11:2004:x1830881263639296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065155.698206:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.698214:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.698223:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.698235:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc146ff11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dc4 expref: 11 pid: 9549 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746065155.698247:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.698249:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.698254:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.698261:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.698284:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.698293:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263383552:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065155.698346:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.699514:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263383552:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065155.699524:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.699539:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263639296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1343us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.699543:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6110 00000100:00100000:0.0:1746065155.701456:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.702107:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263639552 00000100:00100000:2.0:1746065155.702115:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263639552 00002000:00100000:2.0:1746065155.702147:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2187264->2191359) req@ffff880098dd8380 x1830881263639552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.702160:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8380 with x1830881263639552 ext(2187264->2191359) 00002000:00010000:2.0:1746065155.702164:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8380 00000100:00100000:2.0:1746065155.702194:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3883 00000100:00100000:2.0:1746065155.702202:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263639552:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065155.702318:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263639552:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 116us (868us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065155.702323:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3883 00002000:00100000:2.0:1746065155.702328:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2187264->2191359) req@ffff880098dd8380 x1830881263639552/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.702335:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8380 with x1830881263639552 ext(2187264->2191359) 00002000:00010000:2.0:1746065155.702338:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8380 00000100:00100000:0.0:1746065155.713537:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.717255:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263639808 00000100:00100000:3.0:1746065155.717265:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263639808 00000100:00100000:3.0:1746065155.717317:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13694 00000100:00100000:3.0:1746065155.717325:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+30:32388:x1830881263639808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.717407:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.717423:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146ffb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e42 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.717485:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717495:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717504:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717514:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717519:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717528:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717599:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717607:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717612:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065155.717619:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065155.717672:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717677:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717683:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717687:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.717690:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717696:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717705:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065155.717707:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.717711:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717719:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc146ffc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717743:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717747:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717751:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717755:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.717757:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717761:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717767:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097e34d00) 00010000:00010000:3.0:1746065155.717768:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.717786:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717791:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc146ffc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.717821:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc146ffb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 33 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.717832:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.717841:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.717843:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065155.717845:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30000, rc 0) 00000100:00100000:3.0:1746065155.717904:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+32:32388:x1830881263639808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 580us (4374us total) trans 8589936032 rc 0/0 00000100:00100000:3.0:1746065155.717910:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13694 00000100:00100000:1.0:1746065155.726088:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.726514:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263640064 00000100:00100000:2.0:1746065155.726523:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263640064 00000100:00100000:2.0:1746065155.726685:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4951 00000100:00100000:2.0:1746065155.726693:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+32:32388:x1830881263640064:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065155.727098:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+33:32388:x1830881263640064:12345-192.168.202.27@tcp:35:cat.0 Request processed in 405us (1017us total) trans 8589936033 rc 0/0 00000100:00100000:2.0:1746065155.727105:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4951 00000100:00100000:1.0:1746065155.731594:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.731806:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.731828:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.731841:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.731874:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263640192 00000100:00100000:2.0:1746065155.731882:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263640192 00000100:00100000:0.0:1746065155.731920:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263640320 00000100:00100000:0.0:1746065155.731924:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263640320 00000100:00100000:2.0:1746065155.731933:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263640448 00000100:00100000:2.0:1746065155.731936:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263640448 00000100:00100000:0.0:1746065155.731947:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13493 00000100:00100000:0.0:1746065155.731962:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263640192:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.731981:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.731998:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc146ffdc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e49 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.732048:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263383680:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065155.732115:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.732507:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13494 00000100:00100000:2.0:1746065155.732514:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881263640320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.732520:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.732528:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc146ffe3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e50 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.732553:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263383808:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065155.732573:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.732810:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13495 00000100:00100000:0.0:1746065155.732817:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263640448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.732824:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.732832:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146ffea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e57 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.732855:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263383936:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065155.732874:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.732988:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263640704 00000100:00100000:0.0:1746065155.732992:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263640704 00000100:00100000:0.0:1746065155.733021:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13695 00000100:00100000:0.0:1746065155.733027:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+33:32390:x1830881263640704:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065155.733039:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.733049:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146fff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e5e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.733106:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733116:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733124:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733134:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733139:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733143:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733217:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1470006 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733224:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1470006 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733230:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1470006 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065155.733236:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065155.733290:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733296:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733301:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733306:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733311:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065155.733314:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733319:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733328:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065155.733331:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065155.733334:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733338:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc600/0xad6b7ddc146fff8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733351:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733355:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733359:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733362:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065155.733365:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733369:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733374:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012edbde00) 00010000:00010000:0.0:1746065155.733375:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065155.733377:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733381:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd200/0xad6b7ddc146ffff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065155.733413:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc146fff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e5e expref: 36 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.733422:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1470006 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e5e expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.733427:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065155.733429:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065155.733431:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00000100:00100000:0.0:1746065155.733455:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+35:32390:x1830881263640704:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 428us (1869us total) trans 8589936034 rc 0/0 00000100:00100000:0.0:1746065155.733461:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13695 00000100:00100000:2.0:1746065155.733605:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.733744:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263640832 00000100:00100000:0.0:1746065155.733748:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263640832 00000100:00100000:1.0:1746065155.734401:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13696 00000100:00100000:1.0:1746065155.734410:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:32391:x1830881263640832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065155.734426:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.734435:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc1470014 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e65 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.734466:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065155.734473:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065155.734480:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065155.734488:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065155.734492:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065155.734497:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065155.734528:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065155.734537:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 13 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.734543:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065155.734562:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 13 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.734576:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 13 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.734584:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263384064:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065155.735288:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.740796:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263383680:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065155.740827:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc146ffdc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e49 expref: 28 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.740840:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc146ffdc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e49 expref: 28 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.740867:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06a00, rc 0) 00000100:00100000:2.0:1746065155.740919:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263640192:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8959us (9113us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.740926:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13493 00000100:00100000:3.0:1746065155.741835:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263383808:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065155.741853:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc146ffe3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e50 expref: 26 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.741862:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc146ffe3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e50 expref: 26 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.741880:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719800, rc 0) 00000100:00100000:1.0:1746065155.742203:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263383936:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065155.742220:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146ffea lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e57 expref: 33 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.742229:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc146ffea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e57 expref: 33 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.742245:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:3.0:1746065155.742372:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881263640320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9857us (10541us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065155.742378:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13494 00000100:00100000:1.0:1746065155.743329:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263640448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10510us (11483us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.743337:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13495 00000100:00100000:3.0:1746065155.743447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.743506:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263384064:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065155.743523:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:2.0:1746065155.743576:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263641088 00000100:00100000:2.0:1746065155.743583:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263641088 00000100:00100000:2.0:1746065155.743624:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4952 00000100:00100000:2.0:1746065155.743631:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+14:8521:x1830881263641088:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065155.743944:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+15:8521:x1830881263641088:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 312us (496us total) trans 8589936035 rc 0/0 00000100:00100000:2.0:1746065155.743950:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4952 00000100:00100000:0.0:1746065155.744177:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.744461:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263641216 00000100:00100000:3.0:1746065155.744465:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263641216 00000100:00100000:3.0:1746065155.744501:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 723 00000100:00100000:3.0:1746065155.744506:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881263641216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.744759:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.744801:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1470006 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e5e expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.744813:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.744816:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.744822:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.744827:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.744831:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.744860:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263641216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 353us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.744865:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 723 00000100:00100000:0.0:1746065155.745046:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.745393:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263641472 00000100:00100000:3.0:1746065155.745397:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263641472 00000100:00100000:3.0:1746065155.745420:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13697 00000100:00100000:3.0:1746065155.745425:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+15:32394:x1830881263641472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.745439:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.745450:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc1470030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e6c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.745499:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745509:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745518:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745529:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745535:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745539:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745608:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745615:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745620:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065155.745627:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065155.745675:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745680:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745685:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745690:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745694:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.745697:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745706:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745712:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065155.745715:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.745717:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745721:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1470037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745729:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745733:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745737:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745741:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.745742:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745747:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745751:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5100) 00010000:00010000:3.0:1746065155.745753:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.745755:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745759:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc147003e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065155.745811:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30400/0xad6b7ddc1470030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 18 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.745821:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 17 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.745827:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.745828:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065155.745831:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.745835:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.745840:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f877000, rc 0) 00000100:00100000:3.0:1746065155.745863:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ccc4a269-0136-4970-860c-c944630694a4+17:32394:x1830881263641472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 438us (818us total) trans 8589936036 rc 0/0 00000100:00100000:3.0:1746065155.745868:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13697 00000100:00100000:1.0:1746065155.746936:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.746967:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263641600 00000100:00100000:1.0:1746065155.746970:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.746971:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263641600 00010000:00010000:3.0:1746065155.746990:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.746991:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263641728 00000100:00100000:1.0:1746065155.746996:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263641728 00000100:00100000:1.0:1746065155.747058:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13496 00000100:00100000:1.0:1746065155.747068:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263641728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.747081:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.747092:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc1470053 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e73 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.747100:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6111 00000100:00100000:3.0:1746065155.747106:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263641600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.747116:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.747120:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.747133:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.747138:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263384192:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065155.747144:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30800/0xad6b7ddc146ff9d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e2d expref: 17 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.747152:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.747155:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747161:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747165:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747180:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.747196:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263641600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.747201:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6111 00000100:00100000:1.0:1746065155.747212:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00010000:00010000:3.0:1746065155.747217:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747222:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065155.747249:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00200000:3.0:1746065155.747251:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065155.747255:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065155.747264:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747275:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747282:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747288:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747293:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747297:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.747300:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747305:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747311:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065155.747313:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.747315:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747318:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147001b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00000100:00100000:2.0:1746065155.747374:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263641984 00000100:00100000:2.0:1746065155.747380:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263641984 00000100:00100000:2.0:1746065155.747423:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13497 00000100:00100000:2.0:1746065155.747438:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263641984:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.747448:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.747457:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147005a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e81 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.747481:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263384320:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065155.747502:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065155.747532:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747537:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747541:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747546:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.747548:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747552:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747559:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5100) 00010000:00010000:3.0:1746065155.747560:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.747563:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747567:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60600/0xad6b7ddc1470022 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.747589:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc1470014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.747598:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.747603:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.747605:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065155.747606:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60200, rc 0) 00000100:00100000:3.0:1746065155.747636:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32391:x1830881263640832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 13227us (14031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.747641:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13696 00000100:00100000:1.0:1746065155.748085:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.748120:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263641856 00000100:00100000:3.0:1746065155.748124:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263641856 00000100:00100000:3.0:1746065155.748143:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13498 00000100:00100000:3.0:1746065155.748148:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263641856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.748155:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.748162:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470061 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e7a expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.748186:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263384448:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065155.748263:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.750163:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263384192:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065155.750191:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc1470053 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e73 expref: 28 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.750203:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc1470053 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e73 expref: 28 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.750214:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60400, rc 0) 00000100:00100000:2.0:1746065155.751141:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263384320:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.751153:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263641728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4086us (4183us total) trans 0 rc 301/301 00010000:00010000:2.0:1746065155.751159:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147005a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e81 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065155.751161:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13496 00010000:00010000:2.0:1746065155.751168:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147005a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e81 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.751176:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166c00, rc 0) 00000100:00100000:2.0:1746065155.751193:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263641984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3757us (3945us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.751197:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13497 00000100:00100000:1.0:1746065155.753377:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.753392:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.753416:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.753429:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.753445:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263642240 00000100:00100000:1.0:1746065155.753450:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263642240 00000100:00100000:1.0:1746065155.753474:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263642496 00000100:00100000:1.0:1746065155.753476:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263642496 00000100:00100000:1.0:1746065155.753484:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263642112 00000100:00100000:1.0:1746065155.753485:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263642112 00000100:00100000:1.0:1746065155.753492:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263642368 00000100:00100000:1.0:1746065155.753493:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263642368 00000100:00100000:1.0:1746065155.753504:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13499 00000100:00100000:1.0:1746065155.753509:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263642240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065155.753522:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.753534:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc1470068 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e8f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.753564:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263384448:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.753575:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263384576:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065155.753585:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470061 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e7a expref: 26 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.753596:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470061 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e7a expref: 26 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.753604:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5e00, rc 0) 00000100:00100000:3.0:1746065155.753626:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881263641856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5478us (5543us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.753630:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.753632:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13498 00000100:00100000:1.0:1746065155.753643:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13500 00000100:00100000:1.0:1746065155.753648:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263642496:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065155.753650:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13501 00010000:00010000:1.0:1746065155.753653:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065155.753656:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263642112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065155.753660:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147006f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e9d expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.753662:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.753669:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc1470076 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e88 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.753682:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263384704:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065155.753689:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263384832:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.753697:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.753708:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13502 00000100:00100000:3.0:1746065155.753711:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.753712:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263642368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065155.753717:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.753723:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147007d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933e96 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.753958:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.754461:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.754475:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263642624 00000100:00100000:0.0:1746065155.754478:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263642624 00000100:00100000:0.0:1746065155.754493:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263642752 00000100:00100000:0.0:1746065155.754495:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263642752 00000100:00100000:0.0:1746065155.754504:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13503 00000100:00100000:0.0:1746065155.754509:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263642624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065155.754515:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.754521:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1470084 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ea4 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.754541:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263384960:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065155.754576:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.754586:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13504 00000100:00100000:0.0:1746065155.754591:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263642752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.754596:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.754601:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc200/0xad6b7ddc147008b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933eab expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.754616:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263385088:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065155.754631:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.754665:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.754674:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263642880 00000100:00100000:0.0:1746065155.754677:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263642880 00000100:00100000:0.0:1746065155.754690:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13505 00000100:00100000:0.0:1746065155.754694:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263642880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.754699:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.754705:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc1470092 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933eb2 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.754721:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263385216:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065155.754735:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.754878:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263385344:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.754918:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.758111:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263384576:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065155.758143:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc1470068 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e8f expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.758155:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60800/0xad6b7ddc1470068 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e8f expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.758165:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60800, rc 0) 00000100:00100000:0.0:1746065155.758182:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263384960:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065155.758199:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1470084 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ea4 expref: 15 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065155.758201:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263642240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4691us (4830us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.758209:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13499 00010000:00010000:0.0:1746065155.758209:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc600/0xad6b7ddc1470084 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ea4 expref: 15 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.758219:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc600, rc 0) 00000100:00100000:0.0:1746065155.758238:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263642624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3729us (4280us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065155.758244:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13503 00000100:00100000:2.0:1746065155.758324:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263384704:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065155.758333:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263384832:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065155.758341:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147006f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e9d expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.758349:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc1470076 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e88 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.758349:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147006f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e9d expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.758357:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc1470076 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e88 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.758360:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00010000:00010000:3.0:1746065155.758364:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51a800, rc 0) 00000100:00100000:2.0:1746065155.758378:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263642496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4730us (4985us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.758383:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13500 00000100:00100000:3.0:1746065155.758388:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2006:x1830881263642112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4727us (4966us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065155.758394:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13501 00000100:00100000:2.0:1746065155.759174:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263385088:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065155.759188:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc200/0xad6b7ddc147008b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eab expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.759197:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc200/0xad6b7ddc147008b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eab expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.759205:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc200, rc 0) 00000100:00100000:1.0:1746065155.759427:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263385216:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065155.759442:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc1470092 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb2 expref: 16 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.759450:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc1470092 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb2 expref: 16 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.759457:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:2.0:1746065155.759615:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263642752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5022us (5153us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.759622:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13504 00000100:00100000:2.0:1746065155.759718:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263385344:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.759723:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263642880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5027us (5056us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.759729:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13505 00010000:00010000:2.0:1746065155.759731:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147007d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e96 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.759740:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147007d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e96 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.759746:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090790600, rc 0) 00000100:00100000:2.0:1746065155.759764:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263642368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6051us (6334us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.759770:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13502 00000100:00100000:0.0:1746065155.766595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.767807:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263643008 00000100:00100000:2.0:1746065155.767816:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263643008 00000100:00100000:2.0:1746065155.767883:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13506 00000100:00100000:2.0:1746065155.767905:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+14:32394:x1830881263643008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.767922:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065155.768296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.768346:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.768368:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.768476:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263643264 00000100:00100000:3.0:1746065155.768480:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263643264 00000100:00100000:3.0:1746065155.768506:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13698 00000100:00100000:3.0:1746065155.768511:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32391:x1830881263643264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065155.768521:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.768534:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b000/0xad6b7ddc1470099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ec0 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.768625:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.768637:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.768644:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.768668:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.768680:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 8 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.768690:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263385472:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.768750:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.768764:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263643520 00000100:00100000:3.0:1746065155.768767:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263643520 00002000:00100000:3.0:1746065155.768805:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1630207) req@ffff880097f51880 x1830881263643520/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.768813:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51880 with x1830881263643520 ext(1048576->1630207) 00002000:00010000:3.0:1746065155.768818:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f51880 00000100:00100000:3.0:1746065155.768834:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263643776 00000100:00100000:3.0:1746065155.768837:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263643776 00002000:00100000:3.0:1746065155.768848:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6f:0x0] (1449984->2097151) req@ffff880097f50700 x1830881263643776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.768853:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50700 with x1830881263643776 ext(1449984->2097151) 00002000:00010000:3.0:1746065155.768856:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f50700 00000100:00100000:3.0:1746065155.768865:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3884 00000100:00100000:3.0:1746065155.768870:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263643520:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065155.769331:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3885 00000100:00100000:3.0:1746065155.769336:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263643776:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065155.770917:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933eb9 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.770953:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.770961:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065155.770963:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065155.770966:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.770996:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.771006:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 35 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.771017:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263385600:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.771067:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.774395:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263385472:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.774416:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065155.774921:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.775823:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263643904 00000100:00100000:2.0:1746065155.775832:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263643904 00010000:00010000:2.0:1746065155.775864:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 9 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.775908:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6112 00000100:00100000:2.0:1746065155.775914:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263643904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065155.775927:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.775932:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 9 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.775941:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 9 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.775961:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1470029 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e65 expref: 9 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.775974:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065155.775978:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.775987:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.775993:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.776021:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065155.776059:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:2.0:1746065155.776063:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263643904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 149us (1144us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065155.776065:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:2.0:1746065155.776069:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6112 00000004:00200000:0.0:1746065155.776081:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065155.776178:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b000/0xad6b7ddc1470099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.776193:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.776200:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065155.776202:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065155.776204:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51b800, rc 0) 00000100:00100000:0.0:1746065155.776235:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32391:x1830881263643264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7723us (7939us total) trans 8589936037 rc 0/0 00000100:00100000:0.0:1746065155.776241:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13698 00000100:00100000:2.0:1746065155.777027:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263385600:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.777045:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.777056:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166400, rc 0) 00000100:00100000:3.0:1746065155.777272:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263643520:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8400us (8924us total) trans 0 rc 581632/581632 00000100:00100000:3.0:1746065155.777280:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3884 00002000:00100000:3.0:1746065155.777287:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1630207) req@ffff880097f51880 x1830881263643520/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 581632/581632 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.777294:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51880 with x1830881263643520 ext(1048576->1630207) 00010000:00010000:3.0:1746065155.777300:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.777311:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.777317:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097f51880 00000100:00100000:2.0:1746065155.777764:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+15:32394:x1830881263643008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9353us (10671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.777787:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13506 00000100:00100000:1.0:1746065155.777967:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.778132:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263644032 00000100:00100000:3.0:1746065155.778137:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263644032 00002000:00100000:3.0:1746065155.778159:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1630208->2097151) req@ffff88009c5f3b80 x1830881263644032/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.778166:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3b80 with x1830881263644032 ext(1630208->2097151) 00010000:00010000:3.0:1746065155.778170:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.778799:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.778805:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f3b80 00000100:00100000:3.0:1746065155.778821:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1336 00000100:00100000:3.0:1746065155.778828:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263644032:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065155.779047:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263643776:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9709us (10677us total) trans 0 rc 647168/647168 00000100:00100000:3.0:1746065155.779053:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3885 00002000:00100000:3.0:1746065155.779058:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1449984->2097151) req@ffff880097f50700 x1830881263643776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 647168/647168 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.779065:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50700 with x1830881263643776 ext(1449984->2097151) 00002000:00010000:3.0:1746065155.779068:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f50700 00000100:00100000:0.0:1746065155.779190:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.779770:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263644160 00000100:00100000:2.0:1746065155.779916:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263644160 00000100:00100000:2.0:1746065155.779958:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13699 00000100:00100000:2.0:1746065155.779963:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32391:x1830881263644160:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065155.779978:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.780058:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166000/0xad6b7ddc14700b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ec7 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.780129:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.780142:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.780148:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065155.780173:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.780182:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 9 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.780192:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263385728:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.780266:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.787188:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263644032:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8350us (9211us total) trans 17179873516 rc 0/0 00000100:00100000:3.0:1746065155.787201:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1336 00002000:00100000:3.0:1746065155.787213:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1630208->2097151) req@ffff88009c5f3b80 x1830881263644032/t17179873516(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/448 e 0 to 0 dl 1746065166 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.787223:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3b80 with x1830881263644032 ext(1630208->2097151) 00010000:00010000:3.0:1746065155.787234:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.787249:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.787257:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f3b80 00000100:00100000:0.0:1746065155.793191:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.793220:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.793237:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263644288 00000100:00100000:3.0:1746065155.793246:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263644288 00000100:00100000:0.0:1746065155.793251:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065155.793276:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 10 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.793276:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263644416 00000100:00100000:0.0:1746065155.793279:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263644416 00010000:00010000:0.0:1746065155.793295:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.793438:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6113 00000100:00100000:0.0:1746065155.793444:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6114 00000100:00100000:3.0:1746065155.793446:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263644288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065155.793450:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881263644416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.793457:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065155.793457:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.793462:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 10 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.793472:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.793473:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 10 pid: 13395 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.793480:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.793490:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065155.793493:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130113e00/0xad6b7ddc146ff26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dd9 expref: 34 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.793495:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.793503:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065155.793531:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.793533:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.793538:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 14 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.793544:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 14 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.793570:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 14 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.793579:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263385856:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065155.793631:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.793644:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263644544 00000100:00100000:0.0:1746065155.793646:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263644544 00000100:00100000:0.0:1746065155.793667:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13507 00000100:00100000:0.0:1746065155.793672:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+25:32388:x1830881263644544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065155.793683:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.793694:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ece expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.793710:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.793720:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065155.793721:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065155.793724:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 26 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.793738:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.793747:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 9 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.793754:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263385984:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065155.793802:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065155.794110:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.794125:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.794154:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2006:x1830881263644288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 709us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.794160:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6113 00010000:00010000:3.0:1746065155.794193:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700a0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec0 expref: 9 pid: 13395 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.794209:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263385728:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.794223:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.794234:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.794239:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065155.794278:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065155.794282:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065155.794295:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.794318:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166000/0xad6b7ddc14700b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.794329:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.794527:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.794530:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065155.794532:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166c00, rc 0) 00000100:00100000:3.0:1746065155.795163:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32391:x1830881263644160:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 15197us (15971us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.795170:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13699 00000100:00100000:0.0:1746065155.795704:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263385984:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065155.795720:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 26 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.795731:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07e00, rc 0) 00000100:00100000:0.0:1746065155.795750:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+26:32388:x1830881263644544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2078us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.795757:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13507 00000100:00100000:2.0:1746065155.795909:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263385856:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065155.795919:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.795939:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263644416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2490us (2718us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.795946:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6114 00000100:00100000:2.0:1746065155.796432:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.796472:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263644672 00000100:00100000:3.0:1746065155.796477:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263644672 00002000:00100000:3.0:1746065155.796506:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (2080768->2097151) req@ffff88008f3e4a80 x1830881263644672/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 16872/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.796520:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4a80 with x1830881263644672 ext(2080768->2097151) 00010000:00010000:3.0:1746065155.796526:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 10 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.796536:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 10 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.796541:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e4a80 00000100:00100000:3.0:1746065155.796565:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1337 00000100:00100000:3.0:1746065155.796571:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263644672:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065155.797091:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.797159:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263644800 00000100:00100000:2.0:1746065155.797162:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263644800 00000100:00100000:2.0:1746065155.797182:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13508 00000100:00100000:2.0:1746065155.797187:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263644800:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065155.797196:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.797209:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ed5 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.797223:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.797225:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.797230:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.797241:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.797248:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718800, rc 0) 00000100:00100000:2.0:1746065155.797801:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263644800:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 612us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.797806:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13508 00000100:00100000:3.0:1746065155.798052:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263644672:12345-192.168.202.27@tcp:4:cat.0 Request processed in 1480us (1621us total) trans 21474840972 rc 0/0 00000100:00100000:3.0:1746065155.798059:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1337 00002000:00100000:3.0:1746065155.798064:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (2080768->2097151) req@ffff88008f3e4a80 x1830881263644672/t21474840972(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 16872/448 e 0 to 0 dl 1746065166 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.798072:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4a80 with x1830881263644672 ext(2080768->2097151) 00010000:00010000:3.0:1746065155.798077:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 12 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.798087:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 12 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.798092:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e4a80 00000100:00100000:2.0:1746065155.798591:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.798650:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.798665:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.798677:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263644928 00000100:00100000:2.0:1746065155.798680:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263644928 00000100:00100000:2.0:1746065155.798697:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263645056 00000100:00100000:2.0:1746065155.798698:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263645056 00000100:00100000:2.0:1746065155.798708:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263645184 00000100:00100000:2.0:1746065155.798710:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263645184 00000100:00100000:2.0:1746065155.798734:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13509 00000100:00100000:2.0:1746065155.798740:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263644928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065155.798749:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.798757:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc14700d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933edc expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.798768:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13510 00000100:00100000:0.0:1746065155.798793:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2007:x1830881263645056:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065155.798803:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065155.798806:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263386112:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065155.798810:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc14700d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ee3 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.798833:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263386240:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065155.798852:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.798852:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.798867:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13511 00000100:00100000:2.0:1746065155.798872:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2007:x1830881263645184:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065155.798878:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065155.798896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065155.798899:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aa51400/0xad6b7ddc14700df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933eea expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.798920:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263386368:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065155.798933:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.798940:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.798994:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263645312 00000100:00100000:1.0:1746065155.798998:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263645312 00000100:00100000:1.0:1746065155.799025:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13512 00000100:00100000:1.0:1746065155.799029:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263645312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065155.799035:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.799040:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc14700e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ef1 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.799057:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263386496:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.799077:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.799174:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263645568 00000100:00100000:3.0:1746065155.799178:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263645568 00002000:00100000:3.0:1746065155.799194:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa0000 x1830881263645568/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.799201:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0000 with x1830881263645568 ext(1048576->2097151) 00002000:00010000:3.0:1746065155.799205:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0000 00000100:00100000:3.0:1746065155.799215:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3886 00000100:00100000:3.0:1746065155.799220:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263645568:12345-192.168.202.27@tcp:3:cat.0 00002000:00010000:2.0:1746065155.801391:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime: 1746065155 -> 1746065156 00000100:00100000:2.0:1746065155.801416:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263386112:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065155.801446:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc14700d1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933edc expref: 15 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.801458:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc14700d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933edc expref: 15 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.801479:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a200, rc 0) 00000100:00100000:2.0:1746065155.801522:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263644928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2781us (2931us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.801529:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13509 00000100:00100000:0.0:1746065155.802021:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065155.802077:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065155 -> 1746065156 00000100:00100000:2.0:1746065155.802087:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263386368:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065155.802103:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aa51400/0xad6b7ddc14700df lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eea expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.802110:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aa51400/0xad6b7ddc14700df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eea expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.802117:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa51400, rc 0) 00000100:00100000:2.0:1746065155.802137:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2007:x1830881263645184:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3265us (3471us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.802142:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13511 00000100:00100000:3.0:1746065155.802239:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263645696 00000100:00100000:3.0:1746065155.802245:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263645696 00010000:00010000:3.0:1746065155.802265:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 12 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.802283:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6115 00000100:00100000:3.0:1746065155.802289:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+12:2007:x1830881263645696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.802300:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.802309:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 12 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.802318:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 12 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.802337:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.802339:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.802346:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.802358:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.802382:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.802392:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263386624:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065155.802433:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a25000 going to sleep for 11 seconds 00002000:00010000:1.0:1746065155.802971:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065155 -> 1746065156 00010000:00010000:1.0:1746065155.802980:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc146ffab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e34 expref: 12 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.803018:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263386240:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065155.803032:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc14700d8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ee3 expref: 16 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.803039:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc14700d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ee3 expref: 16 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.803046:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06800, rc 0) 00000100:00100000:1.0:1746065155.803198:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2007:x1830881263645056:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4423us (4546us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.803204:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13510 00002000:00010000:1.0:1746065155.805271:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065155 -> 1746065156 00000100:00100000:1.0:1746065155.805292:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263386496:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065155.805316:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc14700e6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ef1 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.805327:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc14700e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ef1 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.805336:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60e00, rc 0) 00000100:00100000:1.0:1746065155.805382:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263645312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6351us (6484us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.805389:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13512 00000100:00100000:3.0:1746065155.809207:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263386624:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065155.809209:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065155.809226:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.809265:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263645696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6974us (7243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.809274:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6115 00000100:00100000:0.0:1746065155.811016:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.811135:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263646208 00000100:00100000:1.0:1746065155.811145:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263646208 00002000:00100000:1.0:1746065155.811195:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097fa3480 x1830881263646208/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.811206:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3480 with x1830881263646208 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.811212:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3480 00000100:00100000:1.0:1746065155.811241:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3887 00000100:00100000:1.0:1746065155.811250:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263646208:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065155.811313:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263645568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12076us (12362us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065155.811325:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3886 00002000:00100000:3.0:1746065155.811337:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880097fa0000 x1830881263645568/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.811345:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0000 with x1830881263645568 ext(1048576->2097151) 00002000:00010000:3.0:1746065155.811350:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0000 00000100:00100000:3.0:1746065155.811388:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263645952 00000100:00100000:3.0:1746065155.811395:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263645952 00000100:00100000:3.0:1746065155.811437:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13700 00000100:00100000:3.0:1746065155.811446:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32391:x1830881263645952:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065155.811467:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.811485:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ef8 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.811582:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811598:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811609:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811621:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811626:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811631:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811636:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.811639:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811645:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811655:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.811657:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065155.811661:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811669:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14700f4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.811704:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700ed lrc: 1/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ef8 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.811712:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51b800/0xad6b7ddc14700ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ef8 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.811719:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51b800, rc 0) 00000100:00100000:3.0:1746065155.811755:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32391:x1830881263645952:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 310us (2548us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065155.811761:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13700 00000100:00100000:0.0:1746065155.824923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.825037:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263646464 00000100:00100000:3.0:1746065155.825045:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263646464 00000100:00100000:3.0:1746065155.825082:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4953 00000100:00100000:3.0:1746065155.825089:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32391:x1830881263646464:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065155.825287:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32391:x1830881263646464:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 195us (368us total) trans 8589936038 rc 0/0 00000100:00100000:3.0:1746065155.825295:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4953 00000100:00100000:0.0:1746065155.826102:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.826352:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263646592 00000100:00100000:1.0:1746065155.826364:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263646592 00000100:00100000:1.0:1746065155.826427:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13513 00000100:00100000:1.0:1746065155.826435:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+15:32394:x1830881263646592:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.826453:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.826473:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933eff expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.826505:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.826513:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065155.826514:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065155.826518:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.826551:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.826563:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 32 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.826576:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263386752:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065155.826680:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.828233:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881263646208:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16972us (17215us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.828244:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3887 00002000:00100000:1.0:1746065155.828261:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097fa3480 x1830881263646208/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.828271:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3480 with x1830881263646208 ext(1048576->2097151) 00002000:00010000:1.0:1746065155.828278:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3480 00000100:00100000:0.0:1746065155.835161:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.835356:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263646720 00000100:00100000:2.0:1746065155.835369:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263646720 00002000:00100000:2.0:1746065155.835423:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1449983) req@ffff88012dc3fb80 x1830881263646720/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.835433:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3fb80 with x1830881263646720 ext(1048576->1449983) 00010000:00010000:2.0:1746065155.835444:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 33 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.835459:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 33 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:2.0:1746065155.835465:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc3fb80 00000100:00100000:2.0:1746065155.835504:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1338 00000100:00100000:2.0:1746065155.835512:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263646720:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065155.836299:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263386752:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065155.836330:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.836346:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61200, rc 0) 00000100:00100000:1.0:1746065155.836391:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+16:32394:x1830881263646592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9956us (10288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.836398:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13513 00000100:00100000:1.0:1746065155.839120:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.839156:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.839173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.839198:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.839222:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263646848 00000100:00100000:1.0:1746065155.839231:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263646848 00000100:00100000:1.0:1746065155.839268:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263647104 00000100:00100000:1.0:1746065155.839270:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263647104 00000100:00100000:1.0:1746065155.839281:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263646976 00000100:00100000:1.0:1746065155.839282:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263646976 00000100:00100000:1.0:1746065155.839290:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263647232 00000100:00100000:1.0:1746065155.839291:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263647232 00000100:00100000:1.0:1746065155.839306:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13514 00000100:00100000:1.0:1746065155.839313:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263646848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.839332:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.839351:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f06 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.839375:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.839378:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065155.839388:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 38 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.839408:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 38 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.839421:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60e00, rc 0) 00000100:00100000:1.0:1746065155.839464:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881263646848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 151us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.839470:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13514 00000100:00100000:1.0:1746065155.839487:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13515 00000100:00100000:1.0:1746065155.839491:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263647104:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.839499:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.839508:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc1470109 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f14 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.839548:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263386880:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065155.839600:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.839620:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13516 00000100:00100000:1.0:1746065155.839625:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263646976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.839631:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.839638:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1470110 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f0d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.839660:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263387008:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065155.839664:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13517 00000100:00100000:3.0:1746065155.839677:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881263647232:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065155.839679:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746065155.839694:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.839709:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c51b800/0xad6b7ddc1470117 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f1b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.839755:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263387136:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065155.839826:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065155.841987:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263646720:12345-192.168.202.27@tcp:4:cat.0 Request processed in 6470us (6828us total) trans 17179873517 rc 0/0 00000100:00100000:2.0:1746065155.841995:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1338 00002000:00100000:2.0:1746065155.842003:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1449983) req@ffff88012dc3fb80 x1830881263646720/t17179873517(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/448 e 0 to 0 dl 1746065166 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.842010:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3fb80 with x1830881263646720 ext(1048576->1449983) 00010000:00010000:2.0:1746065155.842019:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 40 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.842030:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 40 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:2.0:1746065155.842038:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc3fb80 00000100:00100000:1.0:1746065155.843638:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263386880:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065155.843676:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc1470109 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f14 expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.843690:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc1470109 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f14 expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.843729:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60400, rc 0) 00000100:00100000:1.0:1746065155.843825:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263647104:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4331us (4666us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.843834:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13515 00000100:00100000:0.0:1746065155.856343:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.856389:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263647360 00000100:00100000:0.0:1746065155.856399:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263647360 00010000:00010000:0.0:1746065155.856440:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 40 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.856484:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6116 00000100:00100000:0.0:1746065155.856493:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263647360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065155.856519:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263387136:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065155.856522:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065155.856543:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 40 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.856551:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c51b800/0xad6b7ddc1470117 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f1b expref: 40 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.856561:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 40 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.856565:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c51b800/0xad6b7ddc1470117 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f1b expref: 40 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.856587:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.856589:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.856592:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51b800, rc 0) 00010000:00010000:0.0:1746065155.856596:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.856604:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.856643:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263647232:12345-192.168.202.27@tcp:101:cat.0 Request processed in 16969us (17443us total) trans 0 rc 301/301 00010000:00010000:0.0:1746065155.856648:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.856650:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13517 00000100:00100000:0.0:1746065155.856665:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263387264:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065155.856749:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bd80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065155.856863:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30c00/0xad6b7ddc146ff3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1449983) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933dee expref: 38 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746065155.856880:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263387008:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065155.856913:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1470110 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f0d expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.856923:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1470110 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f0d expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065155.856931:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61c00, rc 0) 00000100:00100000:1.0:1746065155.856960:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881263646976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 17334us (17785us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065155.856967:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13516 00000100:00100000:2.0:1746065155.860335:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263387264:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065155.860359:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065155.860655:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263647360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4160us (4322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.860666:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6116 00000100:00100000:3.0:1746065155.861964:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.862099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.863315:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263647488 00000100:00100000:1.0:1746065155.863326:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263647488 00000100:00100000:1.0:1746065155.863377:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13518 00000100:00100000:1.0:1746065155.863385:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:32388:x1830881263647488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065155.863405:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065155.863423:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f22 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.863459:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.863466:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065155.863468:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065155.863471:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 27 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065155.863491:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065155.863502:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.863514:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 10 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.863526:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263647872 00000100:00100000:1.0:1746065155.863528:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263387392:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065155.863533:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263647872 00000100:00100000:0.0:1746065155.863568:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13519 00000100:00100000:0.0:1746065155.863574:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:32390:x1830881263647872:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065155.863587:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.863599:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f29 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.863610:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746065155.863622:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.863628:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065155.863630:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065155.863632:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2330624->3145727] (req 2330624->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.863655:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.863663:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 15 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746065155.863673:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263387520:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.863705:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263647744 00000100:00100000:2.0:1746065155.863710:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263647744 00000100:00100000:0.0:1746065155.863712:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00002000:00100000:2.0:1746065155.863737:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880136a78380 x1830881263647744/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.863747:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78380 with x1830881263647744 ext(1048576->2097151) 00002000:00010000:2.0:1746065155.863751:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78380 00000100:00100000:2.0:1746065155.863762:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3888 00000100:00100000:2.0:1746065155.863766:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263647744:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065155.867412:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263387392:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065155.867447:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 27 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065155.867471:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60800, rc 0) 00000100:00100000:1.0:1746065155.867524:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+27:32388:x1830881263647488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4138us (5562us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065155.867533:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13518 00000100:00100000:2.0:1746065155.868987:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.869501:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263387520:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.869525:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2330624->3145727] (req 2330624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.869540:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd000, rc 0) 00000100:00100000:3.0:1746065155.869572:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+36:32390:x1830881263647872:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5998us (6089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.869579:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13519 00000100:00100000:2.0:1746065155.871056:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.871294:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263648000 00000100:00100000:2.0:1746065155.871303:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263648000 00002000:00100000:2.0:1746065155.871344:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2191359) req@ffff880091b64e00 x1830881263648000/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.871354:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64e00 with x1830881263648000 ext(2097152->2191359) 00010000:00010000:2.0:1746065155.871362:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 11 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.871381:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 11 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:2.0:1746065155.871387:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b64e00 00000100:00100000:2.0:1746065155.871723:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263648128 00000100:00100000:2.0:1746065155.871726:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263648128 00002000:00100000:2.0:1746065155.871743:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3391488->3751935) req@ffff880091b65180 x1830881263648128/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.871750:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65180 with x1830881263648128 ext(3391488->3751935) 00010000:00010000:2.0:1746065155.871756:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 18 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.871765:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 18 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:2.0:1746065155.871771:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b65180 00000100:00100000:2.0:1746065155.871815:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1339 00000100:00100000:2.0:1746065155.871822:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+11:2007:x1830881263648000:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065155.871954:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1340 00000100:00100000:2.0:1746065155.871960:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263648128:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065155.881894:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263648128:12345-192.168.202.27@tcp:4:cat.0 Request processed in 9911us (10823us total) trans 17179873518 rc 0/0 00000100:00100000:0.0:1746065155.881906:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1340 00002000:00100000:0.0:1746065155.881919:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (3391488->3751935) req@ffff880091b65180 x1830881263648128/t17179873518(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/448 e 0 to 0 dl 1746065166 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065155.881929:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65180 with x1830881263648128 ext(3391488->3751935) 00010000:00010000:0.0:1746065155.881941:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 20 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746065155.881954:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 20 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746065155.881960:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b65180 00000100:00100000:2.0:1746065155.882281:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263647744:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18512us (20180us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065155.882288:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3888 00002000:00100000:2.0:1746065155.882295:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880136a78380 x1830881263647744/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065155.882303:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78380 with x1830881263647744 ext(1048576->2097151) 00002000:00010000:2.0:1746065155.882307:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78380 00000100:00100000:3.0:1746065155.883036:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263648000:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11211us (14053us total) trans 21474840973 rc 0/0 00000100:00100000:3.0:1746065155.883045:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1339 00002000:00100000:3.0:1746065155.883051:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2191359) req@ffff880091b64e00 x1830881263648000/t21474840973(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/448 e 0 to 0 dl 1746065166 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.883058:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64e00 with x1830881263648000 ext(2097152->2191359) 00010000:00010000:3.0:1746065155.883066:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 13 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.883076:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 13 pid: 13375 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746065155.883081:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b64e00 00000100:00100000:0.0:1746065155.887354:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.887823:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263648256 00000100:00100000:3.0:1746065155.887833:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263648256 00000100:00100000:3.0:1746065155.887900:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13520 00000100:00100000:3.0:1746065155.887907:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+13:32394:x1830881263648256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.887929:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.887949:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f30 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.887973:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.887975:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.887982:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.887995:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.888010:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167200, rc 0) 00000100:00100000:3.0:1746065155.888063:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+14:32394:x1830881263648256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 156us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.888069:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13520 00000100:00100000:0.0:1746065155.888198:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.888708:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.888806:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263648384 00000100:00100000:2.0:1746065155.888810:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263648384 00010000:00010000:2.0:1746065155.888834:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 18 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.888857:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263648512 00000100:00100000:2.0:1746065155.888859:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263648512 00010000:00010000:2.0:1746065155.888868:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 14 pid: 13375 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746065155.890121:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6117 00000100:00100000:2.0:1746065155.890128:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6118 00000100:00100000:3.0:1746065155.890132:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263648384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065155.890133:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263648512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.890146:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065155.890146:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.890167:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 18 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.890167:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 14 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.890178:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 18 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.890178:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 14 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.890197:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc146ff8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3751935) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e26 expref: 18 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746065155.890197:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167600/0xad6b7ddc146ffb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e3b expref: 14 pid: 13375 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746065155.890215:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.890215:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.890217:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.890217:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.890223:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.890223:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.890231:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.890231:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.890258:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.890258:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065155.890270:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263387776:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065155.890270:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263387648:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065155.890976:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.891077:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.897870:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263387776:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065155.897870:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263387648:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065155.897903:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065155.897905:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.897952:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263648384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7820us (9752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.897963:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6117 00000100:00100000:2.0:1746065155.898159:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+13:2006:x1830881263648512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8023us (9449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.898166:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6118 00000100:00100000:0.0:1746065155.898691:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.898861:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263648768 00000100:00100000:3.0:1746065155.898868:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263648768 00002000:00100000:3.0:1746065155.898916:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012dc3d180 x1830881263648768/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.898926:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d180 with x1830881263648768 ext(1048576->2097151) 00002000:00010000:3.0:1746065155.898930:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3d180 00000100:00100000:3.0:1746065155.898958:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3889 00000100:00100000:3.0:1746065155.898965:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263648768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065155.904110:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.904149:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.904197:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263649024 00000100:00100000:1.0:1746065155.904208:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263649024 00002000:00100000:1.0:1746065155.904258:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88012dc3df80 x1830881263649024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.904269:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3df80 with x1830881263649024 ext(2097152->4194303) 00002000:00010000:1.0:1746065155.904274:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3df80 00000100:00100000:1.0:1746065155.904292:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263649280 00000100:00100000:1.0:1746065155.904294:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263649280 00002000:00100000:1.0:1746065155.904306:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099bd7b80 x1830881263649280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.904313:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7b80 with x1830881263649280 ext(2097152->4194303) 00002000:00010000:1.0:1746065155.904316:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd7b80 00000100:00100000:1.0:1746065155.904341:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3890 00000100:00100000:1.0:1746065155.904348:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263649024:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065155.905437:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3891 00000100:00100000:0.0:1746065155.905448:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263649280:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065155.910151:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263648768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11173us (11448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065155.910163:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3889 00002000:00100000:3.0:1746065155.910176:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012dc3d180 x1830881263648768/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065155.910187:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d180 with x1830881263648768 ext(1048576->2097151) 00002000:00010000:3.0:1746065155.910193:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3d180 00010000:00010000:3.0:1746065155.922650:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065155.923052:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.923177:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.923225:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263649408 00000100:00100000:3.0:1746065155.923235:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263649408 00000100:00100000:2.0:1746065155.923252:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263649536 00000100:00100000:2.0:1746065155.923255:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263649536 00000100:00100000:2.0:1746065155.923303:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13521 00000100:00100000:3.0:1746065155.923309:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13522 00000100:00100000:2.0:1746065155.923311:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263649536:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065155.923313:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+13:2007:x1830881263649408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065155.923329:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.923329:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.923348:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f37 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.923350:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc147013a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f3e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.923371:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.923372:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065155.923381:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 14 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.923395:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 14 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065155.923401:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263387904:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065155.923404:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167e00, rc 0) 00000100:00100000:3.0:1746065155.923450:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263649408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 136us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.923456:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13522 00000100:00100000:2.0:1746065155.924634:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065155.928648:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263649024:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 24287us (24538us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065155.928661:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3890 00002000:00100000:1.0:1746065155.928674:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88012dc3df80 x1830881263649024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.928683:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3df80 with x1830881263649024 ext(2097152->4194303) 00002000:00010000:1.0:1746065155.928690:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3df80 00002000:00010000:2.0:1746065155.930139:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065155 -> 1746065156 00002000:00010000:2.0:1746065155.930145:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065155 -> 1746065156 00000100:00100000:2.0:1746065155.930161:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263387904:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065155.930197:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc147013a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f3e expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.930210:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a6cd600/0xad6b7ddc147013a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f3e expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.930225:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a6cd600, rc 0) 00000100:00100000:2.0:1746065155.930269:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263649536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6957us (7090us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065155.930277:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13521 00000100:00100000:1.0:1746065155.939081:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.939195:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263649792 00000100:00100000:3.0:1746065155.939206:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263649792 00000100:00100000:3.0:1746065155.939258:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13701 00000100:00100000:3.0:1746065155.939266:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+16:32398:x1830881263649792:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065155.939292:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065155.939311:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166000/0xad6b7ddc1470141 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f45 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.939397:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.939412:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.939423:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.939436:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.939441:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.939447:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065155.940228:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263649280:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 34781us (36077us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065155.940238:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3891 00002000:00100000:1.0:1746065155.940247:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099bd7b80 x1830881263649280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.940262:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7b80 with x1830881263649280 ext(2097152->4194303) 00002000:00010000:1.0:1746065155.940267:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd7b80 00010000:00010000:3.0:1746065155.940379:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.940390:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.940397:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065155.940406:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065155.940492:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.940499:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.940509:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.940514:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.940519:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.940526:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.940539:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065155.940542:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.940546:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.940552:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167600/0xad6b7ddc1470148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.942256:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.942268:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.942273:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.942278:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065155.942281:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.942286:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.942302:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009074dc00) 00010000:00010000:3.0:1746065155.942305:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065155.942308:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.942312:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc147014f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065155.942377:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166000/0xad6b7ddc1470141 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 19 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.942391:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 18 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.942397:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065155.942399:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065155.942401:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4200, rc 0) 00000100:00100000:3.0:1746065155.942798:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+18:32398:x1830881263649792:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3530us (3727us total) trans 8589936039 rc 0/0 00000100:00100000:3.0:1746065155.942807:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13701 00000100:00100000:3.0:1746065155.942911:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.943089:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263650048 00000100:00100000:1.0:1746065155.943098:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263650048 00002000:00100000:1.0:1746065155.943133:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880136a78000 x1830881263650048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.943142:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78000 with x1830881263650048 ext(2097152->3145727) 00002000:00010000:1.0:1746065155.943146:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a78000 00000100:00100000:1.0:1746065155.943944:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3892 00000100:00100000:1.0:1746065155.943954:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263650048:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065155.959142:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.960056:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263650048:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16096us (17136us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065155.960070:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3892 00002000:00100000:1.0:1746065155.960083:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880136a78000 x1830881263650048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.960094:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78000 with x1830881263650048 ext(2097152->3145727) 00002000:00010000:1.0:1746065155.960099:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a78000 00000100:00100000:0.0:1746065155.960878:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263650304 00000100:00100000:0.0:1746065155.960897:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263650304 00000100:00100000:0.0:1746065155.960953:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4954 00000100:00100000:0.0:1746065155.960960:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+34:32390:x1830881263650304:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065155.961593:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+35:32390:x1830881263650304:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 628us (2456us total) trans 8589936040 rc 0/0 00000100:00100000:3.0:1746065155.961602:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4954 00000100:00100000:0.0:1746065155.965861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.966005:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263650432 00000100:00100000:2.0:1746065155.966014:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263650432 00000100:00100000:2.0:1746065155.966058:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13523 00000100:00100000:2.0:1746065155.966064:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881263650432:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.966080:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.966095:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f4c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.966114:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.966116:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065155.966122:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.966135:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065155.966144:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3600, rc 0) 00000100:00100000:2.0:1746065155.966196:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263650432:12345-192.168.202.27@tcp:101:cat.0 Request processed in 131us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065155.966201:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13523 00000100:00100000:0.0:1746065155.969537:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.970424:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263650560 00000100:00100000:2.0:1746065155.970431:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263650560 00000100:00100000:2.0:1746065155.971343:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13524 00000100:00100000:2.0:1746065155.971352:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+17:32394:x1830881263650560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.971369:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.971387:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f53 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.971416:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.971424:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065155.971425:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065155.971428:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.971452:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.971463:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 36 pid: 3067 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746065155.971477:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263388032:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065155.972449:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065155.972651:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.972993:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263650816 00000100:00100000:1.0:1746065155.973004:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263650816 00002000:00100000:1.0:1746065155.973049:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097a6f480 x1830881263650816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.973060:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f480 with x1830881263650816 ext(4194304->5021695) 00002000:00010000:1.0:1746065155.973066:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6f480 00000100:00100000:1.0:1746065155.973100:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3893 00000100:00100000:1.0:1746065155.973107:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263650816:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065155.981801:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263388032:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065155.981840:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065155.981857:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2000, rc 0) 00000100:00100000:2.0:1746065155.981933:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+18:32394:x1830881263650560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10581us (12400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065155.981935:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065155.981943:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13524 00000100:00100000:0.0:1746065155.981966:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263650944 00000100:00100000:0.0:1746065155.981973:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263650944 00000100:00100000:0.0:1746065155.982019:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13525 00000100:00100000:0.0:1746065155.982027:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+14:32398:x1830881263650944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065155.982043:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065155.982058:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f5a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065155.982082:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.982090:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 15 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.982097:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 28 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.982102:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.982104:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065155.982107:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [585728->991231] (req 585728->991231) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065155.982128:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263650816:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9021us (9478us total) trans 0 rc 827392/827392 00010000:00010000:0.0:1746065155.982132:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065155.982136:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3893 00010000:00010000:0.0:1746065155.982141:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 27 pid: 12258 timeout: 852 lvb_type: 1 00002000:00100000:1.0:1746065155.982145:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097a6f480 x1830881263650816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/440 e 0 to 0 dl 1746065166 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065155.982151:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263388160:192.168.202.27@tcp:104: 00002000:00100000:1.0:1746065155.982153:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f480 with x1830881263650816 ext(4194304->5021695) 00002000:00010000:1.0:1746065155.982157:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6f480 00010000:00010000:0.0:1746065155.982219:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 15 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065155.982227:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 15 pid: 13375 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746065155.982234:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263388288:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.982316:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065155.982332:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 14 pid: 11461 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065155.982343:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263388416:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.982363:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.983448:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065155.983531:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263651072 00000100:00100000:1.0:1746065155.983535:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263651072 00002000:00100000:1.0:1746065155.983566:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2330624->3145727) req@ffff880099bd7800 x1830881263651072/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/0 e 0 to 0 dl 1746065166 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065155.983575:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7800 with x1830881263651072 ext(2330624->3145727) 00010000:00010000:1.0:1746065155.983582:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 37 pid: 3067 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746065155.983592:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 37 pid: 3067 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746065155.983597:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd7800 00000100:00100000:1.0:1746065155.987870:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1341 00000100:00100000:1.0:1746065155.987896:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263651072:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065155.991808:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263388160:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.991823:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263388288:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065155.991831:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263388416:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065155.991860:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [585728->991231] (req 585728->991231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.991874:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f600, rc 0) 00000100:00100000:3.0:1746065155.991931:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+15:32398:x1830881263650944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9904us (10003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.991940:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13525 00000100:00100000:0.0:1746065155.996555:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.996584:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.996592:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263651584 00000100:00100000:0.0:1746065155.996599:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065155.996600:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263651584 00000100:00100000:3.0:1746065155.996613:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263651200 00000100:00100000:3.0:1746065155.996615:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263651200 00000100:00100000:0.0:1746065155.996618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065155.997383:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 28 pid: 12258 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065155.997416:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263651456 00000100:00100000:3.0:1746065155.997419:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263651456 00010000:00010000:3.0:1746065155.997430:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 15 pid: 11461 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746065155.997444:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6119 00000100:00100000:3.0:1746065155.997450:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6120 00000100:00100000:1.0:1746065155.997453:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263651200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065155.997455:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263651456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065155.997464:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065155.997464:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065155.997480:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 15 pid: 11461 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746065155.997480:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 28 pid: 12258 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746065155.997489:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 15 pid: 11461 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746065155.997498:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 28 pid: 12258 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746065155.997553:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263651712 00000100:00100000:2.0:1746065155.997556:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263651712 00000100:00100000:2.0:1746065155.997575:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13526 00000100:00100000:2.0:1746065155.997579:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263651712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.997589:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.997600:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc1470179 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f68 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065155.997642:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263388544:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065155.997689:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065155.998291:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065155.998313:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263651328 00000100:00100000:0.0:1746065155.998317:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263651328 00010000:00010000:0.0:1746065155.998330:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 15 pid: 13375 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746065155.998346:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6121 00000100:00100000:0.0:1746065155.998350:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263651328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065155.998356:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065155.998854:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13527 00000100:00100000:2.0:1746065155.998859:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263651584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065155.998865:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065155.998874:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc1470180 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f61 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065155.999389:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc146fdb3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d0e expref: 15 pid: 11461 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746065155.999408:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065155.999435:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263651456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1980us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065155.999442:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6120 00010000:00010000:1.0:1746065155.999956:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc146fee0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d7e expref: 29 pid: 12258 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746065155.999978:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065156.000002:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881263651200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2550us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065156.000009:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6119 00010000:00010000:0.0:1746065156.000011:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 15 pid: 13375 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.000022:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 15 pid: 13375 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.000034:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0xad6b7ddc146fef5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933da8 expref: 15 pid: 13375 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.000050:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.000052:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.000056:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.000063:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.000095:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065156.000105:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263388672:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065156.000215:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.000477:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263388800:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065156.000513:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065156.003733:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263651072:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15846us (20282us total) trans 17179873519 rc 0/0 00000100:00100000:1.0:1746065156.003746:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1341 00002000:00100000:1.0:1746065156.003755:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2330624->3145727) req@ffff880099bd7800 x1830881263651072/t17179873519(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:71/0 lens 488/448 e 0 to 0 dl 1746065166 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.003765:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7800 with x1830881263651072 ext(2330624->3145727) 00010000:00010000:1.0:1746065156.003806:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.003822:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746065156.003828:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd7800 00000100:00100000:2.0:1746065156.008691:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263388544:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.008725:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc1470179 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f68 expref: 40 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.008738:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc1470179 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f68 expref: 40 pid: 11461 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746065156.008739:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065155 -> 1746065156 00002000:00010000:3.0:1746065156.008742:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065155 -> 1746065156 00002000:00010000:3.0:1746065156.008744:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065155 -> 1746065156 00000100:00100000:3.0:1746065156.008755:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263388800:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.008761:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2200, rc 0) 00010000:00010000:3.0:1746065156.008787:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc1470180 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f61 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.008799:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc1470180 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f61 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.008807:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3400, rc 0) 00000100:00100000:2.0:1746065156.008815:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263651712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11233us (12228us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.008823:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13526 00000100:00100000:3.0:1746065156.008826:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263651584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9966us (12279us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065156.008831:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13527 00000100:00100000:0.0:1746065156.009068:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263388672:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065156.009079:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.009099:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263651328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10748us (10808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.009107:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6121 00000100:00100000:0.0:1746065156.010422:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.010470:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263651968 00000100:00100000:1.0:1746065156.010476:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263651968 00002000:00100000:1.0:1746065156.010503:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (585728->589823) req@ffff880099bd7100 x1830881263651968/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.010511:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7100 with x1830881263651968 ext(585728->589823) 00002000:00010000:1.0:1746065156.010515:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7100 00000100:00100000:1.0:1746065156.010558:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3894 00000100:00100000:1.0:1746065156.010564:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263651968:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065156.011042:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263651968:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 476us (622us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065156.011049:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3894 00002000:00100000:1.0:1746065156.011054:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (585728->589823) req@ffff880099bd7100 x1830881263651968/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.011066:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7100 with x1830881263651968 ext(585728->589823) 00002000:00010000:1.0:1746065156.011069:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7100 00000100:00100000:0.0:1746065156.013442:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.015074:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.015167:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.015205:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263652096 00000100:00100000:0.0:1746065156.015212:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263652096 00000100:00100000:0.0:1746065156.015245:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263652352 00000100:00100000:0.0:1746065156.015247:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263652352 00000100:00100000:0.0:1746065156.015261:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13528 00000100:00100000:0.0:1746065156.015267:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263652096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.015284:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.015297:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1470187 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f6f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065156.015341:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263388928:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065156.015409:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.015490:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13529 00000100:00100000:0.0:1746065156.015496:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263652352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.015504:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.015512:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab6e400/0xad6b7ddc147018e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f76 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065156.015536:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263389056:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065156.015558:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065156.017195:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263652224 00000100:00100000:1.0:1746065156.017202:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263652224 00010000:00010000:1.0:1746065156.017229:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.017254:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6122 00000100:00100000:1.0:1746065156.017260:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263652224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065156.017269:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065156.017284:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.017294:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.017313:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065156.017315:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065156.017321:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.017327:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.017351:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065156.017363:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263389184:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065156.017408:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.018543:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.018580:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263388928:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065156.018588:0:3067:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880097fa2680 x1830881263389056) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.018601:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1470187 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f6f expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.018606:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd000/0xad6b7ddc1470125 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2330624->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f29 expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.018610:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1470187 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f6f expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065156.018619:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263389056:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.018630:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f800, rc 0) 00000100:00100000:2.0:1746065156.018657:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263652096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3390us (5221us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.018667:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13528 00010000:00010000:0.0:1746065156.018723:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab6e400/0xad6b7ddc147018e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f76 expref: 40 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.018732:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab6e400/0xad6b7ddc147018e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f76 expref: 40 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.018739:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6e400, rc 0) 00000100:00100000:0.0:1746065156.018757:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263652352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3261us (3590us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065156.018763:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13529 00000100:00100000:1.0:1746065156.018828:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263652608 00000100:00100000:1.0:1746065156.018832:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263652608 00000100:00100000:3.0:1746065156.018847:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263389184:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065156.018856:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065156.018856:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (987136->991231) req@ffff88012dc3dc00 x1830881263652608/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.018864:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3dc00 with x1830881263652608 ext(987136->991231) 00002000:00010000:1.0:1746065156.018867:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3dc00 00000100:00100000:3.0:1746065156.018876:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881263652224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1615us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065156.018881:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3895 00000100:00100000:3.0:1746065156.018882:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6122 00000100:00100000:1.0:1746065156.018899:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263652608:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065156.019002:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263652608:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 115us (460us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065156.019007:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3895 00002000:00100000:1.0:1746065156.019011:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (987136->991231) req@ffff88012dc3dc00 x1830881263652608/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.019018:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3dc00 with x1830881263652608 ext(987136->991231) 00002000:00010000:1.0:1746065156.019020:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3dc00 00000100:00100000:0.0:1746065156.027305:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.027442:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263652864 00000100:00100000:3.0:1746065156.027450:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263652864 00000100:00100000:3.0:1746065156.027497:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4955 00000100:00100000:3.0:1746065156.027505:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+18:32398:x1830881263652864:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065156.028082:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+19:32398:x1830881263652864:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 576us (783us total) trans 8589936041 rc 0/0 00000100:00100000:3.0:1746065156.028090:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4955 00000100:00100000:2.0:1746065156.028332:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.028440:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263653120 00000100:00100000:0.0:1746065156.028445:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263653120 00002000:00100000:0.0:1746065156.028466:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880135221c00 x1830881263653120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.028475:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221c00 with x1830881263653120 ext(2097152->4194303) 00002000:00010000:0.0:1746065156.028479:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221c00 00000100:00100000:0.0:1746065156.028501:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3896 00000100:00100000:0.0:1746065156.028507:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263653120:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065156.029603:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.031294:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263653376 00000100:00100000:0.0:1746065156.031303:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263653376 00002000:00100000:0.0:1746065156.031335:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880135220a80 x1830881263653376/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.031344:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220a80 with x1830881263653376 ext(3145728->4194303) 00002000:00010000:0.0:1746065156.031348:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135220a80 00000100:00100000:0.0:1746065156.031364:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3897 00000100:00100000:0.0:1746065156.031370:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263653376:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065156.047962:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263653120:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 19447us (19623us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065156.047977:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3896 00002000:00100000:2.0:1746065156.047988:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880135221c00 x1830881263653120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.047998:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221c00 with x1830881263653120 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.048003:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221c00 00000100:00100000:2.0:1746065156.053077:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263653376:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 21699us (23468us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065156.053088:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3897 00002000:00100000:2.0:1746065156.053099:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880135220a80 x1830881263653376/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.053108:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220a80 with x1830881263653376 ext(3145728->4194303) 00002000:00010000:2.0:1746065156.053113:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135220a80 00000100:00100000:0.0:1746065156.062931:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.063033:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263653632 00000100:00100000:2.0:1746065156.063043:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263653632 00002000:00100000:2.0:1746065156.063084:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012dc3e300 x1830881263653632/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.063093:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3e300 with x1830881263653632 ext(4194304->5021695) 00002000:00010000:2.0:1746065156.063098:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3e300 00000100:00100000:2.0:1746065156.063116:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3898 00000100:00100000:2.0:1746065156.063124:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263653632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.074024:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263653632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10892us (11093us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065156.074035:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3898 00002000:00100000:2.0:1746065156.074045:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012dc3e300 x1830881263653632/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.074053:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3e300 with x1830881263653632 ext(4194304->5021695) 00002000:00010000:2.0:1746065156.074059:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3e300 00000100:00100000:0.0:1746065156.084256:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.085359:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263653888 00000100:00100000:3.0:1746065156.085368:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263653888 00000100:00100000:2.0:1746065156.086514:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4956 00000100:00100000:2.0:1746065156.086524:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+19:32394:x1830881263653888:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065156.088915:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+20:32394:x1830881263653888:12345-192.168.202.27@tcp:35:cat.0 Request processed in 2386us (4661us total) trans 8589936042 rc 0/0 00000100:00100000:2.0:1746065156.088926:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4956 00000100:00100000:0.0:1746065156.153351:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.153442:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263654144 00000100:00100000:3.0:1746065156.153451:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263654144 00000100:00100000:3.0:1746065156.153502:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13702 00000100:00100000:3.0:1746065156.153510:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+35:32405:x1830881263654144:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065156.153529:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.153544:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9400/0xad6b7ddc1470195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f7d expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.153608:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153618:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153628:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153640:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153645:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153650:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153726:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153734:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153740:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065156.153747:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065156.153838:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153845:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153853:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153857:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d9200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065156.153860:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153866:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153874:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065156.153877:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065156.153880:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153896:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147019c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153924:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153929:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153933:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153937:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065156.153939:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153943:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153953:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091b5d800) 00010000:00010000:3.0:1746065156.153955:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065156.153957:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153961:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.153991:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9400/0xad6b7ddc1470195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 38 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.154002:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 37 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.154007:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.154009:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065156.154011:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd81200, rc 0) 00000100:00100000:3.0:1746065156.154055:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+37:32405:x1830881263654144:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 546us (712us total) trans 8589936043 rc 0/0 00000100:00100000:3.0:1746065156.154061:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13702 00000100:00100000:0.0:1746065156.159636:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.159899:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263654400 00000100:00100000:1.0:1746065156.159907:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263654400 00000100:00100000:1.0:1746065156.159960:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13703 00000100:00100000:1.0:1746065156.159967:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+20:32406:x1830881263654400:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065156.159988:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065156.160004:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc14701b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f84 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.160091:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.160105:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.160112:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 21 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.160118:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.160124:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.160150:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.160161:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 36 pid: 13395 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.160171:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263389312:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065156.162324:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 21 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.162337:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 21 pid: 13395 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.162352:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263389440:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065156.164170:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.164183:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 8 pid: 13395 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.164194:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263389568:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065156.164853:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065156.164875:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263389312:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065156.166598:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.166658:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.166678:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263654528 00000100:00100000:0.0:1746065156.166683:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263654528 00010000:00010000:0.0:1746065156.166712:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 37 pid: 13395 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.166732:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263654656 00000100:00100000:0.0:1746065156.166734:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263654656 00010000:00010000:0.0:1746065156.166743:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 22 pid: 13395 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.166770:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6123 00000100:00100000:0.0:1746065156.166796:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263654528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.166805:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.166810:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 37 pid: 13395 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.166819:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 37 pid: 13395 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.166838:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14701aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f7d expref: 37 pid: 13395 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.166853:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065156.166858:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.166865:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.166871:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.166913:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263654528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.166920:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6123 00000100:00100000:0.0:1746065156.166933:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6124 00000100:00100000:0.0:1746065156.166938:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263654656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.166944:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.166948:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 22 pid: 13395 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.166955:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 22 pid: 13395 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.166965:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065156.166968:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.166973:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.166977:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.166989:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263654656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.166994:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6124 00000100:00100000:0.0:1746065156.167054:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.167066:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263654784 00000100:00100000:0.0:1746065156.167068:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263654784 00010000:00010000:0.0:1746065156.167078:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 9 pid: 13395 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.167095:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6125 00000100:00100000:0.0:1746065156.167100:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263654784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.167105:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.167108:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 9 pid: 13395 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.167116:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 9 pid: 13395 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.167126:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065156.167129:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.167135:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.167140:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.167152:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.167165:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263654784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.167170:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6125 00010000:00010000:1.0:1746065156.167869:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1470156 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f45 expref: 21 pid: 13395 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.167895:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263389440:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065156.167906:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166c00/0xad6b7ddc14700bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ec7 expref: 8 pid: 13395 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.167914:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263389568:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065156.167930:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.167937:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.167941:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065156.167960:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065156.168059:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc14701b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 22 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.168070:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 21 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.168076:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065156.168078:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065156.168081:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47000, rc 0) 00000100:00100000:1.0:1746065156.168104:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+21:32406:x1830881263654400:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8138us (8475us total) trans 8589936044 rc 0/0 00000100:00100000:1.0:1746065156.168111:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13703 00000100:00100000:0.0:1746065156.183584:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.183635:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263654912 00000100:00100000:2.0:1746065156.183642:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263654912 00000100:00100000:2.0:1746065156.183687:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13530 00000100:00100000:2.0:1746065156.183703:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+38:32405:x1830881263654912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065156.183718:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.183732:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f8b expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.183759:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.183765:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.183767:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.183770:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3342336->3727359] (req 3342336->3727359) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 39 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.183818:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.183828:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 17 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.183838:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263389696:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.183943:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.186048:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263389696:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.186072:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3342336->3727359] (req 3342336->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 39 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.186084:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:2.0:1746065156.186127:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+39:32405:x1830881263654912:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2433us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.186135:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13530 00000100:00100000:0.0:1746065156.188813:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.188951:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263655040 00000100:00100000:2.0:1746065156.188958:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263655040 00010000:00010000:2.0:1746065156.188986:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.189074:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6126 00000100:00100000:2.0:1746065156.189082:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263655040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.189097:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.189113:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.189126:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.189144:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc147016b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f53 expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.189192:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.189194:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.189200:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.189208:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.189238:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.189248:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263389824:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065156.189309:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.190614:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263389824:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065156.190628:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.190649:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263655040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1568us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.190656:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6126 00000100:00100000:0.0:1746065156.191331:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.191391:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263655296 00000100:00100000:2.0:1746065156.191395:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263655296 00002000:00100000:2.0:1746065156.191419:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3342336->3346431) req@ffff88012f09f480 x1830881263655296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.191428:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f480 with x1830881263655296 ext(3342336->3346431) 00002000:00010000:2.0:1746065156.191432:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f480 00000100:00100000:2.0:1746065156.191457:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3899 00000100:00100000:2.0:1746065156.191463:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263655296:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065156.191545:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263655296:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 81us (214us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065156.191550:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3899 00002000:00100000:2.0:1746065156.191554:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3342336->3346431) req@ffff88012f09f480 x1830881263655296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.191560:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f480 with x1830881263655296 ext(3342336->3346431) 00002000:00010000:2.0:1746065156.191563:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f480 00000100:00100000:2.0:1746065156.202738:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.202796:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.202960:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263655552 00000100:00100000:0.0:1746065156.202967:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263655552 00002000:00100000:0.0:1746065156.203000:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3723264->3727359) req@ffff880135223b80 x1830881263655552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.203009:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223b80 with x1830881263655552 ext(3723264->3727359) 00002000:00010000:0.0:1746065156.203013:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135223b80 00000100:00100000:0.0:1746065156.203029:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3900 00000100:00100000:0.0:1746065156.203035:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263655552:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065156.203145:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263655552:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 109us (415us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065156.203150:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3900 00002000:00100000:0.0:1746065156.203155:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3723264->3727359) req@ffff880135223b80 x1830881263655552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.203161:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223b80 with x1830881263655552 ext(3723264->3727359) 00002000:00010000:0.0:1746065156.203164:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135223b80 00000100:00100000:3.0:1746065156.203620:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263655680 00000100:00100000:3.0:1746065156.203624:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263655680 00000100:00100000:3.0:1746065156.203645:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13531 00000100:00100000:3.0:1746065156.203650:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+14:32406:x1830881263655680:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065156.203658:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.203671:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f92 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.203696:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.203704:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 15 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.203709:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.203711:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.203714:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2535424->2998271] (req 2535424->2998271) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.203735:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 15 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.203745:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 15 pid: 3067 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065156.203755:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263389952:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.203821:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.203828:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 25 pid: 9550 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.203835:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263390080:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.203851:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.206834:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263389952:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.206845:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263390080:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.206871:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2535424->2998271] (req 2535424->2998271) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.206894:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd81e00, rc 0) 00000100:00100000:3.0:1746065156.206941:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+15:32406:x1830881263655680:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3290us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.206948:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13531 00000100:00100000:0.0:1746065156.211463:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.211513:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.211840:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263655936 00000100:00100000:2.0:1746065156.211848:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263655936 00000100:00100000:2.0:1746065156.211895:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4957 00000100:00100000:2.0:1746065156.211902:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+36:32405:x1830881263655936:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065156.212074:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:32405:x1830881263655936:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 172us (617us total) trans 8589936045 rc 0/0 00000100:00100000:2.0:1746065156.212087:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4957 00000100:00100000:3.0:1746065156.212200:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263656064 00000100:00100000:3.0:1746065156.212204:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263656064 00010000:00010000:3.0:1746065156.212225:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 26 pid: 9550 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.212244:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6127 00000100:00100000:3.0:1746065156.212250:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263656064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.212258:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.212272:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 26 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.212287:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 26 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.212305:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60800/0xad6b7ddc147011e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f22 expref: 26 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.212325:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.212345:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263656064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.212350:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6127 00000100:00100000:1.0:1746065156.213423:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.213495:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263656192 00000100:00100000:3.0:1746065156.213500:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263656192 00010000:00010000:3.0:1746065156.213519:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 15 pid: 3067 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065156.214055:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6128 00000100:00100000:3.0:1746065156.214062:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263656192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.214073:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.214085:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 15 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746065156.214095:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 15 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746065156.214109:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1470133 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f37 expref: 15 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746065156.214119:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.214121:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.214126:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.214137:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.214164:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.214175:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263390208:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065156.214242:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.222050:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263390208:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065156.222070:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.222111:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+14:2005:x1830881263656192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8048us (8690us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.222120:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6128 00000100:00100000:0.0:1746065156.222567:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.222622:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263656448 00000100:00100000:1.0:1746065156.222628:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263656448 00002000:00100000:1.0:1746065156.222660:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2535424->2539519) req@ffff88012f09c700 x1830881263656448/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.222669:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c700 with x1830881263656448 ext(2535424->2539519) 00002000:00010000:1.0:1746065156.222673:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c700 00000100:00100000:1.0:1746065156.222699:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3901 00000100:00100000:1.0:1746065156.222705:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263656448:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065156.222828:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2004:x1830881263656448:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 122us (262us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065156.222834:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3901 00002000:00100000:1.0:1746065156.222839:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2535424->2539519) req@ffff88012f09c700 x1830881263656448/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.222846:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c700 with x1830881263656448 ext(2535424->2539519) 00002000:00010000:1.0:1746065156.222848:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09c700 00000100:00100000:0.0:1746065156.229865:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.229983:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263656704 00000100:00100000:2.0:1746065156.229992:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263656704 00002000:00100000:2.0:1746065156.230027:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2994176->2998271) req@ffff88012f09ca80 x1830881263656704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.230036:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ca80 with x1830881263656704 ext(2994176->2998271) 00002000:00010000:2.0:1746065156.230041:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ca80 00000100:00100000:2.0:1746065156.230059:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3902 00000100:00100000:2.0:1746065156.230066:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263656704:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065156.230192:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+14:2007:x1830881263656704:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 125us (333us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065156.230198:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3902 00002000:00100000:2.0:1746065156.230203:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2994176->2998271) req@ffff88012f09ca80 x1830881263656704/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.230210:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ca80 with x1830881263656704 ext(2994176->2998271) 00002000:00010000:2.0:1746065156.230213:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ca80 00000100:00100000:0.0:1746065156.255119:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.255546:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263656960 00000100:00100000:1.0:1746065156.255554:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263656960 00000100:00100000:1.0:1746065156.255753:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13704 00000100:00100000:1.0:1746065156.255761:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+21:32412:x1830881263656960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065156.255897:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065156.255913:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc14701db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933f99 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.255975:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.255987:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.255995:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256005:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256010:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256014:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256093:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc14701f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256103:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc14701f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256108:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc14701f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065156.256116:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065156.256176:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256182:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256187:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256192:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256196:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065156.256199:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256205:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256213:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065156.256215:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065156.256219:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256223:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc14701e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256523:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256529:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256534:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256538:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065156.256540:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256545:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256551:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5100) 00010000:00010000:1.0:1746065156.256553:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065156.256555:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256559:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46c00/0xad6b7ddc14701e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065156.256592:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc14701db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f99 expref: 24 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.256602:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc14701f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f99 expref: 23 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.256608:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065156.256610:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065156.256612:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46200, rc 0) 00000100:00100000:1.0:1746065156.257318:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+23:32412:x1830881263656960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1555us (2203us total) trans 8589936046 rc 0/0 00000100:00100000:1.0:1746065156.257325:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13704 00000100:00100000:0.0:1746065156.259705:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.259754:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.259800:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263657216 00000100:00100000:3.0:1746065156.259807:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263657216 00000100:00100000:2.0:1746065156.259932:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263657088 00000100:00100000:2.0:1746065156.259936:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263657088 00000100:00100000:2.0:1746065156.259958:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13532 00000100:00100000:2.0:1746065156.259964:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263657088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.259975:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.259987:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc14701fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fa0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.260030:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263390336:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065156.260090:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 724 00000100:00100000:3.0:1746065156.260096:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+23:2005:x1830881263657216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.260106:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.260122:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc14701f0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f99 expref: 23 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.260138:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.260141:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.260610:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.260867:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263657216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 769us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.260875:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 724 00000100:00100000:1.0:1746065156.261051:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.261078:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.261301:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263657472 00000100:00100000:2.0:1746065156.261301:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263657344 00000100:00100000:3.0:1746065156.261305:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263657472 00000100:00100000:2.0:1746065156.261305:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263657344 00000100:00100000:3.0:1746065156.261325:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13533 00000100:00100000:3.0:1746065156.261330:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263657472:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065156.261330:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13534 00000100:00100000:2.0:1746065156.261333:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263657344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065156.261339:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.261339:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.261349:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9400/0xad6b7ddc147020c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fae expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.261349:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc1470205 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fa7 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.261375:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263390464:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065156.261375:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263390592:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065156.261551:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.261667:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.263150:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263390336:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.263176:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc14701fe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fa0 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.263187:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc14701fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fa0 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746065156.263206:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065155 -> 1746065156 00002000:00010000:3.0:1746065156.263209:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065155 -> 1746065156 00000100:00100000:3.0:1746065156.263222:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263390464:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065156.263236:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9400/0xad6b7ddc147020c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fae expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.263244:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9400/0xad6b7ddc147020c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fae expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.263252:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d9400, rc 0) 00000100:00100000:3.0:1746065156.263293:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263657472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1961us (2213us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065156.263299:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13533 00010000:00010000:2.0:1746065156.263452:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73600, rc 0) 00000100:00100000:2.0:1746065156.263475:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263657088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3510us (3720us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.263480:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13532 00000100:00100000:2.0:1746065156.263510:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263390592:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.263525:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc1470205 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fa7 expref: 26 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.263533:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc1470205 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fa7 expref: 26 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.263540:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00000100:00100000:2.0:1746065156.263554:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263657344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2219us (2503us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.263558:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13534 00000100:00100000:0.0:1746065156.265373:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.266063:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263657600 00000100:00100000:2.0:1746065156.266070:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263657600 00000100:00100000:2.0:1746065156.266119:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13535 00000100:00100000:2.0:1746065156.266126:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:32414:x1830881263657600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.266140:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.266154:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fb5 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.266178:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.266185:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065156.266186:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065156.266189:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.266211:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 13 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.266222:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 13 pid: 9550 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.266232:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263390720:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.266315:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.266843:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.266878:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263657856 00000100:00100000:1.0:1746065156.266894:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263657856 00002000:00100000:1.0:1746065156.266929:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880134b02a00 x1830881263657856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 504/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.266938:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02a00 with x1830881263657856 ext(0->1048575) 00010000:00010000:1.0:1746065156.266943:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 14 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.266953:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 14 pid: 9550 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746065156.266958:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b02a00 00000100:00100000:1.0:1746065156.266982:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1342 00000100:00100000:1.0:1746065156.266988:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+14:2006:x1830881263657856:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.270487:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.270561:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263390720:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.270588:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.270606:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73800, rc 0) 00000100:00100000:3.0:1746065156.270700:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263657984 00000100:00100000:3.0:1746065156.270707:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263657984 00002000:00100000:3.0:1746065156.270737:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (585728->991231) req@ffff880135221f80 x1830881263657984/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.270745:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221f80 with x1830881263657984 ext(585728->991231) 00010000:00010000:3.0:1746065156.270751:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.270761:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746065156.270766:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135221f80 00000100:00100000:3.0:1746065156.270803:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1343 00000100:00100000:3.0:1746065156.270810:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263657984:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065156.271214:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:32414:x1830881263657600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5087us (5847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.271220:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13535 00000100:00100000:1.0:1746065156.273466:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263657856:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6299us (6444us total) trans 0 rc 643072/643072 00000100:00100000:1.0:1746065156.273477:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1342 00002000:00100000:1.0:1746065156.273487:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880134b02a00 x1830881263657856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 504/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:H/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.273502:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02a00 with x1830881263657856 ext(0->1048575) 00010000:00010000:1.0:1746065156.273510:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.273521:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746065156.273528:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b02a00 00000100:00100000:3.0:1746065156.276928:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+16:2005:x1830881263657984:12345-192.168.202.27@tcp:4:cat.0 Request processed in 6112us (6442us total) trans 21474840974 rc 0/0 00000100:00100000:3.0:1746065156.276937:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1343 00002000:00100000:3.0:1746065156.276946:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (585728->991231) req@ffff880135221f80 x1830881263657984/t21474840974(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.276958:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221f80 with x1830881263657984 ext(585728->991231) 00010000:00010000:3.0:1746065156.276968:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.276981:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746065156.276986:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135221f80 00000100:00100000:0.0:1746065156.285018:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.285115:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263658112 00000100:00100000:3.0:1746065156.285123:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263658112 00010000:00010000:3.0:1746065156.285158:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.285265:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6129 00000100:00100000:3.0:1746065156.285273:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263658112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.285286:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.285303:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.285313:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.285332:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1470172 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 585728->991231) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f5a expref: 16 pid: 9550 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.286100:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.286103:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.286110:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 25 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.286118:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 25 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.286146:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 25 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.286162:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263390848:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065156.286697:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.289431:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.289628:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263658368 00000100:00100000:3.0:1746065156.289635:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263658368 00002000:00100000:3.0:1746065156.289677:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880134b02300 x1830881263658368/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 504/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.289686:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02300 with x1830881263658368 ext(2097152->3145727) 00002000:00010000:3.0:1746065156.289690:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b02300 00000100:00100000:2.0:1746065156.289876:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263390848:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065156.289901:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.289945:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263658112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4672us (4934us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.289953:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6129 00000100:00100000:3.0:1746065156.290337:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3903 00000100:00100000:3.0:1746065156.290345:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263658368:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065156.308626:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+15:2006:x1830881263658368:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18274us (19194us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746065156.308635:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3903 00002000:00100000:3.0:1746065156.308644:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880134b02300 x1830881263658368/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 504/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.308653:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02300 with x1830881263658368 ext(2097152->3145727) 00002000:00010000:3.0:1746065156.308658:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b02300 00000100:00100000:0.0:1746065156.311169:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.311203:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.311227:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263658752 00000100:00100000:3.0:1746065156.311235:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263658752 00000100:00100000:0.0:1746065156.311237:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065156.311274:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880134b03800 x1830881263658752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.311282:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03800 with x1830881263658752 ext(0->1048575) 00002000:00010000:3.0:1746065156.311286:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b03800 00000100:00100000:3.0:1746065156.311300:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263658880 00000100:00100000:3.0:1746065156.311303:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263658880 00002000:00100000:3.0:1746065156.311312:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880134b02d80 x1830881263658880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.311319:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02d80 with x1830881263658880 ext(1048576->2097151) 00002000:00010000:3.0:1746065156.311321:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b02d80 00000100:00100000:3.0:1746065156.311335:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263659008 00000100:00100000:3.0:1746065156.311337:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263659008 00002000:00100000:3.0:1746065156.311346:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880134b01f80 x1830881263659008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.311351:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01f80 with x1830881263659008 ext(1048576->2097151) 00002000:00010000:3.0:1746065156.311353:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01f80 00000100:00100000:3.0:1746065156.311362:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3904 00000100:00100000:3.0:1746065156.311368:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263658752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.311455:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3905 00000100:00100000:2.0:1746065156.311463:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263658880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065156.312018:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3906 00000100:00100000:3.0:1746065156.312025:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263659008:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.314922:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.316893:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263659264 00000100:00100000:1.0:1746065156.316904:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263659264 00000100:00100000:1.0:1746065156.316949:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13536 00000100:00100000:1.0:1746065156.316956:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+17:32412:x1830881263659264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065156.316973:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065156.316988:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fbc expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.317014:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.317020:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065156.317022:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065156.317025:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.317053:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.317069:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 42 pid: 3067 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.317080:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263390976:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065156.317176:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.331317:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263658880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19848us (20106us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065156.331326:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3905 00002000:00100000:2.0:1746065156.331335:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880134b02d80 x1830881263658880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.331344:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02d80 with x1830881263658880 ext(1048576->2097151) 00002000:00010000:2.0:1746065156.331349:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b02d80 00000100:00100000:2.0:1746065156.331437:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.331453:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263659392 00000100:00100000:2.0:1746065156.331459:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263659392 00002000:00100000:2.0:1746065156.331482:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3342336->3727359) req@ffff880135222d80 x1830881263659392/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.331488:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222d80 with x1830881263659392 ext(3342336->3727359) 00010000:00010000:2.0:1746065156.331494:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.331506:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746065156.331512:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135222d80 00000100:00100000:2.0:1746065156.331525:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1344 00000100:00100000:2.0:1746065156.331531:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263659392:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065156.331728:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263390976:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.331747:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.331758:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47c00, rc 0) 00000100:00100000:0.0:1746065156.331795:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+18:32412:x1830881263659264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14840us (16881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.331800:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13536 00000100:00100000:3.0:1746065156.332153:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263658752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20783us (20992us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065156.332160:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3904 00002000:00100000:3.0:1746065156.332165:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880134b03800 x1830881263658752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.332171:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03800 with x1830881263658752 ext(0->1048575) 00002000:00010000:3.0:1746065156.332174:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b03800 00000100:00100000:3.0:1746065156.335267:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263659008:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23234us (24021us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065156.335277:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3906 00002000:00100000:3.0:1746065156.335285:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880134b01f80 x1830881263659008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.335293:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01f80 with x1830881263659008 ext(1048576->2097151) 00002000:00010000:3.0:1746065156.335298:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01f80 00000100:00100000:2.0:1746065156.343155:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263659392:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11612us (11706us total) trans 17179873520 rc 0/0 00000100:00100000:2.0:1746065156.343173:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1344 00002000:00100000:2.0:1746065156.343185:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3342336->3727359) req@ffff880135222d80 x1830881263659392/t17179873520(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.343195:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222d80 with x1830881263659392 ext(3342336->3727359) 00010000:00010000:2.0:1746065156.343207:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.343224:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746065156.343230:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135222d80 00000100:00100000:0.0:1746065156.346327:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.346441:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263659520 00000100:00100000:2.0:1746065156.346452:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263659520 00010000:00010000:2.0:1746065156.346495:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.346546:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6130 00000100:00100000:2.0:1746065156.346554:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263659520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.346572:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.346594:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.346605:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.346630:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc14701cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3342336->3727359) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f8b expref: 41 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.346652:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.346655:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.346663:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.346671:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.346707:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.346725:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263391104:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065156.347521:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.358588:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.358664:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263659648 00000100:00100000:2.0:1746065156.358674:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263659648 00000100:00100000:2.0:1746065156.358737:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13537 00000100:00100000:2.0:1746065156.358746:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263659648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.358766:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.358818:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1470221 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fc3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.358879:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263391232:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065156.361355:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.361413:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263391104:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065156.361439:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.361495:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263659520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 14940us (15180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.361506:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6130 00000100:00100000:0.0:1746065156.364632:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.364828:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263660032 00000100:00100000:2.0:1746065156.364839:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263660032 00002000:00100000:2.0:1746065156.364905:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880134b00e00 x1830881263660032/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.364915:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00e00 with x1830881263660032 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.364921:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00e00 00000100:00100000:2.0:1746065156.364960:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3907 00000100:00100000:2.0:1746065156.364968:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263660032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.366755:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.367851:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.368706:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263659776 00000100:00100000:0.0:1746065156.368716:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263659776 00000100:00100000:0.0:1746065156.368761:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13538 00000100:00100000:0.0:1746065156.368770:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263659776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.368809:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.368827:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fca expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.368850:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.368852:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.368860:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.368874:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.368899:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f7400, rc 0) 00000100:00100000:0.0:1746065156.368936:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263659776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 167us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.368942:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13538 00000100:00100000:3.0:1746065156.369131:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263660288 00000100:00100000:3.0:1746065156.369136:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263660288 00002000:00100000:3.0:1746065156.369166:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880134b00380 x1830881263660288/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.369176:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881263660288 ext(3145728->4194303) 00002000:00010000:3.0:1746065156.369181:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00380 00000100:00100000:3.0:1746065156.369196:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3908 00000100:00100000:3.0:1746065156.369201:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263660288:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.369307:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263391232:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.369333:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1470221 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fc3 expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.369345:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73400/0xad6b7ddc1470221 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fc3 expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.369357:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73400, rc 0) 00000100:00100000:2.0:1746065156.369378:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263659648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10634us (10802us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.369381:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13537 00000100:00100000:2.0:1746065156.379914:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263660032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14939us (15283us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065156.379925:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3907 00002000:00100000:2.0:1746065156.379934:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880134b00e00 x1830881263660032/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.379943:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00e00 with x1830881263660032 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.379948:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00e00 00000100:00100000:0.0:1746065156.383539:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.383610:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263660416 00000100:00100000:2.0:1746065156.383619:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263660416 00000100:00100000:2.0:1746065156.383659:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13539 00000100:00100000:2.0:1746065156.383665:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:32414:x1830881263660416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.383681:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.383696:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fd1 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.383720:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.383732:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065156.383734:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065156.383737:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.383761:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.383770:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.383801:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+15:2005:x1830881263660288:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14571us (17024us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065156.383801:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263391360:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.383814:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3908 00002000:00100000:3.0:1746065156.383825:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880134b00380 x1830881263660288/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.383841:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881263660288 ext(3145728->4194303) 00010000:00010000:3.0:1746065156.383850:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.383863:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746065156.383864:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746065156.383871:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b00380 00000100:00100000:2.0:1746065156.385414:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263391360:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.385437:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.385451:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:2.0:1746065156.385479:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:32414:x1830881263660416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1814us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.385487:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13539 00000100:00100000:0.0:1746065156.386179:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.386313:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263660544 00000100:00100000:3.0:1746065156.386320:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263660544 00002000:00100000:3.0:1746065156.386358:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2535424->2998271) req@ffff880134b02680 x1830881263660544/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.386366:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02680 with x1830881263660544 ext(2535424->2998271) 00010000:00010000:3.0:1746065156.386373:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.386384:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 15 pid: 3067 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746065156.386389:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b02680 00000100:00100000:3.0:1746065156.386414:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1345 00000100:00100000:3.0:1746065156.386420:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+15:2004:x1830881263660544:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065156.388548:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.388729:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263660672 00000100:00100000:2.0:1746065156.388735:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263660672 00000100:00100000:2.0:1746065156.388764:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13540 00000100:00100000:2.0:1746065156.388769:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+17:32412:x1830881263660672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.388798:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.388810:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fd8 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.388829:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065156.388831:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065156.388834:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.388844:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.388851:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72a00, rc 0) 00000100:00100000:2.0:1746065156.388896:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+18:32412:x1830881263660672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 126us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.388902:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13540 00000100:00100000:2.0:1746065156.398172:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263660544:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11743us (11985us total) trans 21474840975 rc 0/0 00000100:00100000:2.0:1746065156.398182:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1345 00002000:00100000:2.0:1746065156.398192:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2535424->2998271) req@ffff880134b02680 x1830881263660544/t21474840975(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.398201:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02680 with x1830881263660544 ext(2535424->2998271) 00010000:00010000:2.0:1746065156.398209:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.398223:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746065156.398230:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b02680 00000100:00100000:0.0:1746065156.406722:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.408898:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263660800 00000100:00100000:3.0:1746065156.408907:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263660800 00010000:00010000:3.0:1746065156.408969:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.409002:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6131 00000100:00100000:3.0:1746065156.409009:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263660800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.409022:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.409036:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.409045:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.409062:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14701d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2535424->2998271) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f92 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.409392:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.409394:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.409400:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.409407:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.409415:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.409416:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.409507:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.409514:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.409542:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.409553:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263391488:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065156.410524:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.410533:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263391616:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065156.410553:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.413912:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263391488:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065156.413923:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263391616:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065156.413937:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.414290:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263660800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4961us (7255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.414299:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6131 00000100:00100000:0.0:1746065156.417639:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.418157:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263661056 00000100:00100000:2.0:1746065156.418164:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263661056 00002000:00100000:2.0:1746065156.418203:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880099ec4e00 x1830881263661056/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.418211:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4e00 with x1830881263661056 ext(3145728->4194303) 00002000:00010000:2.0:1746065156.418215:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec4e00 00000100:00100000:2.0:1746065156.418290:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3909 00000100:00100000:2.0:1746065156.418297:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263661056:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.426412:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.426450:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.426664:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263661312 00000100:00100000:2.0:1746065156.426673:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263661312 00002000:00100000:2.0:1746065156.426708:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099ec5500 x1830881263661312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.426718:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5500 with x1830881263661312 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.426722:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec5500 00000100:00100000:2.0:1746065156.427243:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263661568 00000100:00100000:2.0:1746065156.427247:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263661568 00002000:00100000:2.0:1746065156.427261:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099ec6d80 x1830881263661568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.427268:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6d80 with x1830881263661568 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.427271:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec6d80 00000100:00100000:1.0:1746065156.427302:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3910 00000100:00100000:1.0:1746065156.427311:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263661312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.428012:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3911 00000100:00100000:2.0:1746065156.428020:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263661568:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.428750:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263661056:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10450us (11116us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065156.428757:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3909 00002000:00100000:0.0:1746065156.428764:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880099ec4e00 x1830881263661056/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.428785:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4e00 with x1830881263661056 ext(3145728->4194303) 00002000:00010000:0.0:1746065156.428789:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec4e00 00000100:00100000:0.0:1746065156.440452:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.440540:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263661696 00000100:00100000:2.0:1746065156.440547:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263661696 00000100:00100000:2.0:1746065156.440585:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13541 00000100:00100000:2.0:1746065156.440591:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263661696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.440607:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.440624:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fdf expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.440644:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.440645:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.440652:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.440665:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.440673:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:2.0:1746065156.441478:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263661696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 883us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.441486:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13541 00000100:00100000:1.0:1746065156.450468:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263661312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23150us (24054us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065156.450478:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3910 00002000:00100000:1.0:1746065156.450488:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099ec5500 x1830881263661312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.450496:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5500 with x1830881263661312 ext(2097152->4194303) 00002000:00010000:1.0:1746065156.450501:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec5500 00000100:00100000:0.0:1746065156.451761:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.454043:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263661952 00000100:00100000:1.0:1746065156.454053:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263661952 00002000:00100000:1.0:1746065156.454093:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880099ec6300 x1830881263661952/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.454102:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6300 with x1830881263661952 ext(4194304->5021695) 00002000:00010000:1.0:1746065156.454107:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec6300 00000100:00100000:1.0:1746065156.454142:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3912 00000100:00100000:1.0:1746065156.454149:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263661952:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065156.463222:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.464049:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263662208 00000100:00100000:2.0:1746065156.464056:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263662208 00000100:00100000:2.0:1746065156.464096:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13705 00000100:00100000:2.0:1746065156.464102:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+37:32416:x1830881263662208:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065156.464122:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.464136:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc1470244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fe6 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.464216:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.464229:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.464239:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065156.464248:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065156.464326:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc1470244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 40 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.464348:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 39 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.464355:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065156.464358:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065156.464360:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72000, rc 0) 00000100:00100000:2.0:1746065156.464395:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+39:32416:x1830881263662208:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 293us (1181us total) trans 8589936047 rc 0/0 00000100:00100000:2.0:1746065156.464401:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13705 00000100:00100000:1.0:1746065156.464689:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.464765:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263661952:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10615us (13007us total) trans 0 rc 827392/827392 00000100:00100000:0.0:1746065156.464788:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3912 00002000:00100000:0.0:1746065156.464796:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880099ec6300 x1830881263661952/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.464805:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6300 with x1830881263661952 ext(4194304->5021695) 00002000:00010000:0.0:1746065156.464809:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec6300 00000100:00100000:3.0:1746065156.464941:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263661568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36921us (38489us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065156.464947:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3911 00002000:00100000:3.0:1746065156.464952:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099ec6d80 x1830881263661568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.464959:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6d80 with x1830881263661568 ext(2097152->4194303) 00002000:00010000:3.0:1746065156.464962:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec6d80 00000100:00100000:2.0:1746065156.465584:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263662464 00000100:00100000:2.0:1746065156.465590:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263662464 00000100:00100000:2.0:1746065156.465621:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13706 00000100:00100000:2.0:1746065156.465627:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+22:32418:x1830881263662464:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065156.466333:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.466347:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc1470259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933fed expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.466397:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466406:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466414:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466424:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466429:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466434:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466501:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc147026e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466507:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc147026e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466512:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc147026e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065156.466517:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065156.466562:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466567:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466575:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466580:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065156.466584:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466588:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466595:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065156.466597:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065156.466600:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466604:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1470260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466612:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466616:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466620:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466623:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065156.466625:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466629:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466636:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a300) 00010000:00010000:2.0:1746065156.466637:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065156.466639:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466642:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470267 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065156.466664:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc1470259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fed expref: 25 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.466671:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc147026e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fed expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.466676:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065156.466677:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065156.466679:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4200, rc 0) 00000100:00100000:2.0:1746065156.466718:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+24:32418:x1830881263662464:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1091us (2029us total) trans 8589936048 rc 0/0 00000100:00100000:2.0:1746065156.466724:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13706 00000100:00100000:0.0:1746065156.473749:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.474930:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263662720 00000100:00100000:2.0:1746065156.474940:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263662720 00000100:00100000:2.0:1746065156.474995:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4958 00000100:00100000:2.0:1746065156.475002:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+24:32412:x1830881263662720:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065156.475196:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.475228:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.475232:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263663104 00000100:00100000:3.0:1746065156.475236:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263663104 00000100:00100000:3.0:1746065156.475259:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4959 00000100:00100000:0.0:1746065156.475262:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.475263:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+26:32418:x1830881263663104:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065156.475283:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263663360 00000100:00100000:0.0:1746065156.475285:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263663360 00002000:00100000:0.0:1746065156.475307:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880091a91c00 x1830881263663360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.475316:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91c00 with x1830881263663360 ext(4194304->5021695) 00002000:00010000:0.0:1746065156.475320:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a91c00 00000100:00100000:0.0:1746065156.475337:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3913 00000100:00100000:0.0:1746065156.475342:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263663360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065156.475363:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ccc4a269-0136-4970-860c-c944630694a4+27:32418:x1830881263663104:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 100us (168us total) trans 8589936050 rc 0/0 00000100:00100000:3.0:1746065156.475369:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4959 00000100:00100000:3.0:1746065156.475385:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263662848 00000100:00100000:3.0:1746065156.475387:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263662848 00000100:00100000:3.0:1746065156.475409:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 725 00000100:00100000:3.0:1746065156.475413:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+27:2006:x1830881263662848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.475420:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.475620:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc147026e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fed expref: 27 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.475632:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.475636:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.475652:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+26:2006:x1830881263662848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 239us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.475658:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 725 00000100:00100000:2.0:1746065156.476052:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+25:32412:x1830881263662720:12345-192.168.202.27@tcp:35:cat.0 Request processed in 1049us (2313us total) trans 8589936049 rc 0/0 00000100:00100000:2.0:1746065156.476058:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4958 00000100:00100000:2.0:1746065156.489399:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263663360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14048us (14127us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065156.489408:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3913 00002000:00100000:2.0:1746065156.489418:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880091a91c00 x1830881263663360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.489426:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91c00 with x1830881263663360 ext(4194304->5021695) 00002000:00010000:2.0:1746065156.489432:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a91c00 00000100:00100000:0.0:1746065156.499360:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.499476:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263663488 00000100:00100000:2.0:1746065156.499484:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263663488 00000100:00100000:2.0:1746065156.499523:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13542 00000100:00100000:2.0:1746065156.499531:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+27:32416:x1830881263663488:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065156.499547:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.499561:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ff4 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.499588:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.499596:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.499602:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.499604:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.499607:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3194880->3493887] (req 3194880->3493887) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.499631:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.499641:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 17 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.499652:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263391744:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.499765:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.499813:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 28 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.499824:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263391872:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.499871:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.502512:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263391744:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.502521:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263391872:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.502548:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3194880->3493887] (req 3194880->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.502561:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00000100:00100000:2.0:1746065156.503211:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:32416:x1830881263663488:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3062us (3243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.503224:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13542 00000100:00100000:0.0:1746065156.510659:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.514874:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263663616 00000100:00100000:3.0:1746065156.514891:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263663616 00010000:00010000:3.0:1746065156.514923:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.514958:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6132 00000100:00100000:3.0:1746065156.514964:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263663616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.514976:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.514992:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.515002:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.515019:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1470236 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd8 expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.515035:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.515072:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263663616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (4419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.515077:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6132 00000100:00100000:0.0:1746065156.515264:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.515518:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263663744 00000100:00100000:2.0:1746065156.515521:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263663744 00010000:00010000:2.0:1746065156.515535:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 28 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.515549:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6133 00000100:00100000:2.0:1746065156.515553:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263663744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.515560:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.515567:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 28 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.515575:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 28 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.515585:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147022f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fd1 expref: 28 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.515595:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.515597:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.515601:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.515607:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.515631:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.515641:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263392000:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065156.515683:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.526508:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263392000:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065156.526530:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.526568:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263663744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11013us (11303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.526578:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6133 00000100:00100000:1.0:1746065156.527869:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.528899:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263664000 00000100:00100000:2.0:1746065156.528908:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263664000 00002000:00100000:2.0:1746065156.528946:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3194880->3198975) req@ffff880129f42a00 x1830881263664000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.528955:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42a00 with x1830881263664000 ext(3194880->3198975) 00002000:00010000:2.0:1746065156.528959:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f42a00 00000100:00100000:2.0:1746065156.530225:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3914 00000100:00100000:2.0:1746065156.530239:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263664000:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065156.533350:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263664000:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 3107us (5475us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065156.533360:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3914 00002000:00100000:2.0:1746065156.533370:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3194880->3198975) req@ffff880129f42a00 x1830881263664000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.533379:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42a00 with x1830881263664000 ext(3194880->3198975) 00002000:00010000:2.0:1746065156.533384:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f42a00 00000100:00100000:0.0:1746065156.536286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.536398:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263664256 00000100:00100000:2.0:1746065156.536407:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263664256 00002000:00100000:2.0:1746065156.536449:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (3489792->3493887) req@ffff880097d04380 x1830881263664256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.536464:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04380 with x1830881263664256 ext(3489792->3493887) 00002000:00010000:2.0:1746065156.536468:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04380 00000100:00100000:3.0:1746065156.537199:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3915 00000100:00100000:3.0:1746065156.537211:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263664256:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065156.538144:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263664256:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 931us (1863us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065156.538152:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3915 00002000:00100000:3.0:1746065156.538160:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3489792->3493887) req@ffff880097d04380 x1830881263664256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.538169:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04380 with x1830881263664256 ext(3489792->3493887) 00002000:00010000:3.0:1746065156.538173:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04380 00000100:00100000:0.0:1746065156.591753:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.591929:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263664384 00000100:00100000:2.0:1746065156.591937:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263664384 00000100:00100000:1.0:1746065156.594498:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13543 00000100:00100000:1.0:1746065156.594513:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+18:32418:x1830881263664384:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065156.594529:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065156.594545:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd933ffb expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.594569:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.594576:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 40 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065156.594582:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065156.594587:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065156.594589:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065156.594591:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1888256->2097151] (req 1888256->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.594613:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065156.594622:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 11 pid: 13375 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746065156.594632:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263392128:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065156.594713:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 40 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065156.594720:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 40 pid: 3067 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746065156.594726:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263392256:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065156.594744:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.594750:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 19 pid: 13375 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.594756:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263392384:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065156.594765:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065156.600073:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263392128:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065156.600084:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263392256:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065156.600090:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263392384:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065156.600115:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [1888256->2097151] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.600135:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6200, rc 0) 00000100:00100000:1.0:1746065156.600181:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+19:32418:x1830881263664384:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5673us (8435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065156.600188:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13543 00000100:00100000:0.0:1746065156.611030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.611057:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.611084:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.611102:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263664512 00000100:00100000:0.0:1746065156.611109:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263664512 00010000:00010000:0.0:1746065156.611138:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 12 pid: 13375 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746065156.611159:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263664640 00000100:00100000:0.0:1746065156.611161:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263664640 00010000:00010000:0.0:1746065156.611168:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 19 pid: 13375 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.611185:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6134 00000100:00100000:0.0:1746065156.611191:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263664512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.611202:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.611220:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 12 pid: 13375 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.611230:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 12 pid: 13375 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.611252:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14700ca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ed5 expref: 12 pid: 13375 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.611268:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.611305:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263664512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 114us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.611310:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6134 00000100:00100000:0.0:1746065156.611323:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6135 00000100:00100000:0.0:1746065156.611327:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263664640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.611333:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.611338:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 19 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.611345:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 19 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.611353:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166400/0xad6b7ddc14700a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eb9 expref: 19 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.611360:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.611369:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263664640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.611373:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6135 00000100:00100000:3.0:1746065156.611851:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263664896 00000100:00100000:3.0:1746065156.611855:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263664896 00000100:00100000:3.0:1746065156.611894:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13707 00000100:00100000:3.0:1746065156.611899:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+25:32424:x1830881263664896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065156.611915:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.611926:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147028a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934002 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.611979:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.611989:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.611996:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612007:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612012:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612017:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612090:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc147029f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612098:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc147029f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612103:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc147029f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065156.612110:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065156.612165:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612170:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612175:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612180:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065156.612182:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612187:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612194:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065156.612196:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065156.612199:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612203:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c400/0xad6b7ddc1470291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612214:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612218:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612222:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612225:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065156.612227:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612232:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612236:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c7abc00) 00010000:00010000:3.0:1746065156.612238:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065156.612239:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612243:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1470298 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065156.612270:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147028a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934002 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.612279:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc147029f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934002 expref: 27 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.612284:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.612286:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065156.612287:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd81e00, rc 0) 00000100:00100000:3.0:1746065156.612310:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+27:32424:x1830881263664896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 411us (1287us total) trans 8589936051 rc 0/0 00000100:00100000:3.0:1746065156.612315:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13707 00000100:00100000:0.0:1746065156.614145:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.614163:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263665024 00000100:00100000:0.0:1746065156.614169:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263665024 00010000:00010000:0.0:1746065156.614191:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746065156.614211:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6136 00000100:00100000:0.0:1746065156.614217:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263665024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.614226:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.614239:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.614247:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.614261:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1470102 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f06 expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.614271:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.614273:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.614279:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.614285:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.614312:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065156.614323:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263392512:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065156.614500:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.614516:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263665152 00000100:00100000:1.0:1746065156.614519:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263665152 00000100:00100000:1.0:1746065156.614540:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 726 00000100:00100000:1.0:1746065156.614545:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+27:2007:x1830881263665152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065156.614552:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065156.614564:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc147029f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934002 expref: 27 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065156.614579:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065156.614582:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065156.614598:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+26:2007:x1830881263665152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065156.614604:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 726 00000100:00100000:1.0:1746065156.624064:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.624111:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.624132:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.624147:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263665280 00000100:00100000:1.0:1746065156.624154:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263665280 00000100:00100000:2.0:1746065156.624171:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263665408 00000100:00100000:2.0:1746065156.624176:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263665408 00000100:00100000:3.0:1746065156.624187:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.624189:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13544 00000100:00100000:1.0:1746065156.624200:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263665280:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065156.624205:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263665664 00000100:00100000:3.0:1746065156.624208:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263665664 00010000:00010000:1.0:1746065156.624215:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746065156.624230:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1888256->1892351) req@ffff880097a6ea00 x1830881263665664/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746065156.624230:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14702ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934009 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065156.624239:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ea00 with x1830881263665664 ext(1888256->1892351) 00002000:00010000:3.0:1746065156.624243:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6ea00 00000100:00100000:3.0:1746065156.624254:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3916 00000100:00100000:3.0:1746065156.624258:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263665664:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065156.624274:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263392640:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065156.624325:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.624347:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263665664:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 88us (159us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065156.624354:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3916 00002000:00100000:3.0:1746065156.624360:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1888256->1892351) req@ffff880097a6ea00 x1830881263665664/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.624366:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ea00 with x1830881263665664 ext(1888256->1892351) 00002000:00010000:3.0:1746065156.624369:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6ea00 00000100:00100000:2.0:1746065156.624434:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13545 00000100:00100000:2.0:1746065156.624441:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263665408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.624449:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.624457:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14702b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934010 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.624484:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263392768:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065156.624486:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263392512:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065156.624500:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.625107:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263665024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10889us (10965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.625120:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.625410:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6136 00002000:00010000:1.0:1746065156.629850:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065155 -> 1746065156 00002000:00010000:1.0:1746065156.629856:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065155 -> 1746065156 00002000:00010000:1.0:1746065156.629858:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065155 -> 1746065156 00000100:00100000:1.0:1746065156.629876:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263392640:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065156.629912:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14702ad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934009 expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065156.629924:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14702ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934009 expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065156.629936:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2400, rc 0) 00000100:00100000:1.0:1746065156.629979:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263665280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5783us (5873us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065156.629987:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13544 00000100:00100000:2.0:1746065156.630147:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263392768:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.630168:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14702b4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934010 expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.630176:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc14702b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934010 expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.630200:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5ce800, rc 0) 00000100:00100000:2.0:1746065156.630221:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263665408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5781us (6089us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.630226:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13545 00000100:00100000:2.0:1746065156.635534:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.635597:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263665792 00000100:00100000:0.0:1746065156.635605:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263665792 00000100:00100000:0.0:1746065156.637058:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13546 00000100:00100000:0.0:1746065156.637071:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+18:32418:x1830881263665792:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065156.637086:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.637101:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934017 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.637127:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.637135:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.637141:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.637142:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.637146:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->1585151] (req 1048576->1585151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.637170:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.637185:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 39 pid: 9550 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746065156.637195:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263392896:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.638025:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.638033:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 19 pid: 9548 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.638041:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263393024:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065156.638061:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a93c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.652124:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.652176:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.652196:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263666048 00000100:00100000:0.0:1746065156.652202:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263666048 00010000:00010000:0.0:1746065156.652227:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 40 pid: 9550 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746065156.652247:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6137 00000100:00100000:0.0:1746065156.652253:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263666048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.652267:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.652282:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 40 pid: 9550 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.652297:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 40 pid: 9550 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.652318:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.652348:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263666048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.652358:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6137 00000100:00100000:1.0:1746065156.652589:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263665920 00000100:00100000:1.0:1746065156.652593:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263665920 00000100:00100000:1.0:1746065156.652613:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13547 00000100:00100000:1.0:1746065156.652618:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263665920:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065156.652630:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065156.652639:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc14702c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93401e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065156.652674:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263393152:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065156.652730:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880076cdb9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065156.652804:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470164 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f4c expref: 41 pid: 9550 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746065156.652817:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263392896:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065156.653274:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.653892:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.653914:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263666304 00000100:00100000:0.0:1746065156.653917:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263666304 00002000:00100000:0.0:1746065156.653940:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800957db800 x1830881263666304/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.653948:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db800 with x1830881263666304 ext(0->1048575) 00002000:00010000:0.0:1746065156.653952:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957db800 00000100:00100000:0.0:1746065156.653962:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263666560 00000100:00100000:0.0:1746065156.653964:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263666560 00002000:00100000:0.0:1746065156.653974:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1888255) req@ffff8800957da300 x1830881263666560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.653981:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881263666560 ext(1048576->1888255) 00002000:00010000:0.0:1746065156.653983:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:0.0:1746065156.653997:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3917 00000100:00100000:0.0:1746065156.654002:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263666304:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.654539:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3918 00000100:00100000:0.0:1746065156.654546:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263666560:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.660865:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263393024:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.660901:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->1585151] (req 1048576->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 21 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.660916:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656e400, rc 0) 00000100:00100000:2.0:1746065156.660959:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+21:32418:x1830881263665792:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 23891us (25432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.660966:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13546 00000100:00100000:2.0:1746065156.661365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.661439:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263393152:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.661458:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc14702c2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93401e expref: 40 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.661468:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3200/0xad6b7ddc14702c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93401e expref: 40 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.661476:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3200, rc 0) 00000100:00100000:2.0:1746065156.661493:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263665920:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8875us (9381us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.661499:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13547 00000100:00100000:0.0:1746065156.661720:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263666688 00000100:00100000:0.0:1746065156.661725:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263666688 00000100:00100000:0.0:1746065156.661853:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13708 00000100:00100000:0.0:1746065156.661861:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32428:x1830881263666688:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065156.661877:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.661899:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6cd600/0xad6b7ddc14702c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934025 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.661943:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.661954:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.661962:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.661971:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.661977:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.661982:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.662033:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.662042:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 25 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.662052:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 38 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.662058:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 5/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.662081:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 38 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.662089:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 38 pid: 7203 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.662098:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263393280:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.662147:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 25 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.662154:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 25 pid: 7203 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.662161:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263393408:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065156.662178:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.671315:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.673330:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263666304:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19321us (20050us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065156.673341:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3917 00002000:00100000:1.0:1746065156.673350:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff8800957db800 x1830881263666304/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.673358:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db800 with x1830881263666304 ext(0->1048575) 00002000:00010000:1.0:1746065156.673363:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957db800 00000100:00100000:2.0:1746065156.674210:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263666816 00000100:00100000:2.0:1746065156.674219:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263666816 00010000:00010000:2.0:1746065156.674247:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 21 pid: 9548 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.674276:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6138 00000100:00100000:2.0:1746065156.674283:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263666816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.674297:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.674312:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 21 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.674322:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 21 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.674341:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14700fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933eff expref: 21 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.674356:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.674358:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.674364:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.674371:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.674398:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.674413:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263393536:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065156.674809:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.674846:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263393280:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.678979:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263393408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.679012:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065156.680557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.680580:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.680595:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263667200 00000100:00100000:2.0:1746065156.680601:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263667200 00000100:00100000:1.0:1746065156.680609:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.680645:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263667328 00000100:00100000:3.0:1746065156.680648:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263667328 00000100:00100000:3.0:1746065156.680675:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13548 00000100:00100000:3.0:1746065156.680682:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+39:32427:x1830881263667328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065156.680698:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.680712:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93402c expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065156.680744:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263667072 00000100:00100000:0.0:1746065156.680748:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263667072 00010000:00010000:0.0:1746065156.680766:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 26 pid: 7203 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.680798:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6139 00010000:00010000:3.0:1746065156.680800:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065156.680804:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263667072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.680807:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065156.680809:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065156.680812:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.680812:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.680816:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 26 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.680825:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 26 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.680839:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14701bf lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f84 expref: 26 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.680852:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065156.680856:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.680863:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.680868:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.680871:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065156.680886:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.680898:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 20 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.680909:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263393664:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065156.680914:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263667072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.680920:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6139 00000100:00100000:0.0:1746065156.681366:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263666560:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26815us (27469us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746065156.681373:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3918 00002000:00100000:0.0:1746065156.681380:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1888255) req@ffff8800957da300 x1830881263666560/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.681388:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881263666560 ext(1048576->1888255) 00010000:00010000:0.0:1746065156.681393:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 19 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.681401:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 19 pid: 11461 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746065156.681406:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957da300 00000100:00100000:3.0:1746065156.681568:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065156.681590:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263393536:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065156.681607:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065156.681627:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263666816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7345us (10318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.681632:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4960 00000100:00100000:1.0:1746065156.681633:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6138 00000100:00100000:2.0:1746065156.681639:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+39:8522:x1830881263667200:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065156.682616:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+40:8522:x1830881263667200:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 975us (2060us total) trans 8589936052 rc 0/0 00000100:00100000:2.0:1746065156.682623:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4960 00000100:00100000:1.0:1746065156.685747:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.685812:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263667584 00000100:00100000:0.0:1746065156.685819:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263667584 00002000:00100000:0.0:1746065156.685851:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1581056->1585151) req@ffff880129f43100 x1830881263667584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.685860:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43100 with x1830881263667584 ext(1581056->1585151) 00002000:00010000:0.0:1746065156.685864:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f43100 00000100:00100000:0.0:1746065156.685886:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3919 00000100:00100000:0.0:1746065156.685893:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263667584:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.686117:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263667584:12345-192.168.202.27@tcp:3:cat.0 Request processed in 224us (377us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065156.686123:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3919 00002000:00100000:0.0:1746065156.686128:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1581056->1585151) req@ffff880129f43100 x1830881263667584/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.686135:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43100 with x1830881263667584 ext(1581056->1585151) 00002000:00010000:0.0:1746065156.686138:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f43100 00000100:00100000:0.0:1746065156.688368:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.688454:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263667712 00000100:00100000:2.0:1746065156.688461:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263667712 00000100:00100000:3.0:1746065156.688479:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263393664:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.688488:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 40 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.688500:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.688512:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3de00, rc 0) 00000100:00100000:2.0:1746065156.688524:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6140 00000100:00100000:2.0:1746065156.688530:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263667712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.688540:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.688545:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 40 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.688558:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 40 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.688575:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72000/0xad6b7ddc147024b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fe6 expref: 40 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.688591:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065156.688595:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.688603:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.688609:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.688626:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.689213:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+40:32427:x1830881263667328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8529us (8601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.689213:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800983ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263667712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 681us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.689220:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13548 00000100:00100000:2.0:1746065156.689221:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6140 00010000:00010000:2.0:1746065156.689241:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689248:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065156.689286:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065156.689290:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065156.689304:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689316:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689324:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689329:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689334:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689339:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689343:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd2800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065156.689346:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689352:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689360:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065156.689363:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065156.689366:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689370:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2800/0xad6b7ddc14702d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689380:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689384:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689389:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689393:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd2600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065156.689395:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689400:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689405:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800928a2e00) 00010000:00010000:2.0:1746065156.689407:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065156.689409:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689414:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd2600/0xad6b7ddc14702d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065156.689442:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6cd600/0xad6b7ddc14702c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.689453:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.689458:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065156.689460:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065156.689462:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3a00, rc 0) 00000100:00100000:2.0:1746065156.689500:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32428:x1830881263666688:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 27639us (28135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.689506:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13708 00000100:00100000:2.0:1746065156.690344:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.690373:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263667840 00000100:00100000:2.0:1746065156.690377:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263667840 00002000:00100000:2.0:1746065156.690402:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1888256->2097151) req@ffff880135222a00 x1830881263667840/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.690411:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222a00 with x1830881263667840 ext(1888256->2097151) 00010000:00010000:2.0:1746065156.690418:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.690428:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746065156.690434:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135222a00 00000100:00100000:2.0:1746065156.690733:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1346 00000100:00100000:2.0:1746065156.690740:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263667840:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065156.697292:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.697435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.698016:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263668096 00000100:00100000:3.0:1746065156.698025:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263668096 00000100:00100000:3.0:1746065156.698061:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4961 00000100:00100000:3.0:1746065156.698067:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+25:32418:x1830881263668096:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065156.699632:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+26:32418:x1830881263668096:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1558us (2343us total) trans 8589936053 rc 0/0 00000100:00100000:3.0:1746065156.699642:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4961 00000100:00100000:3.0:1746065156.699670:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263668224 00000100:00100000:3.0:1746065156.699675:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263668224 00000100:00100000:3.0:1746065156.699698:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13549 00000100:00100000:3.0:1746065156.699703:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263668224:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065156.699716:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.699734:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934033 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.699757:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.699759:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.699766:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 15 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.699794:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 15 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.699803:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d000, rc 0) 00000100:00100000:3.0:1746065156.700712:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263668224:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1004us (3273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.700718:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13549 00000100:00100000:0.0:1746065156.701114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.701139:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.701153:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.701168:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.701665:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.701915:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263668352 00000100:00100000:3.0:1746065156.701921:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263668352 00000100:00100000:3.0:1746065156.701950:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263668480 00000100:00100000:3.0:1746065156.701952:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263668480 00000100:00100000:3.0:1746065156.701962:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263668608 00000100:00100000:3.0:1746065156.701963:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263668608 00000100:00100000:3.0:1746065156.701972:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263668736 00000100:00100000:3.0:1746065156.701974:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263668736 00000100:00100000:3.0:1746065156.701981:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263668864 00000100:00100000:3.0:1746065156.701983:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263668864 00000100:00100000:3.0:1746065156.701994:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13550 00000100:00100000:3.0:1746065156.701999:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263668352:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065156.702012:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.702024:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14702f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93403a expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.702064:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263393792:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065156.702117:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.702132:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13551 00000100:00100000:3.0:1746065156.702137:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263668480:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065156.702144:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.702150:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14702fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934041 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.702169:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263393920:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065156.702185:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.702198:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13552 00000100:00100000:3.0:1746065156.702202:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263668608:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065156.702208:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.702215:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934048 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.702226:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.702228:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.702234:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.702246:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.702253:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a400, rc 0) 00000100:00100000:3.0:1746065156.702271:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263668608:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 68us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.702276:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13552 00000100:00100000:3.0:1746065156.702286:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13553 00000100:00100000:3.0:1746065156.702290:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263668736:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065156.702295:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.702300:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc1470308 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93404f expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.702320:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263394048:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065156.702337:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.702354:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13554 00000100:00100000:3.0:1746065156.702359:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263668864:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065156.702365:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.702370:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934056 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.702378:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.702379:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.702383:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 16 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.702392:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 16 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.702398:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683aa00, rc 0) 00000100:00100000:3.0:1746065156.702411:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263668864:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 52us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.702416:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13554 00000100:00100000:1.0:1746065156.702733:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.702749:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263669120 00000100:00100000:1.0:1746065156.702752:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263669120 00002000:00100000:1.0:1746065156.702787:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1585152->2097151) req@ffff880129f40e00 x1830881263669120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.702796:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40e00 with x1830881263669120 ext(1585152->2097151) 00002000:00010000:1.0:1746065156.702799:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40e00 00000100:00100000:1.0:1746065156.702810:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3920 00000100:00100000:1.0:1746065156.702816:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263669120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.704419:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263667840:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13674us (14072us total) trans 17179873521 rc 0/0 00000100:00100000:2.0:1746065156.704428:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1346 00002000:00100000:2.0:1746065156.704435:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1888256->2097151) req@ffff880135222a00 x1830881263667840/t17179873521(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.704443:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222a00 with x1830881263667840 ext(1888256->2097151) 00010000:00010000:2.0:1746065156.704450:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 22 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.704465:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 22 pid: 11461 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746065156.704470:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135222a00 00000100:00100000:1.0:1746065156.708649:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263669120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5823us (5907us total) trans 0 rc 512000/512000 00000100:00100000:1.0:1746065156.708659:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3920 00002000:00100000:1.0:1746065156.708668:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1585152->2097151) req@ffff880129f40e00 x1830881263669120/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 512000/512000 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.708676:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40e00 with x1830881263669120 ext(1585152->2097151) 00002000:00010000:1.0:1746065156.708681:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40e00 00000100:00100000:3.0:1746065156.709172:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263393792:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065156.709198:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14702f3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93403a expref: 15 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.709208:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc14702f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93403a expref: 15 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.709220:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c600, rc 0) 00000100:00100000:3.0:1746065156.709242:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263668352:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7243us (8129us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065156.709247:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13550 00002000:00010000:2.0:1746065156.709450:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime: 1746065155 -> 1746065156 00002000:00010000:2.0:1746065156.709454:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime: 1746065155 -> 1746065156 00000100:00100000:2.0:1746065156.709461:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263393920:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.709474:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14702fa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934041 expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.709481:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14702fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934041 expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.709490:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683be00, rc 0) 00000100:00100000:2.0:1746065156.709506:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263668480:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7368us (8367us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.709511:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13551 00000100:00100000:2.0:1746065156.709923:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263394048:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065156.709938:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc1470308 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93404f expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.709946:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc1470308 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93404f expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.709956:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683bc00, rc 0) 00000100:00100000:2.0:1746065156.709981:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263668736:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7690us (8813us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065156.709986:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13553 00000100:00100000:0.0:1746065156.722153:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.722191:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.722274:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263669504 00000100:00100000:3.0:1746065156.722282:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263669504 00000100:00100000:3.0:1746065156.722317:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13709 00000100:00100000:3.0:1746065156.722323:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32428:x1830881263669504:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065156.722339:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.722353:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc1470316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93405d expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.722426:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.722438:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.722445:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.722467:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.722475:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 10 pid: 7203 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.722485:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263394176:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.722551:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.725244:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.725337:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263669632 00000100:00100000:3.0:1746065156.725344:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263669632 00000100:00100000:2.0:1746065156.725507:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263669248 00000100:00100000:2.0:1746065156.725511:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263669248 00010000:00010000:2.0:1746065156.725532:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 20 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.725560:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6141 00000100:00100000:2.0:1746065156.725566:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263669248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.725576:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.725592:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 20 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.725601:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 20 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.725620:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6200/0xad6b7ddc1470283 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ffb expref: 20 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.725632:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.725634:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.725639:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.725651:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.725676:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.725685:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263394304:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065156.725743:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.726171:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13555 00000100:00100000:3.0:1746065156.726177:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+17:32424:x1830881263669632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065156.726188:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.726198:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934064 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.726212:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.726222:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065156.726223:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065156.726226:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.726241:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.726249:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 26 pid: 9548 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.726256:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263394432:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.726295:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.728710:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.728790:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263394176:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.728807:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065156.729037:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263669760 00000100:00100000:0.0:1746065156.729042:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263669760 00010000:00010000:0.0:1746065156.729064:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 11 pid: 7203 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.729085:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6142 00000100:00100000:0.0:1746065156.729092:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263669760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.729103:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.729108:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 11 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.729116:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 11 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.729135:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc14702de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934025 expref: 11 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.729157:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065156.729161:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.729169:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.729175:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.729334:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.729375:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2005:x1830881263669760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 283us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.729381:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6142 00010000:00010000:3.0:1746065156.729693:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.729700:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065156.729716:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065156.729855:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc1470316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93405d expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.729869:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93405d expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.729875:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.729877:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065156.729889:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683be00, rc 0) 00000100:00100000:3.0:1746065156.729916:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32428:x1830881263669504:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7592us (7725us total) trans 8589936054 rc 0/0 00000100:00100000:3.0:1746065156.729921:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13709 00000100:00100000:3.0:1746065156.731126:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263394432:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.731144:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.731155:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683ba00, rc 0) 00000100:00100000:3.0:1746065156.731186:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+18:32424:x1830881263669632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5009us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.731193:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13555 00000100:00100000:0.0:1746065156.731682:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.731852:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263669888 00000100:00100000:1.0:1746065156.731857:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263669888 00002000:00100000:1.0:1746065156.731893:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3194880->3493887) req@ffff8800a50fc050 x1830881263669888/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.731901:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50fc050 with x1830881263669888 ext(3194880->3493887) 00010000:00010000:1.0:1746065156.731907:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 27 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.731916:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 27 pid: 9548 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746065156.731921:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a50fc050 00000100:00100000:1.0:1746065156.731940:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1347 00000100:00100000:1.0:1746065156.731945:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263669888:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065156.732303:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263394304:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065156.732315:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.732343:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263669248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6777us (10197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.732350:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6141 00000100:00100000:1.0:1746065156.739845:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263669888:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7889us (8155us total) trans 21474840976 rc 0/0 00000100:00100000:1.0:1746065156.739861:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1347 00002000:00100000:1.0:1746065156.739871:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3194880->3493887) req@ffff8800a50fc050 x1830881263669888/t21474840976(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.739889:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50fc050 with x1830881263669888 ext(3194880->3493887) 00010000:00010000:1.0:1746065156.739898:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 29 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.739909:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 29 pid: 9548 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746065156.739915:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a50fc050 00000100:00100000:0.0:1746065156.739930:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.740030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.740141:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263670400 00000100:00100000:3.0:1746065156.740147:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263670400 00000100:00100000:3.0:1746065156.740558:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13710 00000100:00100000:3.0:1746065156.740566:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32428:x1830881263670400:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065156.740583:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.740586:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065156.740604:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147031d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93405d expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.740616:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.740619:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065156.740629:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1470332 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93406b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.740702:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.740712:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.740719:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065156.740727:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065156.740817:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1470332 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.740826:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065156.740828:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263670144 00000100:00100000:1.0:1746065156.740831:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263670144 00010000:00010000:3.0:1746065156.740832:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.740834:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065156.740836:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a800, rc 0) 00002000:00100000:1.0:1746065156.740849:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009aec8e00 x1830881263670144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065156.740855:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8e00 with x1830881263670144 ext(1048576->2097151) 00002000:00010000:1.0:1746065156.740859:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8e00 00000100:00100000:3.0:1746065156.742137:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32428:x1830881263670400:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1568us (2103us total) trans 8589936055 rc 0/0 00000100:00100000:3.0:1746065156.742145:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13710 00000100:00100000:2.0:1746065156.742235:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3921 00000100:00100000:2.0:1746065156.742917:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263670144:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.750933:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.750981:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.751173:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263670528 00000100:00100000:2.0:1746065156.751181:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263670528 00010000:00010000:2.0:1746065156.751211:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 29 pid: 9548 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.751244:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6143 00000100:00100000:3.0:1746065156.751249:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263670656 00000100:00100000:2.0:1746065156.751251:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263670528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065156.751252:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263670656 00010000:00010000:2.0:1746065156.751264:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065156.751278:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13711 00010000:00010000:2.0:1746065156.751281:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 29 pid: 9548 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.751283:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32428:x1830881263670656:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065156.751292:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 29 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.751298:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.751310:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147027c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3194880->3493887) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ff4 expref: 29 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.751312:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc1470347 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934072 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.751337:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.751339:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.751344:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 17 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.751351:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc1470347 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934072 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.751351:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 17 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.751361:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc1470347 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934072 expref: 12 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.751373:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.751375:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065156.751376:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 17 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.751378:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a200, rc 0) 00000100:00100000:2.0:1746065156.751386:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263394560:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065156.751413:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32428:x1830881263670656:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 129us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.751418:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13711 00000100:00100000:2.0:1746065156.751445:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065156.766629:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.766741:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263394560:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065156.766760:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.766805:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263670528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15554us (15880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.766816:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6143 00000100:00100000:2.0:1746065156.766931:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263670144:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24688us (27000us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065156.766937:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3921 00002000:00100000:2.0:1746065156.766945:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009aec8e00 x1830881263670144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.766954:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8e00 with x1830881263670144 ext(1048576->2097151) 00002000:00010000:2.0:1746065156.766958:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8e00 00000100:00100000:0.0:1746065156.767054:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263670912 00000100:00100000:0.0:1746065156.767060:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263670912 00000100:00100000:0.0:1746065156.767085:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13712 00000100:00100000:0.0:1746065156.767090:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+39:32431:x1830881263670912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065156.767106:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.767119:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc147034e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934079 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.767191:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.767203:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.767209:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.767230:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.767240:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 11 pid: 7203 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.767248:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263394688:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065156.767291:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.770713:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.772065:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263671168 00000100:00100000:2.0:1746065156.772074:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263671168 00002000:00100000:2.0:1746065156.772117:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009aec9180 x1830881263671168/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.772125:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881263671168 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.772130:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9180 00000100:00100000:2.0:1746065156.772503:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3922 00000100:00100000:2.0:1746065156.772511:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263671168:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.773603:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263394688:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.773625:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065156.773871:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.776370:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.777896:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263671296 00000100:00100000:2.0:1746065156.777908:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263671296 00000100:00100000:3.0:1746065156.778162:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263671424 00000100:00100000:3.0:1746065156.778168:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263671424 00010000:00010000:3.0:1746065156.778191:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 12 pid: 7203 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.778235:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6144 00000100:00100000:3.0:1746065156.778242:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263671424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.778254:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.778259:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 12 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.778269:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 12 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.778291:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a800/0xad6b7ddc1470339 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93406b expref: 12 pid: 7203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.778308:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.778312:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.778686:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.778692:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.778713:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.778753:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2007:x1830881263671424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 511us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.778759:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6144 00010000:00010000:0.0:1746065156.779818:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065156.779826:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065156.779842:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:2.0:1746065156.779940:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13556 00000100:00100000:2.0:1746065156.779947:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+40:32427:x1830881263671296:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.779959:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.779970:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934080 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.779988:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.779994:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065156.779996:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065156.779998:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 41 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.780017:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.780026:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 18 pid: 9548 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.780035:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263394816:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.780075:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc147034e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 42 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.780077:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00010000:00010000:0.0:1746065156.780090:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 41 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.780095:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065156.783563:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065156.783569:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:1.0:1746065156.784818:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.784850:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.785946:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+41:32431:x1830881263670912:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 18850us (19319us total) trans 8589936056 rc 0/0 00000100:00100000:3.0:1746065156.785955:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13712 00000100:00100000:0.0:1746065156.786303:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.786528:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263671680 00000100:00100000:2.0:1746065156.786528:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263671936 00000100:00100000:3.0:1746065156.786535:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263671680 00000100:00100000:2.0:1746065156.786535:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263671936 00000100:00100000:2.0:1746065156.786566:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263672192 00000100:00100000:2.0:1746065156.786568:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263672192 00000100:00100000:3.0:1746065156.786604:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13557 00000100:00100000:3.0:1746065156.786610:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263671936:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065156.786640:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.786655:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 27 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.786662:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 16 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.786669:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.786674:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.786676:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.786678:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.786701:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.786710:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 19 pid: 3067 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.786720:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263394944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.786763:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 16 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.786770:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 16 pid: 9549 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065156.786790:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263395072:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.786812:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 27 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.786819:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 27 pid: 13375 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.786826:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263395200:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.786840:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.786863:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.786906:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.786923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.786934:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263671552 00000100:00100000:3.0:1746065156.786937:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263671552 00000100:00100000:3.0:1746065156.786954:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263671808 00000100:00100000:3.0:1746065156.786955:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263671808 00000100:00100000:3.0:1746065156.786968:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263672064 00000100:00100000:3.0:1746065156.786970:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263672064 00000100:00100000:3.0:1746065156.786978:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13558 00000100:00100000:3.0:1746065156.786982:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263671680:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065156.786999:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.787008:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.787013:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.787014:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.787016:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.787030:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.787037:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 41 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.787045:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263395328:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.787061:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.787071:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13559 00000100:00100000:3.0:1746065156.787075:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263672192:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065156.787087:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.787095:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.787100:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.787105:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.787109:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.787110:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.787112:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.787123:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.787129:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065156.787135:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263395456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.787153:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065156.787159:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 14 pid: 10219 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065156.787165:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263395584:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.787182:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.787189:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 18 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.787195:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263395712:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.787208:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.787281:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.787303:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263672320 00000100:00100000:3.0:1746065156.787307:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263672320 00002000:00100000:3.0:1746065156.787323:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1585151) req@ffff88008f3e4e00 x1830881263672320/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065156.788012:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13560 00000100:00100000:2.0:1746065156.788019:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263671552:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065156.788037:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.788047:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.788053:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.788058:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.788062:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.788063:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.788064:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.788078:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.788086:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 19 pid: 9548 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746065156.788093:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263395840:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065156.788119:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13561 00010000:00010000:2.0:1746065156.788123:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065156.788125:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263671808:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065156.788130:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 18 pid: 11461 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746065156.788139:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.788142:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263395968:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.788147:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065156.788150:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 41 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.788155:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065156.788156:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.788160:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.788167:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 27 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.788171:0:9550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 41 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.788173:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263396096:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.788179:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.788184:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065156.788195:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13562 00000100:00100000:0.0:1746065156.788200:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263672064:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065156.788211:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.788218:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263394816:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.788219:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.788224:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.788225:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.788227:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.788232:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 41 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.788241:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd81200, rc 0) 00010000:00010000:0.0:1746065156.788242:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.788248:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 19 pid: 9549 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.788254:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263396352:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.788256:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+41:32427:x1830881263671296:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8310us (14387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.788261:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13556 00000100:00100000:0.0:1746065156.788268:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800994f8f00 going to sleep for 11 seconds 00002000:00100000:3.0:1746065156.789895:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4e00 with x1830881263672320 ext(1048576->1585151) 00010000:00010000:3.0:1746065156.789906:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 19 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.789916:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 19 pid: 9548 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746065156.789922:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e4e00 00000100:00100000:3.0:1746065156.789955:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1348 00000100:00100000:3.0:1746065156.789964:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263672320:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065156.795593:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263671168:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23074us (24878us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065156.795603:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3922 00002000:00100000:2.0:1746065156.795613:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff88009aec9180 x1830881263671168/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.795622:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881263671168 ext(2097152->4194303) 00010000:00010000:2.0:1746065156.795631:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 18 pid: 9549 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.795642:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 18 pid: 9549 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746065156.795649:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aec9180 00000100:00100000:2.0:1746065156.808044:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.808113:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263395840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.808136:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.808160:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.808178:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263672448 00000100:00100000:2.0:1746065156.808183:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263672448 00000100:00100000:1.0:1746065156.808185:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263672576 00000100:00100000:1.0:1746065156.808188:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263672576 00010000:00010000:2.0:1746065156.808212:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.808212:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 19 pid: 9549 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746065156.808238:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263672832 00000100:00100000:2.0:1746065156.808240:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263672832 00010000:00010000:2.0:1746065156.808249:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 21 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746065156.808278:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6145 00000100:00100000:1.0:1746065156.808286:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263672448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065156.808298:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065156.808315:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.808323:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 18 pid: 3067 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.808348:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065156.808379:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263672448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065156.808384:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6145 00000100:00100000:1.0:1746065156.808398:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6146 00000100:00100000:1.0:1746065156.808402:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263672576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065156.808408:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065156.808413:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 19 pid: 9549 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746065156.808420:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 19 pid: 9549 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746065156.808429:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065156.808441:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2005:x1830881263672576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065156.808445:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6146 00000100:00100000:1.0:1746065156.808482:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6147 00000100:00100000:1.0:1746065156.808487:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263672832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065156.808493:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065156.808503:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 21 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.808511:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 21 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746065156.808522:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065156.808533:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263672832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065156.808538:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6147 00010000:00010000:3.0:1746065156.808614:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167200/0xad6b7ddc147012c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933f30 expref: 17 pid: 3067 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.808628:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263394944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.808637:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc1470301 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934048 expref: 18 pid: 9549 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065156.808650:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263395072:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.808653:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.808658:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263395200:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.808664:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263672704 00000100:00100000:2.0:1746065156.808666:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263672704 00010000:00010000:2.0:1746065156.808676:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 28 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.808681:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.808687:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6148 00000100:00100000:2.0:1746065156.808692:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263672704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.808697:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.808704:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 28 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.808711:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 28 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.808722:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc14700c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933ece expref: 28 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.808723:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f47c00/0xad6b7ddc147021a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fbc expref: 20 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.808731:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263395712:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.808731:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.808733:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.808737:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.808743:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.808765:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065156.808769:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.808790:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.808794:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263672704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.808799:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6148 00010000:00010000:3.0:1746065156.808804:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.808810:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.808817:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.808823:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683be00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065156.808826:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.808832:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.808845:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.808851:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc147036a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.808858:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263395456:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.808897:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263671936:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 22287us (24046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.808901:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263395584:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065156.808903:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13557 00000100:00100000:3.0:1746065156.808925:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263395328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065156.808934:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.808956:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.808966:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263672960 00000100:00100000:3.0:1746065156.808968:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263672960 00010000:00010000:3.0:1746065156.808978:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 41 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.808990:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6149 00000100:00100000:3.0:1746065156.808994:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263672960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.808999:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.809007:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 41 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.809018:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 41 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.809274:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc14702e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93402c expref: 41 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.809370:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.809372:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.809374:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.809381:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.809393:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065156.809734:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.810093:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263395968:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.810151:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.810162:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263673088 00000100:00100000:2.0:1746065156.810165:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263673088 00010000:00010000:2.0:1746065156.810179:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 15 pid: 10219 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746065156.810193:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6150 00000100:00100000:2.0:1746065156.810197:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263673088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.810203:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.810211:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 15 pid: 10219 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810218:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 15 pid: 10219 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810229:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147030f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934056 expref: 15 pid: 10219 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810236:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.810249:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263673088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.810254:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6150 00000100:00100000:2.0:1746065156.810276:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.810285:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263673216 00000100:00100000:2.0:1746065156.810288:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263673216 00010000:00010000:2.0:1746065156.810297:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 17 pid: 11461 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746065156.810309:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6151 00000100:00100000:2.0:1746065156.810313:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263673216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.810318:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.810325:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 17 pid: 11461 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810332:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 17 pid: 11461 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810341:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d000/0xad6b7ddc14702ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934033 expref: 17 pid: 11461 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810349:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.810361:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263673216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 48us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.810365:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6151 00000100:00100000:2.0:1746065156.810403:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263396096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.810421:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.810478:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.810486:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263673344 00000100:00100000:2.0:1746065156.810488:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263673344 00010000:00010000:2.0:1746065156.810497:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746065156.810515:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6152 00000100:00100000:2.0:1746065156.810519:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263673344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.810524:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.810530:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810538:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810547:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49f7400/0xad6b7ddc1470228 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fca expref: 41 pid: 3067 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746065156.810555:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.810557:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.810559:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.810564:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.810574:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.810587:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263673344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.810591:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6152 00000100:00100000:0.0:1746065156.810637:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263396352:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065156.810648:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065156.810695:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.810706:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263673472 00000100:00100000:0.0:1746065156.810708:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263673472 00010000:00010000:0.0:1746065156.810718:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 27 pid: 11461 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746065156.810740:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6153 00000100:00100000:0.0:1746065156.810745:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263673472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065156.810750:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065156.810757:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 27 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.810768:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 27 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.810791:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1470213 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fb5 expref: 27 pid: 11461 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.810801:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065156.810815:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881263673472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.810821:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6153 00000100:00100000:0.0:1746065156.810860:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.810869:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263673600 00000100:00100000:0.0:1746065156.810872:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263673600 00010000:00010000:0.0:1746065156.810893:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 17 pid: 9548 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746065156.811967:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263672960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2965us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.811975:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6149 00000100:00100000:3.0:1746065156.812013:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6154 00000100:00100000:3.0:1746065156.812020:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263673600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065156.812027:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.812038:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 17 pid: 9548 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746065156.812045:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 17 pid: 9548 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746065156.812060:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147023d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933fdf expref: 17 pid: 9548 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746065156.812068:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.812070:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.812072:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812078:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812092:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.812107:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+16:2004:x1830881263673600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.812112:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6154 00010000:00010000:3.0:1746065156.812136:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812142:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812155:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812163:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812177:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812182:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f6e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065156.812185:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812192:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812201:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812207:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1470371 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.812240:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263671680:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 25258us (27427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.812246:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13558 00010000:00010000:3.0:1746065156.812298:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812304:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812314:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812320:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812325:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812329:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a5ce800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065156.812331:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812337:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812345:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812351:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147037f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.812381:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263671552:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 24363us (25516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.812386:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13560 00010000:00010000:3.0:1746065156.812402:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812407:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812418:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812423:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812429:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812434:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e890c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065156.812436:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812440:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812448:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.812453:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e890c00/0xad6b7ddc1470378 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065156.812479:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263672192:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 25403us (26177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.812484:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13559 00000100:00100000:0.0:1746065156.813238:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263672320:12345-192.168.202.27@tcp:4:cat.0 Request processed in 23268us (25948us total) trans 17179873522 rc 0/0 00000100:00100000:0.0:1746065156.813250:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1348 00002000:00100000:0.0:1746065156.813263:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->1585151) req@ffff88008f3e4e00 x1830881263672320/t17179873522(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/448 e 0 to 0 dl 1746065167 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.813274:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4e00 with x1830881263672320 ext(1048576->1585151) 00010000:00010000:0.0:1746065156.813283:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746065156.813300:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746065156.813306:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e4e00 00000100:00100000:0.0:1746065156.822326:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.822413:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.822549:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263673728 00000100:00100000:2.0:1746065156.822557:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263673728 00010000:00010000:2.0:1746065156.822585:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.822610:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6155 00000100:00100000:2.0:1746065156.822617:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263673728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.822629:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.822645:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.822655:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.822674:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e400/0xad6b7ddc14702bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1585151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934017 expref: 20 pid: 9548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.822686:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.822688:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.822694:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 38 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.822701:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 38 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.822730:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 38 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.822739:0:7191:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 38 pid: 13375 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.822750:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263396480:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065156.824838:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263673856 00000100:00100000:3.0:1746065156.824847:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263673856 00000100:00100000:3.0:1746065156.824898:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13563 00000100:00100000:3.0:1746065156.824905:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+20:32424:x1830881263673856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065156.824919:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.824933:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934087 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065156.824949:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d704, atime: 0x6812d704, ctime: 0x6812d704, blocks: 0x1000 00010000:00010000:3.0:1746065156.824962:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.824963:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.824968:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.824978:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.824985:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:2.0:1746065156.825161:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065156.825911:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+21:32424:x1830881263673856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1002us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.825919:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13563 00000100:00100000:0.0:1746065156.827748:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.828315:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263673984 00000100:00100000:2.0:1746065156.828321:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263673984 00010000:00010000:2.0:1746065156.828347:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 16 pid: 9549 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746065156.828379:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6156 00000100:00100000:2.0:1746065156.828385:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+16:2007:x1830881263673984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.828398:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.829205:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 16 pid: 9549 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.829217:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 16 pid: 9549 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.829239:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc1470324 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934064 expref: 16 pid: 9549 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746065156.829252:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.829254:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.829258:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.829517:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.829539:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.829571:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+15:2007:x1830881263673984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1186us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.829578:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6156 00010000:00010000:0.0:1746065156.829678:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.829686:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.829700:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.829706:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.829712:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.829717:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065156.829720:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.829731:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.829739:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.829744:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc147038d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065156.829796:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263672064:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 41595us (42870us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.829804:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13562 00000100:00100000:3.0:1746065156.838231:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.838283:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263674240 00000100:00100000:0.0:1746065156.838292:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263674240 00002000:00100000:0.0:1746065156.838328:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88008f3e5500 x1830881263674240/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065156.838337:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881263674240 ext(2097152->3145727) 00002000:00010000:0.0:1746065156.838342:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e5500 00000100:00100000:0.0:1746065156.838367:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3923 00000100:00100000:0.0:1746065156.838374:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263674240:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.845257:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.846211:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263674496 00000100:00100000:3.0:1746065156.846219:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263674496 00002000:00100000:3.0:1746065156.846254:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009aecb800 x1830881263674496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.846264:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb800 with x1830881263674496 ext(1048576->2097151) 00010000:00010000:3.0:1746065156.846272:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 39 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.846284:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 39 pid: 13375 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746065156.846290:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aecb800 00000100:00100000:2.0:1746065156.846298:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263396480:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065156.846306:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1349 00000100:00100000:3.0:1746065156.846312:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263674496:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065156.846315:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.846350:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263673728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 23734us (24033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.846357:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6155 00000100:00100000:2.0:1746065156.853957:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263674240:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15571us (15720us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065156.853970:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3923 00002000:00100000:2.0:1746065156.853983:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff88008f3e5500 x1830881263674240/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.853992:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5500 with x1830881263674240 ext(2097152->3145727) 00002000:00010000:2.0:1746065156.853998:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e5500 00000100:00100000:3.0:1746065156.860644:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263674496:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14320us (15384us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065156.860656:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1349 00002000:00100000:3.0:1746065156.860668:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009aecb800 x1830881263674496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.860677:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb800 with x1830881263674496 ext(1048576->2097151) 00010000:00010000:3.0:1746065156.860687:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 39 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.860702:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 39 pid: 13375 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746065156.860708:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aecb800 00000100:00100000:0.0:1746065156.868150:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.868905:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263674624 00000100:00100000:2.0:1746065156.868912:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263674624 00000100:00100000:2.0:1746065156.868964:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13564 00000100:00100000:2.0:1746065156.868971:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+15:32424:x1830881263674624:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.868985:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.869001:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93408e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065156.869023:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d704, atime: 0x6812d704, ctime: 0x6812d704, blocks: 0x1650 00010000:00010000:2.0:1746065156.869042:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.869043:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.869050:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 16 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.869064:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 16 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.869072:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96600, rc 0) 00000100:00100000:2.0:1746065156.869119:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+16:32424:x1830881263674624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 149us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.869125:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13564 00000100:00100000:0.0:1746065156.872339:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.872413:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.872478:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263674880 00000100:00100000:2.0:1746065156.872485:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263674880 00010000:00010000:2.0:1746065156.872514:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 39 pid: 13375 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746065156.872533:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263674752 00000100:00100000:3.0:1746065156.872536:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263674752 00000100:00100000:2.0:1746065156.872537:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6157 00000100:00100000:2.0:1746065156.872542:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881263674880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.872554:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065156.872556:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13565 00000100:00100000:3.0:1746065156.872559:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:32427:x1830881263674752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065156.872569:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 39 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.872571:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.872578:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 39 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.872584:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934095 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065156.872596:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d703, atime: 0x6812d703, ctime: 0x6812d703, blocks: 0x808 00010000:00010000:2.0:1746065156.872596:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd81200/0xad6b7ddc1470363 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934080 expref: 39 pid: 13375 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746065156.872607:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.872608:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065156.872614:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.872625:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.872633:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2600, rc 0) 00000100:00100000:3.0:1746065156.872734:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+27:32427:x1830881263674752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 171us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065156.872740:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13565 00010000:00010000:2.0:1746065156.872968:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.872970:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.872973:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.873055:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.873085:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065156.873100:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.873109:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.873124:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.873131:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.873137:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.873142:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065156.873145:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.873151:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.873159:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.873165:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470386 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065156.873256:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881263674880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 713us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.873256:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263671808:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 85131us (86349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.873263:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6157 00000100:00100000:0.0:1746065156.873263:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13561 00000100:00100000:0.0:1746065156.882212:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.882285:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263675136 00000100:00100000:3.0:1746065156.882293:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263675136 00002000:00100000:3.0:1746065156.882326:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097fa8380 x1830881263675136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.882335:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881263675136 ext(1048576->2097151) 00002000:00010000:3.0:1746065156.882339:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:3.0:1746065156.882363:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3924 00000100:00100000:3.0:1746065156.882368:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263675136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.885688:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.885992:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.886036:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.886117:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263675904 00000100:00100000:2.0:1746065156.886185:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263675520 00000100:00100000:2.0:1746065156.886190:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263675520 00002000:00100000:2.0:1746065156.886224:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097faa680 x1830881263675520/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.886234:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa680 with x1830881263675520 ext(3145728->4194303) 00002000:00010000:2.0:1746065156.886238:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097faa680 00000100:00100000:2.0:1746065156.886258:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263675776 00000100:00100000:2.0:1746065156.886261:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263675776 00000100:00100000:3.0:1746065156.886268:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263675904 00002000:00100000:2.0:1746065156.886274:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880129f40e00 x1830881263675776/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.886279:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40e00 with x1830881263675776 ext(3145728->4194303) 00002000:00010000:2.0:1746065156.886283:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40e00 00000100:00100000:2.0:1746065156.886293:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3925 00000100:00100000:2.0:1746065156.886300:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263675520:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065156.886380:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13713 00000100:00100000:3.0:1746065156.886386:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32428:x1830881263675904:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:3.0:1746065156.886413:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065156.886432:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc1470347 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934072 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.886448:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.886452:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065156.886572:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32428:x1830881263675904:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 98us (448us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746065156.886578:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13713 00000100:00100000:3.0:1746065156.886648:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3926 00000100:00100000:3.0:1746065156.886654:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263675776:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065156.897645:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.897700:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263676160 00000100:00100000:3.0:1746065156.897710:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263676160 00000100:00100000:3.0:1746065156.897761:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4962 00000100:00100000:3.0:1746065156.897768:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32428:x1830881263676160:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065156.897998:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32428:x1830881263676160:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 229us (358us total) trans 8589936057 rc 0/0 00000100:00100000:3.0:1746065156.898004:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4962 00000100:00100000:3.0:1746065156.904133:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263675136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21752us (21918us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065156.904145:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3924 00002000:00100000:3.0:1746065156.904157:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880097fa8380 x1830881263675136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.904171:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881263675136 ext(1048576->2097151) 00002000:00010000:3.0:1746065156.904176:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:0.0:1746065156.905444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.905503:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263676416 00000100:00100000:3.0:1746065156.905509:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263676416 00000100:00100000:3.0:1746065156.905548:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4963 00000100:00100000:3.0:1746065156.905553:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:32428:x1830881263676416:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065156.905696:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32428:x1830881263676416:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 143us (255us total) trans 8589936058 rc 0/0 00000100:00100000:3.0:1746065156.905702:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4963 00000100:00100000:2.0:1746065156.915140:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+16:2006:x1830881263675520:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28831us (29451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065156.915149:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3925 00002000:00100000:2.0:1746065156.915159:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097faa680 x1830881263675520/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.915168:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa680 with x1830881263675520 ext(3145728->4194303) 00002000:00010000:2.0:1746065156.915173:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097faa680 00000100:00100000:0.0:1746065156.919799:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.919822:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.919843:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.919861:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263676544 00000100:00100000:0.0:1746065156.919868:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263676544 00000100:00100000:0.0:1746065156.919906:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263676672 00000100:00100000:0.0:1746065156.919908:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263676672 00000100:00100000:3.0:1746065156.920676:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263675776:12345-192.168.202.27@tcp:3:cat.0 Request processed in 34015us (34678us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065156.920687:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3926 00002000:00100000:3.0:1746065156.920699:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880129f40e00 x1830881263675776/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.920707:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40e00 with x1830881263675776 ext(3145728->4194303) 00002000:00010000:3.0:1746065156.920712:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40e00 00000100:00100000:3.0:1746065156.920768:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.921993:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263676800 00000100:00100000:0.0:1746065156.922002:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263676800 00000100:00100000:0.0:1746065156.922038:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263676928 00000100:00100000:0.0:1746065156.922041:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263676928 00000100:00100000:0.0:1746065156.922064:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13566 00000100:00100000:0.0:1746065156.922073:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263676544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.922089:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.922109:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93409c expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065156.922131:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d704, atime: 0x6812d703, ctime: 0x6812d704, blocks: 0x7f8 00010000:00010000:0.0:1746065156.922149:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922151:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922161:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922181:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922192:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130104600, rc 0) 00000100:00100000:0.0:1746065156.922225:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263676544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 153us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.922231:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13566 00000100:00100000:0.0:1746065156.922249:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13567 00000100:00100000:0.0:1746065156.922256:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263676672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.922265:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.922278:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340a3 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065156.922290:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d704, atime: 0x6812d704, ctime: 0x6812d704, blocks: 0x808 00010000:00010000:0.0:1746065156.922299:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922300:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922304:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 40 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922313:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 40 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922319:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130105000, rc 0) 00000100:00100000:0.0:1746065156.922341:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263676672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 85us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.922349:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13567 00000100:00100000:0.0:1746065156.922364:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13568 00000100:00100000:0.0:1746065156.922370:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263676800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.922378:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.922388:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340aa expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065156.922399:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d704, atime: 0x6812d704, ctime: 0x6812d704, blocks: 0x800 00010000:00010000:0.0:1746065156.922409:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922410:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922415:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 40 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922425:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 40 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922432:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d600, rc 0) 00000100:00100000:0.0:1746065156.922455:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263676800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 84us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.922460:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13568 00000100:00100000:0.0:1746065156.922473:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13569 00000100:00100000:0.0:1746065156.922479:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263676928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.922486:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.922495:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340b1 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.922510:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922511:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922517:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922526:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922533:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3de00, rc 0) 00000100:00100000:0.0:1746065156.922555:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263676928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 75us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.922559:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13569 00000100:00100000:0.0:1746065156.922690:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.922703:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263677056 00000100:00100000:0.0:1746065156.922706:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263677056 00000100:00100000:0.0:1746065156.922722:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13570 00000100:00100000:0.0:1746065156.922725:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263677056:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.922731:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.922737:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340b8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.922746:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922747:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.922750:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 41 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922758:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 41 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.922766:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d000, rc 0) 00000100:00100000:0.0:1746065156.922798:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263677056:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.922802:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13570 00010000:00010000:2.0:1746065156.925235:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065156.935605:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.935666:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.935714:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.935866:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065156.935898:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263677184 00000100:00100000:0.0:1746065156.935906:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263677184 00000100:00100000:0.0:1746065156.935945:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263677312 00000100:00100000:0.0:1746065156.935948:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263677312 00000100:00100000:0.0:1746065156.935960:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263677440 00000100:00100000:0.0:1746065156.935961:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263677440 00000100:00100000:0.0:1746065156.935972:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263677568 00000100:00100000:0.0:1746065156.935974:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263677568 00000100:00100000:0.0:1746065156.935985:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13571 00000100:00100000:0.0:1746065156.935992:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263677184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.936007:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.936021:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340bf expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.936042:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.936043:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.936052:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.936069:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.936078:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c800, rc 0) 00000100:00100000:0.0:1746065156.936112:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263677184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 120us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.936118:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13571 00000100:00100000:0.0:1746065156.936132:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13572 00000100:00100000:0.0:1746065156.936137:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263677312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.936144:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.936154:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340c6 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.936167:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.936169:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.936174:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.936184:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.936192:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c400, rc 0) 00000100:00100000:0.0:1746065156.936216:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263677312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 77us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.936221:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13572 00000100:00100000:0.0:1746065156.936236:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13573 00000100:00100000:0.0:1746065156.936242:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263677440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.936250:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.936257:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340cd expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.936270:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.936271:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.936276:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.936285:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 22 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.936292:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9dc00, rc 0) 00000100:00100000:0.0:1746065156.936306:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263677440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 64us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.936310:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13573 00000100:00100000:0.0:1746065156.936322:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13574 00000100:00100000:0.0:1746065156.936326:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263677568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065156.936334:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065156.936341:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340d4 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065156.936353:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.936354:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065156.936359:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.936369:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065156.936377:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c000, rc 0) 00000100:00100000:0.0:1746065156.936399:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263677568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065156.936404:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13574 00000100:00100000:2.0:1746065156.940232:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.942566:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.942653:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.942681:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263677824 00000100:00100000:2.0:1746065156.942688:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263677824 00002000:00100000:2.0:1746065156.942726:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff8800957d8380 x1830881263677824/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.942735:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8380 with x1830881263677824 ext(4194304->5021695) 00002000:00010000:2.0:1746065156.942740:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8380 00000100:00100000:2.0:1746065156.942759:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263678080 00000100:00100000:2.0:1746065156.942761:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263678080 00002000:00100000:2.0:1746065156.942793:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff8800957d9f80 x1830881263678080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.942800:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881263678080 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.942803:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9f80 00000100:00100000:3.0:1746065156.943370:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263678336 00000100:00100000:3.0:1746065156.943374:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263678336 00002000:00100000:3.0:1746065156.943436:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff8800957da300 x1830881263678336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/0 e 0 to 0 dl 1746065167 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065156.943443:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881263678336 ext(2097152->4194303) 00002000:00010000:3.0:1746065156.943446:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:2.0:1746065156.943658:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3927 00000100:00100000:2.0:1746065156.943666:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263677824:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.944207:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3928 00000100:00100000:2.0:1746065156.944216:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263678080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065156.944553:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3929 00000100:00100000:3.0:1746065156.944564:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263678336:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065156.955595:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263677824:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11914us (15361us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065156.955608:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3927 00002000:00100000:2.0:1746065156.955620:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff8800957d8380 x1830881263677824/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.955629:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8380 with x1830881263677824 ext(4194304->5021695) 00002000:00010000:2.0:1746065156.955635:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8380 00000100:00100000:0.0:1746065156.969272:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065156.971694:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263678592 00000100:00100000:3.0:1746065156.971705:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263678592 00000100:00100000:3.0:1746065156.971759:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13714 00000100:00100000:3.0:1746065156.971766:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+26:32436:x1830881263678592:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065156.971800:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065156.971817:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc14703e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340db expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.971885:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.971896:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.971904:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.971914:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.971920:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.971924:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972004:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc14703fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972012:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc14703fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972021:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc14703fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065156.972028:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065156.972085:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972090:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972095:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972099:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972104:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065156.972107:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972112:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972119:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065156.972122:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065156.972124:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972128:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ba00/0xad6b7ddc14703ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972158:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972165:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972169:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972173:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065156.972174:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972178:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972183:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b4838200) 00010000:00010000:3.0:1746065156.972185:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065156.972186:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972190:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14703f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065156.972222:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc14703e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340db expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.972230:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc14703fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340db expref: 28 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065156.972235:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065156.972237:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065156.972239:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a400, rc 0) 00000100:00100000:3.0:1746065156.972279:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+28:32436:x1830881263678592:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 514us (3014us total) trans 8589936059 rc 0/0 00000100:00100000:3.0:1746065156.972286:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13714 00000100:00100000:0.0:1746065156.990896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065156.990962:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263678848 00000100:00100000:1.0:1746065156.990970:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263678848 00000100:00100000:1.0:1746065156.991020:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4964 00000100:00100000:1.0:1746065156.991028:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+28:32424:x1830881263678848:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065156.991207:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+29:32424:x1830881263678848:12345-192.168.202.27@tcp:35:cat.0 Request processed in 179us (318us total) trans 8589936060 rc 0/0 00000100:00100000:1.0:1746065156.991213:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4964 00000100:00100000:2.0:1746065156.991342:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263678080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 47127us (48986us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065156.991351:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3928 00002000:00100000:2.0:1746065156.991359:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff8800957d9f80 x1830881263678080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.991368:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881263678080 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.991375:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9f80 00000100:00100000:2.0:1746065156.995252:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263678336:12345-192.168.202.27@tcp:3:cat.0 Request processed in 50683us (52592us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065156.995263:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3929 00002000:00100000:2.0:1746065156.995271:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff8800957da300 x1830881263678336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:72/0 lens 488/440 e 0 to 0 dl 1746065167 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065156.995279:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881263678336 ext(2097152->4194303) 00002000:00010000:2.0:1746065156.995284:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:0.0:1746065156.995687:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.995744:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263678976 00000100:00100000:2.0:1746065156.995750:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263678976 00000100:00100000:2.0:1746065156.995806:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 727 00000100:00100000:2.0:1746065156.995812:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+29:2006:x1830881263678976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065156.995823:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065156.995843:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc14703fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340db expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.995868:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065156.995872:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065156.995899:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+28:2006:x1830881263678976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065156.995904:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 727 00000100:00100000:0.0:1746065156.997455:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065156.997522:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263679104 00000100:00100000:2.0:1746065156.997527:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263679104 00000100:00100000:2.0:1746065156.997563:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13575 00000100:00100000:2.0:1746065156.997569:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:32431:x1830881263679104:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065156.997584:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065156.997597:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340e2 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.997620:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.997631:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.997637:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.997639:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065156.997642:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [155648->1048575] (req 155648->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 30 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065156.997665:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.997675:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 17 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065156.997684:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263396608:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065156.997764:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065156.997791:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 30 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065156.997799:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263396736:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065156.997828:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.005117:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.005196:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.005432:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263396608:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.005442:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263396736:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.005470:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [155648->1048575] (req 155648->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 30 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.005486:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3e00, rc 0) 00000100:00100000:2.0:1746065157.005524:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+30:32431:x1830881263679104:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7955us (8072us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.005531:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13575 00000100:00100000:3.0:1746065157.005787:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263679232 00000100:00100000:3.0:1746065157.005793:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263679232 00000100:00080000:3.0:1746065157.005810:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746065157.005826:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 18 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.005845:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263679360 00000100:00100000:3.0:1746065157.005847:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263679360 00010000:00010000:3.0:1746065157.005855:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 30 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.005866:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6158 00000100:00100000:3.0:1746065157.005871:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+18:2007:x1830881263679232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.005890:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.005905:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 18 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.005913:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 18 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.005930:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c800/0xad6b7ddc14703cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340bf expref: 18 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.005947:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.005964:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+17:2007:x1830881263679232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.005972:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6158 00000100:00100000:3.0:1746065157.005981:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6159 00000100:00100000:3.0:1746065157.005985:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263679360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.005990:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.005997:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 30 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.006005:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 30 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.006015:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc14703a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93409c expref: 30 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.006023:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.006024:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.006030:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.006037:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.006061:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.006071:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263396864:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065157.006114:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4b40 going to sleep for 11 seconds 00000100:00080000:3.0:1746065157.006123:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065157.019429:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.019899:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263396864:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065157.019916:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.019958:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263679360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 13971us (14761us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.019968:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6159 00000100:00100000:2.0:1746065157.020084:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263679488 00000100:00100000:2.0:1746065157.020090:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263679488 00000100:00100000:2.0:1746065157.020119:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13576 00000100:00100000:2.0:1746065157.020125:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263679488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.020138:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.020434:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc1470412 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340e9 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.020473:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263396992:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065157.020619:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.021214:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263679744 00000100:00100000:3.0:1746065157.021218:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263679744 00002000:00100000:3.0:1746065157.021241:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (155648->159743) req@ffff88011dad6300 x1830881263679744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.021249:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6300 with x1830881263679744 ext(155648->159743) 00002000:00010000:3.0:1746065157.021253:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad6300 00000100:00100000:3.0:1746065157.021267:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3930 00000100:00100000:3.0:1746065157.021272:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263679744:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065157.021372:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263679744:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 99us (752us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065157.021377:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3930 00002000:00100000:3.0:1746065157.021382:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (155648->159743) req@ffff88011dad6300 x1830881263679744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.021388:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6300 with x1830881263679744 ext(155648->159743) 00002000:00010000:3.0:1746065157.021391:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad6300 00000100:00100000:2.0:1746065157.021458:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00002000:00010000:2.0:1746065157.025956:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065156 -> 1746065157 00002000:00010000:2.0:1746065157.025963:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065155 -> 1746065157 00002000:00010000:2.0:1746065157.025965:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065156 -> 1746065157 00000100:00100000:2.0:1746065157.025982:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263396992:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.026009:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc1470412 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e9 expref: 30 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.026021:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3400/0xad6b7ddc1470412 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e9 expref: 30 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.026692:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3400, rc 0) 00000100:00100000:2.0:1746065157.026737:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263679488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6612us (7315us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.026744:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13576 00000100:00100000:0.0:1746065157.034725:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.034802:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263680000 00000100:00100000:3.0:1746065157.034810:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263680000 00002000:00100000:3.0:1746065157.034846:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88011dad4e00 x1830881263680000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.034859:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4e00 with x1830881263680000 ext(4194304->5021695) 00002000:00010000:3.0:1746065157.034864:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad4e00 00000100:00100000:3.0:1746065157.034892:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3931 00000100:00100000:3.0:1746065157.034899:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263680000:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065157.040859:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.041229:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263680128 00000100:00100000:2.0:1746065157.041237:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263680128 00000100:00100000:2.0:1746065157.041334:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13577 00000100:00100000:2.0:1746065157.041341:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:32431:x1830881263680128:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065157.041358:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.041373:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340f0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.041397:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 42 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.041406:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 21 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.041412:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.041414:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.041417:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->1060863] (req 1048576->1060863) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 42 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.041441:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 21 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.041455:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 21 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.041465:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263397120:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.041541:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 42 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.041548:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 42 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.041556:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263397248:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.041573:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00080000:3.0:1746065157.041694:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065157.042616:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263680000:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7715us (7971us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065157.042624:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3931 00002000:00100000:3.0:1746065157.042632:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88011dad4e00 x1830881263680000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.042641:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4e00 with x1830881263680000 ext(4194304->5021695) 00002000:00010000:3.0:1746065157.042645:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad4e00 00000100:00100000:0.0:1746065157.043970:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.044006:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.044070:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263680256 00000100:00100000:1.0:1746065157.044076:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263680256 00010000:00010000:1.0:1746065157.044106:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 22 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.044136:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263680384 00000100:00100000:1.0:1746065157.044138:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263680384 00010000:00010000:1.0:1746065157.044148:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 43 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.044155:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6160 00000100:00100000:0.0:1746065157.044162:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263680256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065157.044172:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6161 00010000:00010000:0.0:1746065157.044172:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065157.044176:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881263680384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065157.044177:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263397120:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.044182:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065157.044186:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263397248:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.044188:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 43 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.044188:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 22 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.044197:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 43 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.044205:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 22 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.044223:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc14703b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340a3 expref: 43 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.044227:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c400/0xad6b7ddc14703d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340c6 expref: 22 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.044238:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.044240:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.044245:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 42 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.044252:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 42 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.044259:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065157.044273:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 42 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.044282:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881263680384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.044282:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263397376:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065157.044288:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6161 00000100:00100000:0.0:1746065157.044321:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b22040c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065157.044349:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746065157.044471:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.044480:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3600, rc 0) 00000100:00100000:2.0:1746065157.044515:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:32431:x1830881263680128:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3174us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.044521:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13577 00000100:00100000:0.0:1746065157.046208:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.046264:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263680512 00000100:00100000:2.0:1746065157.046269:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263680512 00000100:00100000:2.0:1746065157.046305:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13578 00000100:00100000:2.0:1746065157.046311:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263680512:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.046324:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.046335:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470420 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340f7 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.046367:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263397504:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.046419:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00002000:00010000:3.0:1746065157.048116:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime: 1746065156 -> 1746065157 00002000:00010000:3.0:1746065157.048121:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime: 1746065156 -> 1746065157 00002000:00010000:3.0:1746065157.048123:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime: 1746065156 -> 1746065157 00000100:00100000:3.0:1746065157.048137:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263397504:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065157.048160:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470420 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f7 expref: 42 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.048171:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2e00/0xad6b7ddc1470420 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f7 expref: 42 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.048190:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2e00, rc 0) 00000100:00100000:3.0:1746065157.048216:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263680512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1905us (2023us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065157.048223:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13578 00000100:00100000:2.0:1746065157.048246:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263397376:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065157.048257:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.048278:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263680256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4116us (4311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.048286:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6160 00000100:00100000:0.0:1746065157.048951:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.048989:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263680768 00000100:00100000:3.0:1746065157.049004:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263680768 00002000:00100000:3.0:1746065157.049031:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1056768->1060863) req@ffff88011dad5f80 x1830881263680768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.049041:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5f80 with x1830881263680768 ext(1056768->1060863) 00002000:00010000:3.0:1746065157.049045:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5f80 00000100:00100000:3.0:1746065157.049059:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3932 00000100:00100000:3.0:1746065157.049065:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263680768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065157.049149:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263680768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 83us (198us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065157.049154:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3932 00002000:00100000:3.0:1746065157.049159:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6e:0x0] (1056768->1060863) req@ffff88011dad5f80 x1830881263680768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.049166:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5f80 with x1830881263680768 ext(1056768->1060863) 00002000:00010000:3.0:1746065157.049168:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5f80 00000100:00100000:0.0:1746065157.066617:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.066711:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263680896 00000100:00100000:3.0:1746065157.066720:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263680896 00000100:00100000:3.0:1746065157.066796:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13579 00000100:00100000:3.0:1746065157.066803:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+17:32436:x1830881263680896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065157.066819:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.066832:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9340fe expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.066860:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 18 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.066867:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 28 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.066873:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.066884:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.066888:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2740224->3145727] (req 2740224->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.066913:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 28 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.066923:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 28 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.066933:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263397632:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.067014:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 18 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.067021:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 18 pid: 12258 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.067028:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263397760:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.067045:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.069733:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263397632:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.069743:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263397760:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.069769:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2740224->3145727] (req 2740224->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.069799:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a200, rc 0) 00000100:00100000:3.0:1746065157.070180:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+18:32436:x1830881263680896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3376us (3569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.070189:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13579 00000100:00100000:0.0:1746065157.072431:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.072650:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263681024 00000100:00100000:2.0:1746065157.072658:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263681024 00010000:00010000:2.0:1746065157.072684:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 18 pid: 12258 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.072688:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.072809:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263681152 00000100:00100000:2.0:1746065157.072813:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263681152 00010000:00010000:2.0:1746065157.072863:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 29 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.072894:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6162 00000100:00100000:3.0:1746065157.072900:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6163 00000100:00100000:2.0:1746065157.072900:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+18:2005:x1830881263681024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065157.072905:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263681152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.072911:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.072911:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.072926:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 29 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746065157.072926:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 18 pid: 12258 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.072935:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 18 pid: 12258 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.073004:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 29 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.073021:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14703be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b1 expref: 29 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.073037:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065157.073133:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc147039b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93408e expref: 18 pid: 12258 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.073144:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.073146:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.073151:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.073158:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.073185:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.073195:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263397888:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065157.073215:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263681152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 309us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.073224:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6163 00000100:00100000:2.0:1746065157.073233:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.074659:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263397888:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065157.074675:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.074708:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263681024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1807us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.074715:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6162 00000100:00100000:0.0:1746065157.075108:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.075390:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263681408 00000100:00100000:3.0:1746065157.075395:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263681408 00002000:00100000:3.0:1746065157.075425:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2740224->2744319) req@ffff88009a6dca80 x1830881263681408/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.075433:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881263681408 ext(2740224->2744319) 00002000:00010000:3.0:1746065157.075436:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dca80 00000100:00100000:3.0:1746065157.076028:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3933 00000100:00100000:3.0:1746065157.076035:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263681408:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065157.076366:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2005:x1830881263681408:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 330us (1261us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065157.076372:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3933 00002000:00100000:3.0:1746065157.076377:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2740224->2744319) req@ffff88009a6dca80 x1830881263681408/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.076384:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881263681408 ext(2740224->2744319) 00002000:00010000:3.0:1746065157.076387:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dca80 00000100:00100000:0.0:1746065157.080893:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.080998:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263681536 00000100:00100000:3.0:1746065157.081005:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263681536 00000100:00100000:3.0:1746065157.081221:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13580 00000100:00100000:3.0:1746065157.081228:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+21:32436:x1830881263681536:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065157.081242:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.081257:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934105 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.081283:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.081290:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.081295:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.081296:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.081299:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->2281471] (req 2097152->2281471) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.081323:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.081333:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 40 pid: 1880 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.081342:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263398016:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.081421:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.081428:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.081435:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263398144:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.081458:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.085639:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263398016:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.085651:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263398144:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.085677:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->2281471] (req 2097152->2281471) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.085691:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683aa00, rc 0) 00000100:00100000:3.0:1746065157.085732:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+22:32436:x1830881263681536:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4503us (4858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.085739:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13580 00000100:00100000:0.0:1746065157.086004:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.086091:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263681664 00000100:00100000:3.0:1746065157.086096:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263681664 00010000:00010000:3.0:1746065157.086116:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.086137:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6164 00000100:00100000:3.0:1746065157.086143:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263681664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.086153:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.086168:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.086177:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.086194:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1470394 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934087 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.086219:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.086239:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263681664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.086244:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6164 00000100:00100000:0.0:1746065157.087124:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.087176:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263681792 00000100:00100000:2.0:1746065157.087181:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263681792 00010000:00010000:2.0:1746065157.087197:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 41 pid: 1880 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.087222:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6165 00000100:00100000:2.0:1746065157.087227:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263681792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.087235:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.087244:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 41 pid: 1880 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746065157.087252:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 41 pid: 1880 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746065157.087264:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc14703c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340b8 expref: 41 pid: 1880 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746065157.087276:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.087277:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.087282:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.087290:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.087313:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.087327:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263398272:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065157.087385:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.091024:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263398272:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065157.091047:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.092124:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881263681792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4891us (4996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.092134:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6165 00000100:00100000:0.0:1746065157.094865:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.095015:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263682048 00000100:00100000:3.0:1746065157.095022:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263682048 00002000:00100000:3.0:1746065157.095059:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2277376->2281471) req@ffff88009a6ddc00 x1830881263682048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.095067:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddc00 with x1830881263682048 ext(2277376->2281471) 00002000:00010000:3.0:1746065157.095072:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddc00 00000100:00100000:3.0:1746065157.095098:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3934 00000100:00100000:3.0:1746065157.095104:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263682048:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065157.095477:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263682048:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 371us (617us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065157.095483:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3934 00002000:00100000:3.0:1746065157.095489:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x70:0x0] (2277376->2281471) req@ffff88009a6ddc00 x1830881263682048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.095495:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddc00 with x1830881263682048 ext(2277376->2281471) 00002000:00010000:3.0:1746065157.095498:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddc00 00000100:00100000:0.0:1746065157.098338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.098478:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263682304 00000100:00100000:3.0:1746065157.098485:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263682304 00000100:00080000:0.0:1746065157.098551:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065157.098597:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4965 00000100:00100000:3.0:1746065157.098603:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+28:32436:x1830881263682304:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065157.098823:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+29:32436:x1830881263682304:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 219us (492us total) trans 8589936061 rc 0/0 00000100:00100000:3.0:1746065157.098828:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4965 00000100:00100000:0.0:1746065157.132398:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.132506:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263682432 00000100:00100000:1.0:1746065157.132515:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263682432 00000100:00100000:1.0:1746065157.132576:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13715 00000100:00100000:1.0:1746065157.132582:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:32441:x1830881263682432:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065157.132605:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.132621:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc1470435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93410c expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.132673:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.132684:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.132693:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.132704:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.132709:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.132714:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.132769:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.132802:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 40 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.132808:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.132833:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 40 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.132847:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 40 pid: 7203 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.132857:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263398400:192.168.202.27@tcp:104: 00000100:00080000:0.0:1746065157.132948:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065157.132953:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.134243:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263398400:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.134258:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065157.134514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.134658:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263682688 00000100:00100000:1.0:1746065157.134663:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263682688 00000100:00100000:1.0:1746065157.134743:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4966 00000100:00100000:1.0:1746065157.134750:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+41:30399:x1830881263682688:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065157.134954:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+42:30399:x1830881263682688:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 204us (440us total) trans 8589936062 rc 0/0 00000100:00100000:1.0:1746065157.134961:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4966 00000100:00080000:0.0:1746065157.134998:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065157.136825:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.137119:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263682816 00000100:00100000:2.0:1746065157.137125:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263682816 00010000:00010000:2.0:1746065157.137155:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 42 pid: 7203 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.137190:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6166 00000100:00100000:2.0:1746065157.137196:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263682816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.137207:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.137211:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 42 pid: 7203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.137221:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 42 pid: 7203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.137264:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1470355 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934079 expref: 42 pid: 7203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.137460:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.137465:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.137474:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.137480:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.137506:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065157.137560:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137567:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065157.137604:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065157.137607:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065157.137621:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137629:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137637:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137642:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137647:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137651:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065157.137654:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137659:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137666:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065157.137668:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.137671:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137674:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c400/0xad6b7ddc147043c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137683:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137687:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137691:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137694:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065157.137696:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137701:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137705:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5c00) 00010000:00010000:1.0:1746065157.137707:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.137709:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137712:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c800/0xad6b7ddc1470443 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.137739:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc1470435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.137750:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 13 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.137755:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.137756:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065157.137758:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00000100:00100000:2.0:1746065157.138185:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263682816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 988us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.138192:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6166 00000100:00100000:1.0:1746065157.138314:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:32441:x1830881263682432:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5731us (5928us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.138320:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13715 00000100:00100000:0.0:1746065157.140982:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.141020:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.141036:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263682944 00000100:00100000:3.0:1746065157.141045:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263682944 00000100:00100000:0.0:1746065157.141045:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.141069:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.141070:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263683200 00000100:00100000:1.0:1746065157.141075:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263683200 00000100:00080000:0.0:1746065157.141081:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065157.141084:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065157.141092:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263683072 00000100:00100000:0.0:1746065157.141094:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263683072 00000100:00100000:1.0:1746065157.141102:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263683328 00000100:00100000:1.0:1746065157.141104:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263683328 00000100:00100000:3.0:1746065157.141107:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13581 00000100:00100000:0.0:1746065157.141112:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13582 00000100:00100000:3.0:1746065157.141113:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263682944:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065157.141117:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263683200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065157.141132:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.141132:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.141148:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934121 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.141149:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc1470458 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934113 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.141170:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.141172:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.141181:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.141196:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065157.141200:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263398528:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065157.141210:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130112400, rc 0) 00000100:00100000:0.0:1746065157.141245:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263683200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 128us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.141272:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13582 00000100:00100000:1.0:1746065157.141285:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13583 00000100:00100000:0.0:1746065157.141290:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13584 00000100:00100000:1.0:1746065157.141292:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263683072:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065157.141295:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263683328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065157.141299:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.141301:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.141306:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc147045f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93411a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.141308:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934128 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.141317:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.141318:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.141321:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.141330:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.141335:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130113e00, rc 0) 00000100:00100000:1.0:1746065157.141336:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263398656:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065157.141392:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263683328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 97us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.141397:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13584 00000100:00100000:3.0:1746065157.141407:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.141410:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.141522:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.141559:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.141617:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263683456 00000100:00100000:3.0:1746065157.141620:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263683456 00000100:00100000:3.0:1746065157.141646:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263683584 00000100:00100000:3.0:1746065157.141649:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263683584 00000100:00100000:3.0:1746065157.141661:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13585 00000100:00100000:3.0:1746065157.141665:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263683456:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065157.141671:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065157.141673:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13586 00000100:00100000:0.0:1746065157.141677:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263683584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065157.141678:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc147046d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93412f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.141684:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.141689:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1470474 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934136 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.141700:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263398784:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065157.141707:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263398912:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065157.141723:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a25000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.141728:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b22040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.143167:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263398656:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065157.143186:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc147045f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93411a expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.143196:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc147045f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93411a expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.143204:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00000100:00100000:1.0:1746065157.143554:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263683072:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2260us (2506us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065157.143561:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13583 00002000:00010000:0.0:1746065157.143724:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime: 1746065156 -> 1746065157 00002000:00010000:0.0:1746065157.143727:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065156 -> 1746065157 00002000:00010000:0.0:1746065157.143729:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime: 1746065156 -> 1746065157 00000100:00100000:0.0:1746065157.143737:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263398912:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065157.143751:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1470474 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934136 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.143763:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d000/0xad6b7ddc1470474 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934136 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.143807:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d000, rc 0) 00000100:00100000:0.0:1746065157.143836:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263683584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2158us (2277us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065157.143842:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13586 00002000:00010000:2.0:1746065157.143845:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065156 -> 1746065157 00002000:00010000:2.0:1746065157.143848:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065156 -> 1746065157 00002000:00010000:2.0:1746065157.143850:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065156 -> 1746065157 00000100:00100000:2.0:1746065157.143860:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263398784:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.143886:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc147046d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93412f expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.143895:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc147046d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93412f expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.143903:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97000, rc 0) 00000100:00100000:2.0:1746065157.143922:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263683456:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2256us (2400us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.143927:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13585 00000100:00100000:3.0:1746065157.144040:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263398528:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065157.144057:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc1470458 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934113 expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.144066:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683be00/0xad6b7ddc1470458 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934113 expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.144075:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683be00, rc 0) 00000100:00100000:3.0:1746065157.144094:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263682944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2982us (3119us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065157.144100:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13581 00000100:00100000:0.0:1746065157.146751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.146810:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263683840 00000100:00100000:1.0:1746065157.146817:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263683840 00000100:00100000:1.0:1746065157.146958:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13716 00000100:00100000:1.0:1746065157.147116:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:32441:x1830881263683840:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065157.147132:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.147148:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc147047b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93413d expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.147238:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.147251:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.147258:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.147283:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.147294:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 14 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.147304:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263399040:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.147414:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.148892:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.148962:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263683968 00000100:00100000:2.0:1746065157.148968:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263683968 00010000:00010000:2.0:1746065157.148990:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 15 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.149027:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6167 00000100:00100000:2.0:1746065157.149033:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263683968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.149042:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.149046:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 15 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.149055:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 15 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.149080:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263399040:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.149336:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.149380:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30c00/0xad6b7ddc147044a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93410c expref: 15 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.149391:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.149394:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.149401:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.149407:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.149428:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065157.149551:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.149556:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065157.149571:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065157.149659:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc147047b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 16 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.149670:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.149675:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.149677:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065157.149679:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31a00, rc 0) 00000100:00100000:2.0:1746065157.149811:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263683968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 777us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.149821:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6167 00000100:00100000:1.0:1746065157.150159:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32441:x1830881263683840:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3193us (3413us total) trans 8589936063 rc 0/0 00000100:00100000:1.0:1746065157.150165:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13716 00000100:00100000:0.0:1746065157.151851:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.151991:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263684096 00000100:00100000:1.0:1746065157.151998:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263684096 00000100:00100000:1.0:1746065157.152041:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13717 00000100:00100000:1.0:1746065157.152047:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32441:x1830881263684096:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065157.152066:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.152080:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc1470490 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934144 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.152141:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.152153:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.152158:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.152181:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.152194:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 15 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.152203:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263399168:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.153911:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.153937:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263399168:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.153951:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:2.0:1746065157.154970:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.155211:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263684224 00000100:00100000:0.0:1746065157.155218:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263684224 00010000:00010000:0.0:1746065157.155241:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 16 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.155273:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6168 00000100:00100000:0.0:1746065157.155280:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263684224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.155292:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.155296:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 16 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.155305:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 16 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.155320:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1470482 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93413d expref: 16 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.155333:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065157.155337:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.155344:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.155349:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.155454:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065157.155476:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.155483:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065157.155484:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263684224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 204us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.155489:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6168 00000004:00200000:1.0:1746065157.155519:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065157.155522:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065157.155537:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.155566:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2c00/0xad6b7ddc1470490 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.155576:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.155582:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.155584:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065157.155586:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:1.0:1746065157.155617:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32441:x1830881263684096:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3570us (3770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.155623:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13717 00000100:00100000:2.0:1746065157.157799:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.158019:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.158039:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.158070:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.158127:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263684480 00000100:00100000:0.0:1746065157.158127:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263684736 00000100:00100000:1.0:1746065157.158133:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263684480 00000100:00100000:0.0:1746065157.158133:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263684736 00000100:00100000:3.0:1746065157.158175:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263684352 00000100:00100000:3.0:1746065157.158182:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263684352 00000100:00100000:3.0:1746065157.158204:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263684608 00000100:00100000:3.0:1746065157.158209:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263684608 00000100:00100000:2.0:1746065157.158217:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13587 00000100:00100000:2.0:1746065157.158224:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263684352:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065157.158237:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.158249:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb2400/0xad6b7ddc147049e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93414b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.158253:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13588 00000100:00100000:3.0:1746065157.158257:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263684608:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065157.158263:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.158269:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc14704a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934159 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.158287:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263399424:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.158287:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263399296:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065157.158330:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13589 00000100:00100000:2.0:1746065157.158333:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.158335:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263684480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065157.158341:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065157.158341:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13590 00000100:00100000:0.0:1746065157.158347:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263684736:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065157.158348:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc14704ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934152 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.158354:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.158361:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14704b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934160 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.158368:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263399552:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065157.158383:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263399680:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065157.158440:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a25000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.158471:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.158478:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b22040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.159818:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263399680:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065157.159818:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263399552:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065157.159836:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc14704ac lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934152 expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.159844:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2800/0xad6b7ddc14704ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934152 expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.159852:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2800, rc 0) 00000100:00100000:1.0:1746065157.159889:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263684480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1553us (2121us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065157.159894:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13589 00010000:00010000:2.0:1746065157.159947:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14704b3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934160 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.160043:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc14704b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934160 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.160051:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:2.0:1746065157.160071:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263684736:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1724us (2051us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.160076:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13590 00000100:00100000:3.0:1746065157.160538:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263399296:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065157.160559:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2400/0xad6b7ddc147049e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93414b expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.160571:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2400/0xad6b7ddc147049e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93414b expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.160590:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2400, rc 0) 00000100:00100000:3.0:1746065157.160622:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263684352:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2399us (2581us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065157.160626:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13587 00000100:00100000:3.0:1746065157.160656:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263399424:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065157.160669:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc14704a5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934159 expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.160677:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc14704a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934159 expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.160683:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25400, rc 0) 00000100:00100000:3.0:1746065157.160698:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263684608:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2440us (2627us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065157.160703:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13588 00000100:00100000:0.0:1746065157.165051:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.165123:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263684992 00000100:00100000:1.0:1746065157.165133:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263684992 00000100:00100000:1.0:1746065157.165273:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13718 00000100:00100000:1.0:1746065157.165281:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32441:x1830881263684992:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065157.165297:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.165312:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14704ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934167 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.165393:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.165404:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.165414:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065157.165423:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065157.165500:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14704ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.165511:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 16 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.165519:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.165521:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065157.165523:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2400, rc 0) 00000100:00100000:1.0:1746065157.166048:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32441:x1830881263684992:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 767us (1003us total) trans 8589936064 rc 0/0 00000100:00100000:1.0:1746065157.166054:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13718 00000100:00100000:0.0:1746065157.169016:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.169119:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.169257:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.169397:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.171043:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263685120 00000100:00100000:3.0:1746065157.171052:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263685120 00000100:00100000:3.0:1746065157.171089:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263685376 00000100:00100000:3.0:1746065157.171092:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263685376 00000100:00100000:3.0:1746065157.171102:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263685632 00000100:00100000:3.0:1746065157.171104:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263685632 00000100:00100000:3.0:1746065157.171117:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13591 00000100:00100000:3.0:1746065157.171124:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263685120:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065157.171158:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.171173:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.171180:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.171181:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.171183:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.171208:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.171217:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 27 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.171227:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263399808:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.172262:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13592 00000100:00100000:1.0:1746065157.172269:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263685376:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065157.172287:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172295:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 39 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.172302:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.172309:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 20 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.172314:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.172315:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.172317:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172333:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 20 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.172341:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 20 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.172349:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263399936:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.172390:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13593 00000100:00100000:1.0:1746065157.172395:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263685632:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065157.172415:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172424:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 16 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172429:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.172430:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.172432:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172445:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 16 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172452:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 16 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.172459:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263400064:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.172624:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263685248 00000100:00100000:1.0:1746065157.172628:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263685248 00000100:00100000:1.0:1746065157.172650:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13594 00000100:00100000:1.0:1746065157.172654:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263685248:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065157.172665:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172672:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172678:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.172679:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.172680:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172690:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172694:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 39 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.172699:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263400192:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.172708:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.172725:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263685504 00000100:00100000:1.0:1746065157.172727:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263685504 00000100:00100000:0.0:1746065157.172734:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.172740:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263685760 00000100:00100000:1.0:1746065157.172742:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263685760 00000100:00100000:1.0:1746065157.172750:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13595 00000100:00100000:1.0:1746065157.172754:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263685504:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065157.172766:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172787:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172793:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.172804:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.172809:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.172810:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.172812:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.172826:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.172833:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 16 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.172840:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263400320:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.172853:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13596 00000100:00100000:0.0:1746065157.172860:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263685760:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065157.172883:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.172893:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.172898:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065157.172899:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065157.172904:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.172922:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.172929:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 20 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.172936:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263400448:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.172974:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.173006:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263685888 00000100:00100000:1.0:1746065157.173009:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263685888 00000100:00100000:0.0:1746065157.173017:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.173021:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263686016 00000100:00100000:1.0:1746065157.173022:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263686016 00000100:00100000:1.0:1746065157.173031:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13597 00000100:00100000:1.0:1746065157.173036:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263685888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065157.173043:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.173051:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14704f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93416e expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.173070:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13598 00000100:00100000:1.0:1746065157.173077:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263400576:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.173078:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263686016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.173084:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.173090:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc1470500 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934175 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.173109:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263400704:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065157.175969:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.175984:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 14 pid: 9548 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.175997:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263400832:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.177126:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 41 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.177138:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 41 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.177147:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263400960:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.178418:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1af00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.178452:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263399936:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.178535:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.178548:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263400064:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.178567:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.178660:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.178671:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263400192:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.178681:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.178753:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.178762:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 17 pid: 9548 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.178786:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263401088:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.178929:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b22040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.178942:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a000 going to sleep for 11 seconds 00010000:00010000:2.0:1746065157.179893:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.179903:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 29 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.179911:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263401216:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.181282:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.181301:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.181309:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a25000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.181328:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263399808:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.181344:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.181591:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.181701:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263400448:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.181713:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.181764:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263400576:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065157.181797:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14704f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93416e expref: 29 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.181807:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4e00/0xad6b7ddc14704f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93416e expref: 29 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.181816:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4e00, rc 0) 00000100:00100000:1.0:1746065157.181841:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881263685888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8803us (8865us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065157.181848:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13597 00000100:00100000:1.0:1746065157.181923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.181939:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.181952:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263686528 00000100:00100000:1.0:1746065157.181957:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263686528 00002000:00100000:1.0:1746065157.181985:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1060863) req@ffff880129f41c00 x1830881263686528/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 12776/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.181993:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41c00 with x1830881263686528 ext(1048576->1060863) 00010000:00010000:1.0:1746065157.181999:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 42 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.182008:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 42 pid: 11461 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746065157.182017:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f41c00 00000100:00100000:1.0:1746065157.182028:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263686272 00000100:00100000:1.0:1746065157.182031:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263686272 00002000:00100000:1.0:1746065157.182041:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8a:0x0] (155648->1048575) req@ffff880129f41f80 x1830881263686272/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.182048:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41f80 with x1830881263686272 ext(155648->1048575) 00010000:00010000:1.0:1746065157.182052:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 28 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.182058:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 28 pid: 11461 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746065157.182062:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129f41f80 00000100:00100000:1.0:1746065157.182071:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1350 00000100:00100000:1.0:1746065157.182077:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263686528:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065157.182131:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.182149:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.182163:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263686784 00000100:00100000:3.0:1746065157.182166:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263686784 00002000:00100000:3.0:1746065157.182182:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2281471) req@ffff88008f3e4380 x1830881263686784/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.182189:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4380 with x1830881263686784 ext(2097152->2281471) 00010000:00010000:3.0:1746065157.182195:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 21 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.182208:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 21 pid: 11461 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746065157.182214:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e4380 00000100:00100000:3.0:1746065157.182225:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263686400 00000100:00100000:3.0:1746065157.182227:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263686400 00002000:00100000:3.0:1746065157.182238:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2740224->3145727) req@ffff88008f3e4a80 x1830881263686400/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.182245:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4a80 with x1830881263686400 ext(2740224->3145727) 00010000:00010000:3.0:1746065157.182249:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 17 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.182256:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 17 pid: 11461 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746065157.182262:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e4a80 00000100:00100000:3.0:1746065157.182278:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1351 00000100:00100000:3.0:1746065157.182284:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263686272:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065157.182289:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1352 00000100:00100000:1.0:1746065157.182294:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263686784:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065157.182362:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1353 00000100:00100000:1.0:1746065157.182366:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263686400:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065157.182405:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.182461:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263400832:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.182489:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263686144 00000100:00100000:3.0:1746065157.182492:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263686144 00000100:00100000:1.0:1746065157.182500:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263400960:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.182506:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 23 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.182513:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.182521:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263686656 00000100:00100000:3.0:1746065157.182523:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263686656 00010000:00010000:3.0:1746065157.182530:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 19 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.182542:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6169 00000100:00100000:3.0:1746065157.182547:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+23:2004:x1830881263686144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.182553:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065157.182553:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6170 00000100:00100000:1.0:1746065157.182558:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263686656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.182562:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 23 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.182566:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.182570:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 23 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.182575:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 19 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.182582:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 19 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.182585:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9dc00/0xad6b7ddc14703da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340cd expref: 23 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.182594:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065157.182596:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.182612:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+19:2004:x1830881263686656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.182613:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263686144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.182616:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6170 00000100:00100000:3.0:1746065157.182620:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6169 00000100:00100000:2.0:1746065157.183154:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263400704:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.183175:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc1470500 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934175 expref: 44 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.183184:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc1470500 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934175 expref: 44 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.183191:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2400, rc 0) 00000100:00100000:2.0:1746065157.183209:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881263686016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10133us (10191us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.183214:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13598 00010000:00010000:2.0:1746065157.183242:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c000/0xad6b7ddc14703e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340d4 expref: 18 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.183250:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263400320:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.184374:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.184460:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263687296 00000100:00100000:0.0:1746065157.184466:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263687296 00000100:00100000:0.0:1746065157.184502:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13719 00000100:00100000:0.0:1746065157.184511:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+41:32445:x1830881263687296:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065157.184528:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.184545:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc1470507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93417c expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.184626:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.184638:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.184644:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.184652:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 5/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.184672:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.184681:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 15 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.184691:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263401344:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.184746:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.184753:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 15 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.184761:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa6300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263401472:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.185448:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b22040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.185495:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263686528:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3417us (3904us total) trans 17179873523 rc 0/0 00000100:00100000:2.0:1746065157.185505:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1350 00002000:00100000:2.0:1746065157.185513:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->1060863) req@ffff880129f41c00 x1830881263686528/t17179873523(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 12776/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.185522:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41c00 with x1830881263686528 ext(1048576->1060863) 00010000:00010000:2.0:1746065157.185528:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 42 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.185537:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 42 pid: 11461 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.185542:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f41c00 00000100:00100000:3.0:1746065157.187352:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.187378:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263686912 00000100:00100000:3.0:1746065157.187387:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263686912 00010000:00010000:3.0:1746065157.187421:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 15 pid: 9548 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.187446:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6171 00000100:00100000:3.0:1746065157.187453:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263686912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.187463:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.187482:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 15 pid: 9548 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.187492:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 15 pid: 9548 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.187510:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130112400/0xad6b7ddc1470451 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934121 expref: 15 pid: 9548 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.187528:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.187569:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263686912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.187573:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6171 00000100:00100000:3.0:1746065157.187599:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.187607:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263687040 00000100:00100000:3.0:1746065157.187609:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263687040 00010000:00010000:3.0:1746065157.187617:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 42 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.187627:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6172 00000100:00100000:3.0:1746065157.187629:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263687040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.187634:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.187638:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 42 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.187646:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 42 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.187654:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc14703b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340aa expref: 42 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.187659:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.187661:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.187664:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.187669:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.187682:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.187691:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263687040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 61us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.187694:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6172 00010000:00010000:1.0:1746065157.187893:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.187901:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.187920:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.187927:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.187939:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.187945:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065157.187948:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.187955:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.187964:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.187969:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14704d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.188019:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263685376:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 15750us (18900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.188026:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13592 00000100:00100000:0.0:1746065157.190079:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.190101:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263401088:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.190112:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263401216:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.190135:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.190939:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263687424 00000100:00100000:3.0:1746065157.190947:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263687424 00010000:00010000:3.0:1746065157.190977:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 18 pid: 9548 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.191002:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6173 00000100:00100000:3.0:1746065157.191009:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263687424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.191020:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.191037:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 18 pid: 9548 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.191045:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 18 pid: 9548 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.191062:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130113e00/0xad6b7ddc1470466 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934128 expref: 18 pid: 9548 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.191075:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.191111:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263687424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.191116:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6173 00000100:00100000:3.0:1746065157.192181:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263686784:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 9882us (10047us total) trans 17179873524 rc 0/0 00000100:00100000:3.0:1746065157.192189:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1352 00002000:00100000:3.0:1746065157.192197:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->2281471) req@ffff88008f3e4380 x1830881263686784/t17179873524(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.192203:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4380 with x1830881263686784 ext(2097152->2281471) 00010000:00010000:3.0:1746065157.192209:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.192216:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746065157.192220:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e4380 00000100:00100000:3.0:1746065157.192603:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.192640:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.192705:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263687552 00000100:00100000:0.0:1746065157.192710:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263687552 00010000:00010000:0.0:1746065157.192725:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 41 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.192749:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6174 00000100:00100000:0.0:1746065157.192755:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263687552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.192765:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.192792:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 41 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.192800:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 41 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.193256:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.193288:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.193292:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263687936 00000100:00100000:2.0:1746065157.193296:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263687936 00010000:00010000:2.0:1746065157.193310:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 16 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.193325:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263687808 00000100:00100000:2.0:1746065157.193327:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263687808 00010000:00010000:2.0:1746065157.193334:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 17 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.193336:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263687680 00000100:00100000:1.0:1746065157.193339:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263687680 00000100:00100000:2.0:1746065157.193346:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6175 00000100:00100000:2.0:1746065157.193350:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263687936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.193358:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065157.193359:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13599 00010000:00010000:2.0:1746065157.193363:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 17 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.193363:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:32446:x1830881263687680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.193369:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 17 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.193375:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.193387:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934183 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.193396:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.193400:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.193407:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.193407:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.193410:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.193415:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065157.193416:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065157.193419:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.193430:0:12260:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.193436:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263687936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065157.193440:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.193441:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6175 00010000:00010000:1.0:1746065157.193447:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4c00, rc 0) 00000100:00100000:2.0:1746065157.193451:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6176 00000100:00100000:2.0:1746065157.193455:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263687808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.193460:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065157.193461:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:32446:x1830881263687680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 98us (821us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065157.193463:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 16 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.193465:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13599 00010000:00010000:2.0:1746065157.193470:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 16 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.193479:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.193482:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.193488:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.193495:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.193505:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.193519:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263687808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.193523:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6176 00010000:00010000:0.0:1746065157.194850:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3600/0xad6b7ddc1470419 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340f0 expref: 41 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.194881:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.194884:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.194886:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.194892:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.194907:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.194931:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881263687552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2175us (2332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.194936:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6174 00010000:00010000:0.0:1746065157.194978:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2400/0xad6b7ddc14704c1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934167 expref: 15 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.194988:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263401344:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.194997:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1470497 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934144 expref: 14 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.195004:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa6300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263401472:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.195017:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.195023:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.195027:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065157.195041:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:0.0:1746065157.195142:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc1470507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 44 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.195152:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 43 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.195158:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065157.195160:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065157.195162:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d000, rc 0) 00000100:00100000:0.0:1746065157.195179:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+43:32445:x1830881263687296:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10668us (10809us total) trans 8589936065 rc 0/0 00000100:00100000:0.0:1746065157.195185:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13719 00000100:00100000:2.0:1746065157.195915:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065157.196242:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.196251:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.196269:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.196279:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.196285:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.196290:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065157.196293:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.196299:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.196310:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.196314:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc14704e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.196355:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263685248:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 23698us (26956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.196363:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13594 00000100:00100000:0.0:1746065157.196445:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263688064 00000100:00100000:0.0:1746065157.196451:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263688064 00010000:00010000:0.0:1746065157.196472:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 33 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.196496:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6177 00000100:00100000:0.0:1746065157.196503:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263688064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.196512:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.196524:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 33 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.196533:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 33 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.196545:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2600/0xad6b7ddc14703a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934095 expref: 33 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.196557:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.196558:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.196561:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.196568:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.196582:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.196601:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263688064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.196606:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6177 00010000:00010000:2.0:1746065157.199082:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.199098:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.199119:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.199125:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.199132:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.199138:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065157.199142:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.199148:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.199160:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.199165:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9c400/0xad6b7ddc14704eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.199229:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263686400:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 16855us (17072us total) trans 21474840978 rc 0/0 00000100:00100000:0.0:1746065157.199241:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1353 00002000:00100000:0.0:1746065157.199252:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2740224->3145727) req@ffff88008f3e4a80 x1830881263686400/t21474840978(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065157.199259:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263685504:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 26502us (26550us total) trans 0 rc 0/0 00002000:00100000:0.0:1746065157.199261:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4a80 with x1830881263686400 ext(2740224->3145727) 00000100:00100000:2.0:1746065157.199267:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13595 00010000:00010000:0.0:1746065157.199269:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 18 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.199280:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 18 pid: 11461 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746065157.199285:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e4a80 00000100:00100000:3.0:1746065157.201091:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263686272:12345-192.168.202.27@tcp:4:cat.0 Request processed in 18801us (19145us total) trans 21474840977 rc 0/0 00000100:00100000:3.0:1746065157.201101:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1351 00002000:00100000:3.0:1746065157.201110:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8a:0x0] (155648->1048575) req@ffff880129f41f80 x1830881263686272/t21474840977(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.201117:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41f80 with x1830881263686272 ext(155648->1048575) 00010000:00010000:3.0:1746065157.201123:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 30 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.201132:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 30 pid: 11461 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746065157.201137:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129f41f80 00000100:00100000:0.0:1746065157.202398:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.202434:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263688192 00000100:00100000:2.0:1746065157.202441:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263688192 00010000:00010000:2.0:1746065157.202461:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.202490:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6178 00000100:00100000:2.0:1746065157.202497:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263688192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.202507:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.202521:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.202530:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.202546:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc147042e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934105 expref: 22 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.202557:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.202559:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.202562:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.202570:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.202596:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.202633:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263688192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 137us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.202639:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6178 00010000:00010000:1.0:1746065157.202831:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.202840:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.202854:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.202860:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.202867:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.202872:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065157.202885:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.202891:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.202900:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.202905:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14704f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.203149:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263685760:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 30289us (30413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.203157:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13596 00000100:00100000:0.0:1746065157.204999:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.205021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.205072:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263688320 00000100:00100000:1.0:1746065157.205078:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263688320 00000100:00100000:1.0:1746065157.205118:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13600 00000100:00100000:1.0:1746065157.205124:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:32445:x1830881263688320:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065157.205138:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.205151:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93418a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.205173:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.205176:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.205180:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065157.205183:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3162112->3268607] (req 3162112->3268607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.205194:0:3067:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.205203:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3162112->3268607] (req 3162112->3268607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.205210:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5600, rc 0) 00000100:00100000:1.0:1746065157.205249:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:32445:x1830881263688320:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.205254:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13600 00000100:00100000:0.0:1746065157.205453:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.205678:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263688448 00000100:00100000:2.0:1746065157.205682:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263688448 00010000:00010000:2.0:1746065157.205697:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 18 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.205723:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263688576 00000100:00100000:2.0:1746065157.205725:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263688576 00010000:00010000:2.0:1746065157.205733:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 31 pid: 11461 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.205747:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6179 00000100:00100000:2.0:1746065157.205752:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+18:2004:x1830881263688448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.205760:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.205797:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 18 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.205805:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 18 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.205820:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a200/0xad6b7ddc1470427 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2740224->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340fe expref: 18 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.205829:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.205830:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.205834:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.205839:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.205854:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.205885:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+17:2004:x1830881263688448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 132us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.205891:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6179 00000100:00100000:2.0:1746065157.205902:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6180 00000100:00100000:2.0:1746065157.205907:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263688576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.205914:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.205921:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 31 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.206306:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 31 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.206317:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3e00/0xad6b7ddc147040b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 155648->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9340e2 expref: 31 pid: 11461 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.206324:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.206326:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.206328:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206334:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206652:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.206672:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263688576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 764us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.206676:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6180 00010000:00010000:2.0:1746065157.206716:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206722:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206736:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206746:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206751:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206756:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065157.206759:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206764:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206789:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.206791:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.206794:0:9550:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206800:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.206819:0:9550:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.206830:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263401600:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065157.207121:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207129:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207141:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207147:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207156:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207161:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71aa00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065157.207163:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207169:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207177:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.207178:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.207181:0:12258:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207187:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.207205:0:12258:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.207212:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263401728:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065157.207571:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.207641:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.212094:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263401728:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065157.212127:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.212139:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14704cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.212194:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263685120:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 41070us (43184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.212202:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13591 00000100:00100000:2.0:1746065157.212286:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263401600:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065157.212297:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.212303:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3400/0xad6b7ddc14704dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.212327:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263685632:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 39932us (43071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.212332:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13593 00000100:00100000:0.0:1746065157.217346:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.217533:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.218054:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.218075:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263689344 00000100:00100000:0.0:1746065157.218081:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263689344 00000100:00100000:3.0:1746065157.218303:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263688832 00000100:00100000:3.0:1746065157.218307:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263688832 00002000:00100000:3.0:1746065157.218344:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3162112->3166207) req@ffff880097fa4380 x1830881263688832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.218353:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa4380 with x1830881263688832 ext(3162112->3166207) 00002000:00010000:3.0:1746065157.218357:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa4380 00000100:00100000:3.0:1746065157.218366:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263688960 00000100:00100000:3.0:1746065157.218368:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263688960 00002000:00100000:3.0:1746065157.218375:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097fa4a80 x1830881263688960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.218381:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa4a80 with x1830881263688960 ext(0->1048575) 00002000:00010000:3.0:1746065157.218383:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa4a80 00000100:00100000:0.0:1746065157.219800:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13720 00000100:00100000:0.0:1746065157.219810:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32441:x1830881263689344:12345-192.168.202.27@tcp:36:lfs.0 00000100:00100000:0.0:1746065157.219902:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32441:x1830881263689344:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 93us (1848us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746065157.219908:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13720 00000100:00100000:3.0:1746065157.220180:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3935 00000100:00100000:1.0:1746065157.220187:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3936 00000100:00100000:3.0:1746065157.220188:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263688832:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065157.220195:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263688960:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065157.220283:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881263688832:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 95us (2944us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065157.220289:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3935 00002000:00100000:3.0:1746065157.220294:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3162112->3166207) req@ffff880097fa4380 x1830881263688832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.220302:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa4380 with x1830881263688832 ext(3162112->3166207) 00002000:00010000:3.0:1746065157.220306:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa4380 00000100:00100000:2.0:1746065157.226441:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.227373:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263689600 00000100:00100000:1.0:1746065157.227383:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263689600 00000100:00100000:1.0:1746065157.227424:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4967 00000100:00100000:1.0:1746065157.227432:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:32441:x1830881263689600:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065157.227608:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:32441:x1830881263689600:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 176us (1175us total) trans 8589936066 rc 0/0 00000100:00100000:1.0:1746065157.227614:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4967 00000100:00100000:2.0:1746065157.227906:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.228247:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263689856 00000100:00100000:3.0:1746065157.228251:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263689856 00002000:00100000:3.0:1746065157.228276:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3264512->3268607) req@ffff88011dad4000 x1830881263689856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.228285:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4000 with x1830881263689856 ext(3264512->3268607) 00002000:00010000:3.0:1746065157.228290:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad4000 00000100:00100000:3.0:1746065157.228302:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3937 00000100:00100000:3.0:1746065157.228307:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263689856:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065157.228402:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881263689856:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 94us (495us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065157.228408:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3937 00002000:00100000:3.0:1746065157.228412:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3264512->3268607) req@ffff88011dad4000 x1830881263689856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.228419:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4000 with x1830881263689856 ext(3264512->3268607) 00002000:00010000:3.0:1746065157.228421:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad4000 00000100:00100000:1.0:1746065157.228954:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263688960:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8760us (11420us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.229614:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3936 00002000:00100000:1.0:1746065157.229622:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff880097fa4a80 x1830881263688960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.229630:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa4a80 with x1830881263688960 ext(0->1048575) 00002000:00010000:1.0:1746065157.229633:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa4a80 00000100:00100000:0.0:1746065157.237325:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.237425:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263690112 00000100:00100000:1.0:1746065157.237434:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263690112 00000100:00100000:1.0:1746065157.237625:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4968 00000100:00100000:1.0:1746065157.237633:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:32441:x1830881263690112:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065157.238438:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32441:x1830881263690112:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 804us (1119us total) trans 8589936067 rc 0/0 00000100:00100000:1.0:1746065157.238446:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4968 00000100:00100000:0.0:1746065157.239081:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.239175:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263690368 00000100:00100000:2.0:1746065157.239180:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263690368 00000100:00100000:2.0:1746065157.239221:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13721 00000100:00100000:2.0:1746065157.239227:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+29:32448:x1830881263690368:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065157.239242:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.239257:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147052a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934191 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.239308:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239318:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239327:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239337:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239342:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239346:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239414:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc147053f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239423:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc147053f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239428:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc147053f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065157.239435:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065157.239472:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239477:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239482:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239487:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239492:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065157.239495:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239501:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239514:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065157.239517:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065157.239520:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239524:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3400/0xad6b7ddc1470531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239551:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239555:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239560:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239564:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065157.239566:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239570:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239576:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a300) 00010000:00010000:2.0:1746065157.239579:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065157.239581:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239585:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1470538 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065157.239612:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147052a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934191 expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.239622:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc147053f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934191 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.239628:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.239630:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065157.239632:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:2.0:1746065157.239661:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+31:32448:x1830881263690368:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 434us (581us total) trans 8589936068 rc 0/0 00000100:00100000:2.0:1746065157.239665:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13721 00000100:00100000:0.0:1746065157.240857:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.240918:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263690496 00000100:00100000:3.0:1746065157.240923:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263690496 00000100:00100000:3.0:1746065157.240954:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13601 00000100:00100000:3.0:1746065157.240960:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+40:32446:x1830881263690496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.240971:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.240984:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934198 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065157.241004:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d705, atime: 0x6812d705, ctime: 0x6812d705, blocks: 0x808 00010000:00010000:3.0:1746065157.241018:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.241019:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.241026:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 41 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.241036:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 41 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.241043:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ae00, rc 0) 00000100:00100000:3.0:1746065157.241077:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+41:32446:x1830881263690496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 118us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.241082:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13601 00000100:00100000:0.0:1746065157.242664:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.242705:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263690624 00000100:00100000:2.0:1746065157.242710:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263690624 00000100:00100000:2.0:1746065157.242757:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 728 00000100:00100000:2.0:1746065157.242763:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+31:2006:x1830881263690624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.242793:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.242811:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2a00/0xad6b7ddc147053f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934191 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.242824:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.242826:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.242862:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+30:2006:x1830881263690624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.242867:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 728 00000100:00100000:0.0:1746065157.245410:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.246061:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263690880 00000100:00100000:2.0:1746065157.246070:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263690880 00000100:00100000:2.0:1746065157.246105:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13722 00000100:00100000:2.0:1746065157.246112:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+30:32452:x1830881263690880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.246132:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.246146:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2e00/0xad6b7ddc1470554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93419f expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.246211:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246222:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246231:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246242:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246246:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246251:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246326:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470569 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246334:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470569 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246338:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470569 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065157.246345:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065157.246393:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246402:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246407:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246411:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065157.246413:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246418:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246425:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065157.246428:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065157.246430:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246434:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc147055b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246443:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246447:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246450:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246454:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a852aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065157.246456:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246463:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246467:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ef2a100) 00010000:00010000:2.0:1746065157.246469:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065157.246470:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246474:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc1470562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.246499:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2e00/0xad6b7ddc1470554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93419f expref: 33 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.246507:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470569 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93419f expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.246512:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.246513:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065157.246515:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852a200, rc 0) 00000100:00100000:2.0:1746065157.246553:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+32:32452:x1830881263690880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 442us (1146us total) trans 8589936069 rc 0/0 00000100:00100000:2.0:1746065157.246558:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13722 00000100:00100000:1.0:1746065157.248052:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.249068:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263691136 00000100:00100000:2.0:1746065157.249075:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263691136 00002000:00100000:2.0:1746065157.249109:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880129f43480 x1830881263691136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.249119:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43480 with x1830881263691136 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.249125:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f43480 00000100:00100000:2.0:1746065157.249153:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3938 00000100:00100000:2.0:1746065157.249160:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263691136:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065157.254222:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.254380:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263691264 00000100:00100000:2.0:1746065157.254387:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263691264 00000100:00100000:2.0:1746065157.254434:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13602 00000100:00100000:2.0:1746065157.254442:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+21:32448:x1830881263691264:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065157.254457:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.254472:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341a6 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.254497:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 42 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.254503:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.254505:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.254508:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1085440->1404927] (req 1085440->1404927) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.254531:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 42 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.254541:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 42 pid: 9550 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.254551:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263401856:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.254624:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.255378:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263691136:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 6216us (7326us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.255396:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3938 00002000:00100000:2.0:1746065157.255403:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880129f43480 x1830881263691136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.255410:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43480 with x1830881263691136 ext(1048576->2097151) 00010000:00010000:2.0:1746065157.255415:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 41 pid: 9550 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.255424:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 41 pid: 9550 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.255430:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f43480 00000100:00100000:0.0:1746065157.255893:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.256537:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.256593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.256719:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263691520 00000100:00100000:2.0:1746065157.256723:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263691520 00000100:00100000:2.0:1746065157.256756:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263691648 00000100:00100000:2.0:1746065157.256758:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263691648 00000100:00100000:1.0:1746065157.256919:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263691392 00000100:00100000:1.0:1746065157.256922:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263691392 00000100:00100000:1.0:1746065157.256951:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 729 00000100:00100000:1.0:1746065157.256957:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+32:2005:x1830881263691392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.256966:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065157.256985:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470569 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93419f expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.257001:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.257004:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.257026:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+31:2005:x1830881263691392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.257031:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 729 00000100:00100000:2.0:1746065157.257262:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13603 00000100:00100000:2.0:1746065157.257268:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+17:2006:x1830881263691520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.257279:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.257291:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341ad expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.257310:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.257312:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.257318:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 18 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.257335:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 18 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.257344:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090790600, rc 0) 00000100:00100000:2.0:1746065157.257364:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+18:2006:x1830881263691520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 96us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.257369:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13603 00000100:00100000:2.0:1746065157.257379:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13604 00000100:00100000:2.0:1746065157.257383:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263691648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.257389:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.257397:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1470585 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341b4 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.257407:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.257412:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1470585 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341b4 expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.257418:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1470585 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341b4 expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.257425:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:2.0:1746065157.257438:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263691648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (845us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.257443:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13604 00000100:00100000:2.0:1746065157.258307:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263401856:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.258325:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1085440->1404927] (req 1085440->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.258332:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3600, rc 0) 00000100:00100000:2.0:1746065157.258356:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+22:32448:x1830881263691264:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3916us (4142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.258361:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13602 00000100:00100000:0.0:1746065157.258527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.258571:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.258595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.258613:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.258732:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263691776 00000100:00100000:3.0:1746065157.258736:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263691776 00000100:00100000:3.0:1746065157.258753:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263691904 00000100:00100000:3.0:1746065157.258755:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263691904 00000100:00100000:3.0:1746065157.258765:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263692032 00000100:00100000:3.0:1746065157.258766:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263692032 00000100:00100000:3.0:1746065157.258788:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263692160 00000100:00100000:3.0:1746065157.258790:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263692160 00000100:00100000:3.0:1746065157.258809:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13605 00000100:00100000:3.0:1746065157.258814:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2007:x1830881263691776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.258821:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.258831:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341bb expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065157.258851:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d704, atime: 0x6812d704, ctime: 0x6812d704, blocks: 0x800 00010000:00010000:3.0:1746065157.258859:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.258860:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.258865:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.258884:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.258890:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bef600, rc 0) 00000100:00100000:3.0:1746065157.258909:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+24:2007:x1830881263691776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 96us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.258914:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13605 00000100:00100000:3.0:1746065157.258925:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13606 00000100:00100000:3.0:1746065157.258929:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263691904:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.258934:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.258943:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341c2 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065157.258954:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d703, atime: 0x6812d703, ctime: 0x6812d703, blocks: 0x808 00010000:00010000:3.0:1746065157.258962:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.258963:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.258967:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.258974:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.258981:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131beec00, rc 0) 00000100:00100000:3.0:1746065157.258995:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263691904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.258999:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13606 00000100:00100000:3.0:1746065157.259007:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13607 00000100:00100000:3.0:1746065157.259011:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263692032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.259015:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.259020:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131bee200/0xad6b7ddc147059a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341c9 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.259046:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263401984:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065157.259090:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.259101:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13608 00000100:00100000:3.0:1746065157.259106:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263692160:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.259111:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.259118:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341d0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065157.259127:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d705, atime: 0x6812d704, ctime: 0x6812d705, blocks: 0x1000 00010000:00010000:3.0:1746065157.259134:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.259135:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.259138:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.259150:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.259155:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b800, rc 0) 00000100:00100000:3.0:1746065157.259169:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263692160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 63us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.259173:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13608 00000100:00100000:0.0:1746065157.262937:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.263118:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.263572:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263692288 00000100:00100000:2.0:1746065157.263580:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263692288 00000100:00100000:2.0:1746065157.264047:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13609 00000100:00100000:2.0:1746065157.264055:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+41:32446:x1830881263692288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.264070:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.264087:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341d7 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.264108:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.264109:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.264116:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.264129:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.264137:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3800, rc 0) 00000100:00100000:1.0:1746065157.264735:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263692416 00000100:00100000:1.0:1746065157.264740:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263692416 00010000:00010000:1.0:1746065157.264758:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 43 pid: 9550 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.265249:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6181 00000100:00100000:1.0:1746065157.265256:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263692416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.265266:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065157.265282:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 43 pid: 9550 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.265292:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 43 pid: 9550 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.265306:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147054d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934198 expref: 43 pid: 9550 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.265397:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+42:32446:x1830881263692288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1341us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.265403:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13609 00010000:00010000:1.0:1746065157.265884:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.265887:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.265892:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.265900:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.265925:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.265935:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263402112:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065157.266501:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.268996:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263401984:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065157.269025:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131bee200/0xad6b7ddc147059a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c9 expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.269036:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131bee200/0xad6b7ddc147059a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c9 expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.269048:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee200, rc 0) 00000100:00100000:3.0:1746065157.269082:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+19:2006:x1830881263692032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10068us (10484us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065157.269089:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13607 00000100:00100000:0.0:1746065157.269490:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.269629:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263402112:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065157.269640:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.269660:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263692416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4405us (6543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.269667:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6181 00000100:00100000:3.0:1746065157.269802:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263692672 00000100:00100000:3.0:1746065157.269807:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263692672 00002000:00100000:3.0:1746065157.269836:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88012dc3fb80 x1830881263692672/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.269844:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3fb80 with x1830881263692672 ext(1048576->2097151) 00002000:00010000:3.0:1746065157.269848:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3fb80 00000100:00100000:3.0:1746065157.269872:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3939 00000100:00100000:3.0:1746065157.269891:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263692672:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065157.270663:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.271377:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263692928 00000100:00100000:1.0:1746065157.271381:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263692928 00002000:00100000:1.0:1746065157.271400:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1085440->1089535) req@ffff88012dc3d180 x1830881263692928/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.271408:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d180 with x1830881263692928 ext(1085440->1089535) 00002000:00010000:1.0:1746065157.271411:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3d180 00000100:00100000:1.0:1746065157.271425:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3940 00000100:00100000:1.0:1746065157.271431:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263692928:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065157.271505:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263692928:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 74us (843us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065157.271510:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3940 00002000:00100000:1.0:1746065157.271514:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1085440->1089535) req@ffff88012dc3d180 x1830881263692928/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.271520:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d180 with x1830881263692928 ext(1085440->1089535) 00002000:00010000:1.0:1746065157.271522:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3d180 00000100:00100000:3.0:1746065157.282517:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881263692672:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12617us (13018us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.282527:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3939 00002000:00100000:3.0:1746065157.282538:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88012dc3fb80 x1830881263692672/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.282547:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3fb80 with x1830881263692672 ext(1048576->2097151) 00002000:00010000:3.0:1746065157.282554:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3fb80 00000100:00100000:0.0:1746065157.290839:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.290905:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263693184 00000100:00100000:3.0:1746065157.290913:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263693184 00002000:00100000:3.0:1746065157.290952:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88012dc3df80 x1830881263693184/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.290962:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3df80 with x1830881263693184 ext(0->1048575) 00002000:00010000:3.0:1746065157.290966:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3df80 00000100:00100000:3.0:1746065157.290981:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3941 00000100:00100000:3.0:1746065157.290988:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263693184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065157.291313:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.291340:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.291363:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.291519:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263693440 00000100:00100000:3.0:1746065157.291522:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263693952 00000100:00100000:1.0:1746065157.291523:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263693440 00000100:00100000:3.0:1746065157.291525:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263693952 00002000:00100000:1.0:1746065157.291544:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88011dad5880 x1830881263693440/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 504/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.291553:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5880 with x1830881263693440 ext(1048576->2097151) 00000100:00100000:3.0:1746065157.291554:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13610 00002000:00010000:1.0:1746065157.291556:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5880 00000100:00100000:3.0:1746065157.291558:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:32446:x1830881263693952:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065157.291565:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263693696 00010000:00010000:3.0:1746065157.291567:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065157.291567:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263693696 00002000:00100000:1.0:1746065157.291576:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88011dad6a00 x1830881263693696/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065157.291581:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341de expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065157.291582:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6a00 with x1830881263693696 ext(1048576->2097151) 00002000:00010000:1.0:1746065157.291585:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad6a00 00000100:00100000:1.0:1746065157.291596:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3942 00000100:00100000:1.0:1746065157.291601:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263693440:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:3.0:1746065157.291602:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.291603:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.291609:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.291622:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.291630:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04a000, rc 0) 00000100:00100000:3.0:1746065157.291662:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:32446:x1830881263693952:12345-192.168.202.27@tcp:101:cat.0 Request processed in 103us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.291667:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13610 00000100:00100000:0.0:1746065157.291719:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3943 00000100:00100000:0.0:1746065157.291726:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263693696:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065157.292333:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.292403:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263694080 00000100:00100000:2.0:1746065157.292406:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263694080 00002000:00100000:2.0:1746065157.292424:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009a6dc000 x1830881263694080/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.292431:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881263694080 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.292434:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:2.0:1746065157.292448:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3944 00000100:00100000:2.0:1746065157.292453:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263694080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065157.300409:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+21:2005:x1830881263693184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9411us (9645us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.300418:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3941 00002000:00100000:3.0:1746065157.300428:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88012dc3df80 x1830881263693184/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.300436:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3df80 with x1830881263693184 ext(0->1048575) 00002000:00010000:3.0:1746065157.300441:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3df80 00000100:00100000:1.0:1746065157.304359:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263693440:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12750us (13039us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746065157.304372:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3942 00002000:00100000:1.0:1746065157.304381:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88011dad5880 x1830881263693440/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 504/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.304388:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5880 with x1830881263693440 ext(1048576->2097151) 00002000:00010000:1.0:1746065157.304393:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5880 00000100:00100000:2.0:1746065157.313383:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263694080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20922us (21043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.313393:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3944 00002000:00100000:2.0:1746065157.313402:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009a6dc000 x1830881263694080/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.313412:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881263694080 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.313417:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:0.0:1746065157.316011:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.316215:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263693696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24488us (24872us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.316224:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3943 00002000:00100000:3.0:1746065157.316232:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88011dad6a00 x1830881263693696/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.316246:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6a00 with x1830881263693696 ext(1048576->2097151) 00000100:00100000:2.0:1746065157.316246:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263694336 00002000:00010000:3.0:1746065157.316250:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad6a00 00000100:00100000:2.0:1746065157.316253:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263694336 00002000:00100000:2.0:1746065157.316283:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012dc3dc00 x1830881263694336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.316291:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3dc00 with x1830881263694336 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.316295:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3dc00 00000100:00100000:2.0:1746065157.316319:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3945 00000100:00100000:2.0:1746065157.316326:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263694336:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065157.324522:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.325212:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263694336:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8884us (9206us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.325223:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3945 00002000:00100000:2.0:1746065157.325231:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88012dc3dc00 x1830881263694336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.325239:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3dc00 with x1830881263694336 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.325244:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3dc00 00000100:00100000:1.0:1746065157.325312:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263694592 00000100:00100000:1.0:1746065157.325319:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263694592 00000100:00100000:1.0:1746065157.326018:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4969 00000100:00100000:1.0:1746065157.326027:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+31:32448:x1830881263694592:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065157.326172:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+32:32448:x1830881263694592:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 147us (1656us total) trans 8589936070 rc 0/0 00000100:00100000:1.0:1746065157.326177:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4969 00000100:00100000:0.0:1746065157.337185:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.337232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.337306:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263694848 00000100:00100000:2.0:1746065157.337314:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263694848 00002000:00100000:2.0:1746065157.337351:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88012dc3d500 x1830881263694848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.337361:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d500 with x1830881263694848 ext(2097152->3145727) 00002000:00010000:2.0:1746065157.337365:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3d500 00000100:00100000:2.0:1746065157.337385:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3946 00000100:00100000:2.0:1746065157.337392:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263694848:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065157.338057:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263694976 00000100:00100000:3.0:1746065157.338061:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263694976 00000100:00100000:3.0:1746065157.338084:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13611 00000100:00100000:3.0:1746065157.338090:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+19:32452:x1830881263694976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.338098:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.338111:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341e5 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.338130:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.338137:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.338138:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.338141:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 20 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.338163:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.338172:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 32 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.338181:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263402240:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.338479:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.343262:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263694848:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5861us (6074us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.343271:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3946 00002000:00100000:2.0:1746065157.343280:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff88012dc3d500 x1830881263694848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.343289:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d500 with x1830881263694848 ext(2097152->3145727) 00010000:00010000:2.0:1746065157.343302:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 31 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.343315:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 31 pid: 3067 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.343322:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3d500 00000100:00100000:3.0:1746065157.343400:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263402240:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.343420:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 20 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.343432:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31200, rc 0) 00000100:00100000:3.0:1746065157.343450:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+20:32452:x1830881263694976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5360us (6218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.343456:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13611 00000100:00100000:0.0:1746065157.343994:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.344049:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263695104 00000100:00100000:2.0:1746065157.344054:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263695104 00002000:00100000:2.0:1746065157.344076:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3162112->3268607) req@ffff88012dc3f100 x1830881263695104/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.344084:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f100 with x1830881263695104 ext(3162112->3268607) 00010000:00010000:2.0:1746065157.344088:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 31 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.344097:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 31 pid: 3067 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.344102:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3f100 00000100:00100000:2.0:1746065157.344116:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1354 00000100:00100000:2.0:1746065157.344123:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263695104:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065157.346826:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.346967:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263695232 00000100:00100000:3.0:1746065157.346973:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263695232 00000100:00100000:3.0:1746065157.347003:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13612 00000100:00100000:3.0:1746065157.347008:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+41:32446:x1830881263695232:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.347020:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.347032:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341ec expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.347051:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.347053:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.347058:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.347069:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.347076:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31a00, rc 0) 00000100:00100000:3.0:1746065157.347653:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+42:32446:x1830881263695232:12345-192.168.202.27@tcp:101:cat.0 Request processed in 643us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.347662:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13612 00000100:00100000:2.0:1746065157.347832:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263695104:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3708us (3838us total) trans 21474840979 rc 0/0 00000100:00100000:2.0:1746065157.347839:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1354 00002000:00100000:2.0:1746065157.347951:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (3162112->3268607) req@ffff88012dc3f100 x1830881263695104/t21474840979(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.347966:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f100 with x1830881263695104 ext(3162112->3268607) 00010000:00010000:2.0:1746065157.347973:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.347984:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.347989:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3f100 00000100:00100000:0.0:1746065157.353528:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.353687:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263695488 00000100:00100000:2.0:1746065157.353696:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263695488 00002000:00100000:2.0:1746065157.353731:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880097fa2300 x1830881263695488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.353740:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2300 with x1830881263695488 ext(2097152->3145727) 00002000:00010000:2.0:1746065157.353745:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa2300 00000100:00100000:2.0:1746065157.353768:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3947 00000100:00100000:2.0:1746065157.353793:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263695488:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065157.354000:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.354285:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263695616 00000100:00100000:0.0:1746065157.354289:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263695616 00010000:00010000:0.0:1746065157.354309:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.354340:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6182 00000100:00100000:0.0:1746065157.354345:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881263695616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.354354:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.354369:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.354531:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.354551:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5600/0xad6b7ddc1470523 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3268607) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93418a expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.354579:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.354581:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.354587:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.354593:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.354620:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.354635:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263402368:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065157.354698:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.360259:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263402368:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065157.360277:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.360324:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881263695616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5977us (6323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.360334:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6182 00000100:00100000:2.0:1746065157.362097:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263695488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8299us (8570us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.362105:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3947 00002000:00100000:2.0:1746065157.362117:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->3145727) req@ffff880097fa2300 x1830881263695488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.362126:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2300 with x1830881263695488 ext(2097152->3145727) 00002000:00010000:2.0:1746065157.362130:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa2300 00000100:00100000:0.0:1746065157.367443:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.367478:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263695744 00000100:00100000:3.0:1746065157.367486:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263695744 00000100:00100000:3.0:1746065157.367525:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13613 00000100:00100000:3.0:1746065157.367530:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+32:32446:x1830881263695744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.367542:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.367554:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341f3 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.367572:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.367573:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.367578:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.367588:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.367594:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31600, rc 0) 00000100:00100000:3.0:1746065157.367634:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+33:32446:x1830881263695744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 104us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.367638:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13613 00000100:00100000:0.0:1746065157.374748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.374803:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263696000 00000100:00100000:2.0:1746065157.374811:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263696000 00002000:00100000:2.0:1746065157.374847:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097fa1180 x1830881263696000/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.374856:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881263696000 ext(2097152->4194303) 00002000:00010000:2.0:1746065157.374861:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa1180 00000100:00100000:2.0:1746065157.374889:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3948 00000100:00100000:2.0:1746065157.374896:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263696000:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065157.377522:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.377624:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263696256 00000100:00100000:2.0:1746065157.377630:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263696256 00002000:00100000:2.0:1746065157.377658:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880097fa0e00 x1830881263696256/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.377667:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0e00 with x1830881263696256 ext(2097152->4194303) 00002000:00010000:2.0:1746065157.377672:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0e00 00000100:00100000:2.0:1746065157.377688:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3949 00000100:00100000:2.0:1746065157.377694:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263696256:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065157.379234:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.379273:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.379364:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263696640 00000100:00100000:3.0:1746065157.379370:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263696640 00002000:00100000:3.0:1746065157.379399:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097fa1880 x1830881263696640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.379407:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1880 with x1830881263696640 ext(3145728->4194303) 00002000:00010000:3.0:1746065157.379411:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1880 00000100:00100000:3.0:1746065157.379426:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263696768 00000100:00100000:3.0:1746065157.379428:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263696768 00002000:00100000:3.0:1746065157.379439:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa2a00 x1830881263696768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.379446:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2a00 with x1830881263696768 ext(3145728->4194303) 00002000:00010000:3.0:1746065157.379448:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2a00 00000100:00100000:3.0:1746065157.379467:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3950 00000100:00100000:3.0:1746065157.379473:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263696640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065157.379705:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3951 00000100:00100000:1.0:1746065157.379713:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263696768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065157.393500:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263696000:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18597us (18752us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065157.393509:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3948 00002000:00100000:2.0:1746065157.393519:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880097fa1180 x1830881263696000/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.393528:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881263696000 ext(2097152->4194303) 00002000:00010000:2.0:1746065157.393533:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa1180 00000100:00100000:1.0:1746065157.394333:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263696768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14616us (15054us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065157.394340:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3951 00002000:00100000:1.0:1746065157.394345:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097fa2a00 x1830881263696768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.394352:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2a00 with x1830881263696768 ext(3145728->4194303) 00002000:00010000:1.0:1746065157.394355:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa2a00 00000100:00100000:3.0:1746065157.396571:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263696640:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17090us (17332us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.396582:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3950 00002000:00100000:3.0:1746065157.396590:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->4194303) req@ffff880097fa1880 x1830881263696640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.396597:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1880 with x1830881263696640 ext(3145728->4194303) 00002000:00010000:3.0:1746065157.396602:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1880 00000100:00100000:2.0:1746065157.403049:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263696256:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25345us (25525us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065157.403059:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3949 00002000:00100000:2.0:1746065157.403069:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880097fa0e00 x1830881263696256/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.403077:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0e00 with x1830881263696256 ext(2097152->4194303) 00002000:00010000:2.0:1746065157.403082:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0e00 00000100:00100000:0.0:1746065157.403933:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.404131:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263696896 00000100:00100000:2.0:1746065157.404138:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263696896 00000100:00100000:2.0:1746065157.404502:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13614 00000100:00100000:2.0:1746065157.404510:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263696896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.404524:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.404538:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a8400/0xad6b7ddc14705cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9341fa expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.404579:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263402496:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.404706:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.406513:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263402496:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.406538:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8400/0xad6b7ddc14705cb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341fa expref: 43 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.406550:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8400/0xad6b7ddc14705cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341fa expref: 43 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.406573:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8400, rc 0) 00000100:00100000:2.0:1746065157.407346:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263696896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2835us (3412us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.407354:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13614 00000100:00100000:0.0:1746065157.410343:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.410813:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263697152 00000100:00100000:2.0:1746065157.410820:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263697152 00002000:00100000:2.0:1746065157.410855:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097fa0000 x1830881263697152/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.410863:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0000 with x1830881263697152 ext(4194304->5021695) 00002000:00010000:2.0:1746065157.410867:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0000 00000100:00100000:2.0:1746065157.410904:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3952 00000100:00100000:2.0:1746065157.410910:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263697152:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065157.411298:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.412792:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263697408 00000100:00100000:3.0:1746065157.412798:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263697408 00002000:00100000:3.0:1746065157.412824:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097fa3480 x1830881263697408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.412832:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3480 with x1830881263697408 ext(4194304->5021695) 00002000:00010000:3.0:1746065157.412836:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3480 00000100:00100000:3.0:1746065157.412860:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3953 00000100:00100000:3.0:1746065157.412867:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263697408:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065157.422735:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263697152:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11814us (12391us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065157.422748:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3952 00002000:00100000:2.0:1746065157.422760:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097fa0000 x1830881263697152/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.422768:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0000 with x1830881263697152 ext(4194304->5021695) 00002000:00010000:2.0:1746065157.422786:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0000 00000100:00100000:3.0:1746065157.424430:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263697408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11557us (13127us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065157.424438:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3953 00002000:00100000:3.0:1746065157.424444:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097fa3480 x1830881263697408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.424451:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3480 with x1830881263697408 ext(4194304->5021695) 00002000:00010000:3.0:1746065157.424455:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3480 00000100:00100000:0.0:1746065157.428188:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.430082:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263697536 00000100:00100000:2.0:1746065157.430091:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263697536 00000100:00100000:2.0:1746065157.430144:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13615 00000100:00100000:2.0:1746065157.430152:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263697536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.430171:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.430187:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a8400/0xad6b7ddc14705d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934201 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.430229:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263402624:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.430767:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.437139:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.437283:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263697792 00000100:00100000:3.0:1746065157.437291:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263697792 00000100:00100000:2.0:1746065157.438084:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263402624:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.438110:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8400/0xad6b7ddc14705d2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934201 expref: 43 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.438121:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8400/0xad6b7ddc14705d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934201 expref: 43 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.438138:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8400, rc 0) 00000100:00100000:2.0:1746065157.438200:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263697536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8048us (10019us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.438206:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13615 00000100:00100000:3.0:1746065157.438340:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4970 00000100:00100000:3.0:1746065157.438348:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+32:32452:x1830881263697792:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065157.440803:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+33:32452:x1830881263697792:12345-192.168.202.27@tcp:35:cat.0 Request processed in 2448us (3663us total) trans 8589936071 rc 0/0 00000100:00100000:3.0:1746065157.440812:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4970 00000100:00100000:2.0:1746065157.450052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.450121:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263697920 00000100:00100000:0.0:1746065157.450128:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263697920 00000100:00100000:0.0:1746065157.450172:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13616 00000100:00100000:0.0:1746065157.450181:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263697920:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065157.450195:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.450208:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc14705d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934208 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.450250:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263402752:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065157.450331:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.456822:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263402752:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.456855:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc14705d9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934208 expref: 43 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.456868:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc14705d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934208 expref: 43 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.456903:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf000, rc 0) 00000100:00100000:2.0:1746065157.456954:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263697920:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6772us (6908us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.456961:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13616 00000100:00100000:0.0:1746065157.468219:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.469185:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263698176 00000100:00100000:1.0:1746065157.469193:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263698176 00000100:00100000:1.0:1746065157.469237:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13723 00000100:00100000:1.0:1746065157.469244:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+33:32459:x1830881263698176:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065157.469265:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.469282:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc14705e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93420f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.469341:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.469351:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.469360:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.469375:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.469380:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.469384:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.469456:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc14705f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.469466:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc14705f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.469471:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc14705f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065157.469481:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065157.470258:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470266:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470272:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470276:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470281:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065157.470284:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470290:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470299:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065157.470302:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.470305:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470310:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857600/0xad6b7ddc14705e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470867:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470882:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470891:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470895:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065157.470897:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470902:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470908:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5800) 00010000:00010000:1.0:1746065157.470910:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.470912:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470916:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14705ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.470953:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc14705e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93420f expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.470963:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc14705f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93420f expref: 35 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.470969:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.470971:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065157.470973:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:1.0:1746065157.471648:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+35:32459:x1830881263698176:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2403us (3434us total) trans 8589936072 rc 0/0 00000100:00100000:1.0:1746065157.471656:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13723 00000100:00100000:0.0:1746065157.476746:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.478133:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263698304 00000100:00100000:2.0:1746065157.478142:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263698304 00000100:00100000:2.0:1746065157.478196:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 730 00000100:00100000:2.0:1746065157.478204:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+35:2004:x1830881263698304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.478217:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.478239:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc14705f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93420f expref: 35 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.478425:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.478429:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.478481:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+34:2004:x1830881263698304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 277us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.478488:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 730 00000100:00100000:0.0:1746065157.551163:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.551293:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263698432 00000100:00100000:2.0:1746065157.551302:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263698432 00000100:00100000:2.0:1746065157.551353:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13617 00000100:00100000:2.0:1746065157.551361:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:32458:x1830881263698432:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065157.551378:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.551395:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934216 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.551424:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.551431:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.551437:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.551438:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.551441:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.551465:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.551475:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 34 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.551485:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263402880:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.552428:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.552438:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 19 pid: 13375 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.552446:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263403008:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.552473:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.557089:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263402880:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.557104:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263403008:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.557128:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.557143:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9a00, rc 0) 00000100:00100000:2.0:1746065157.557399:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:32458:x1830881263698432:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6037us (6242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.557407:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13617 00000100:00100000:0.0:1746065157.559698:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.559746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.560945:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263698560 00000100:00100000:3.0:1746065157.560954:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263698560 00010000:00010000:3.0:1746065157.560984:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 34 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.561021:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6183 00000100:00100000:3.0:1746065157.561028:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263698560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.561039:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.561054:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 34 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.561068:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 34 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.561085:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14705af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341de expref: 34 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.561102:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.561135:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263698560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.561140:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6183 00000100:00100000:2.0:1746065157.561231:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263698688 00000100:00100000:2.0:1746065157.561235:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263698688 00000100:00100000:2.0:1746065157.561254:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13618 00000100:00100000:2.0:1746065157.561259:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+20:32459:x1830881263698688:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065157.561270:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.561280:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93421d expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.561298:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.561306:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.561311:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.561313:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.561316:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.561337:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.561345:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 32 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.561354:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263403136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.561403:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.561411:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 21 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.561417:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263403264:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.561431:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.562739:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.562800:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263698816 00000100:00100000:1.0:1746065157.562805:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263698816 00010000:00010000:1.0:1746065157.562821:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 22 pid: 13375 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.562847:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6184 00000100:00100000:1.0:1746065157.562853:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+22:2005:x1830881263698816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.562860:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065157.562881:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 22 pid: 13375 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.562890:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 22 pid: 13375 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.562903:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131beec00/0xad6b7ddc1470593 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341c2 expref: 22 pid: 13375 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.562915:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.562917:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.562921:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.562928:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.562948:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.562963:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263403392:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065157.563009:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.567556:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.567648:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263403136:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.567657:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263403264:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.567681:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.567695:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8600, rc 0) 00000100:00100000:0.0:1746065157.567732:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+21:32459:x1830881263698688:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6473us (8042us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.567739:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13618 00000100:00100000:2.0:1746065157.568012:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.568098:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263699072 00000100:00100000:3.0:1746065157.568104:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263699072 00002000:00100000:3.0:1746065157.568135:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1953792->1957887) req@ffff88009a6ddf80 x1830881263699072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.568143:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddf80 with x1830881263699072 ext(1953792->1957887) 00002000:00010000:3.0:1746065157.568154:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6ddf80 00000100:00100000:3.0:1746065157.568176:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3954 00000100:00100000:3.0:1746065157.568186:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263699072:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065157.568293:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263699072:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 108us (742us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065157.568306:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3954 00002000:00100000:3.0:1746065157.568311:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1953792->1957887) req@ffff88009a6ddf80 x1830881263699072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.568321:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddf80 with x1830881263699072 ext(1953792->1957887) 00002000:00010000:3.0:1746065157.568325:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6ddf80 00000100:00100000:1.0:1746065157.568542:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263403392:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065157.568552:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.568572:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263698816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5720us (5836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.568579:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6184 00000100:00100000:1.0:1746065157.570586:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263699200 00000100:00100000:1.0:1746065157.570594:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263699200 00010000:00010000:1.0:1746065157.570616:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.570646:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6185 00000100:00100000:1.0:1746065157.570653:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263699200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.570661:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065157.570675:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.570683:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.570699:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc14705c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341f3 expref: 33 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.570718:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.570741:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263699200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (2730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.570746:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6185 00000100:00100000:0.0:1746065157.574339:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.578067:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263699328 00000100:00100000:3.0:1746065157.578079:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263699328 00010000:00010000:3.0:1746065157.578112:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 20 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.578140:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6186 00000100:00100000:3.0:1746065157.578147:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263699328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.578158:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.578172:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 20 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.578182:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 20 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.578199:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31200/0xad6b7ddc14705b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341e5 expref: 20 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.578221:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.578222:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.578228:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.578235:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.578263:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.578279:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263403520:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065157.578353:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.579639:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.580025:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263699456 00000100:00100000:2.0:1746065157.580031:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263699456 00000100:00100000:2.0:1746065157.581162:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13619 00000100:00100000:2.0:1746065157.581170:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:32458:x1830881263699456:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065157.581184:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.581197:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934224 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.581222:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.581229:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065157.581230:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065157.581233:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.581254:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.581263:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 19 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.581272:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263403648:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.582801:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.582892:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263699712 00000100:00100000:0.0:1746065157.582897:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263699712 00002000:00100000:0.0:1746065157.582932:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (4136960->4141055) req@ffff88012f09e300 x1830881263699712/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.582940:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881263699712 ext(4136960->4141055) 00010000:00010000:0.0:1746065157.582947:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 7/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.582958:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 7/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746065157.582968:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09e300 00000100:00100000:0.0:1746065157.582981:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1355 00000100:00100000:0.0:1746065157.582988:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263699712:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065157.583086:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ccc4a269-0136-4970-860c-c944630694a4+20:2004:x1830881263699712:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 98us (290us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065157.583091:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1355 00002000:00100000:0.0:1746065157.583096:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (4136960->4141055) req@ffff88012f09e300 x1830881263699712/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.583101:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881263699712 ext(4136960->4141055) 00010000:00010000:0.0:1746065157.583105:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 7/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.583112:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 7/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746065157.583117:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09e300 00000100:00100000:3.0:1746065157.583198:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263403520:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065157.583211:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.583229:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+19:2007:x1830881263699328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5084us (8899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.583236:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6186 00000100:00100000:2.0:1746065157.583930:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.583945:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263403648:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.583961:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.583973:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8c00, rc 0) 00000100:00100000:2.0:1746065157.583995:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:32458:x1830881263699456:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2827us (4358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.584001:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13619 00000100:00100000:0.0:1746065157.589240:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.589287:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.589308:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.589332:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263700096 00000100:00100000:0.0:1746065157.589340:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263700096 00002000:00100000:0.0:1746065157.589385:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4136960->4194303) req@ffff88012f09f100 x1830881263700096/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.589394:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f100 with x1830881263700096 ext(4136960->4194303) 00010000:00010000:0.0:1746065157.589403:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 19 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.589416:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 19 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746065157.589421:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09f100 00000100:00100000:0.0:1746065157.589438:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1356 00000100:00100000:0.0:1746065157.589445:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+19:2007:x1830881263700096:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065157.589514:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263700352 00000100:00100000:1.0:1746065157.589518:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263700352 00000100:00100000:1.0:1746065157.589742:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13724 00000100:00100000:1.0:1746065157.589748:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+34:32464:x1830881263700352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065157.589762:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.589799:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc1470618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934232 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.589858:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.589867:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.589887:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.589897:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.589902:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.589905:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065157.590138:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263699968 00000100:00100000:2.0:1746065157.590143:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263699968 00000100:00100000:2.0:1746065157.590166:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13620 00000100:00100000:2.0:1746065157.590171:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+24:32459:x1830881263699968:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065157.590179:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.590187:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93422b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.590203:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.590209:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.590214:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.590216:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.590218:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->3829759] (req 3145728->3829759) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.590242:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.590255:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 41 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.590266:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263403776:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.590330:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.590342:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 25 pid: 10219 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.590349:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263403904:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.590368:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d180 going to sleep for 11 seconds 00010000:00010000:1.0:1746065157.590750:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856a00/0xad6b7ddc147062d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590761:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856a00/0xad6b7ddc147062d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590768:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856a00/0xad6b7ddc147062d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:1.0:1746065157.590789:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:1.0:1746065157.590853:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590858:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590863:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590868:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590885:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065157.590888:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590894:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590903:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065157.590905:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.590908:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590915:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc147061f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590928:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590932:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590935:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590939:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d856400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065157.590941:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590944:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590949:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5500) 00010000:00010000:1.0:1746065157.590951:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065157.590953:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590957:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1470626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.590986:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc1470618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934232 expref: 37 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.590995:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856a00/0xad6b7ddc147062d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934232 expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.591003:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.591005:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065157.591007:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856a00, rc 0) 00000100:00100000:1.0:1746065157.591031:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+36:32464:x1830881263700352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1283us (1744us total) trans 8589936073 rc 0/0 00000100:00100000:1.0:1746065157.591036:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13724 00000100:00100000:0.0:1746065157.592139:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263700096:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 2691us (2826us total) trans 21474840980 rc 0/0 00000100:00100000:0.0:1746065157.592147:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1356 00002000:00100000:0.0:1746065157.592155:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4136960->4194303) req@ffff88012f09f100 x1830881263700096/t21474840980(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.592163:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f100 with x1830881263700096 ext(4136960->4194303) 00010000:00010000:0.0:1746065157.592169:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 21 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.592178:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 21 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746065157.592184:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09f100 00000100:00100000:0.0:1746065157.595026:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.595955:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.596008:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.596021:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.596045:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.596158:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263700480 00000100:00100000:1.0:1746065157.596166:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263700480 00000100:00100000:1.0:1746065157.596193:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263700608 00000100:00100000:1.0:1746065157.596195:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263700608 00000100:00100000:0.0:1746065157.597400:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.597420:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263701120 00000100:00100000:0.0:1746065157.597424:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263701120 00000100:00100000:0.0:1746065157.597455:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263700992 00000100:00100000:0.0:1746065157.597457:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263700992 00010000:00010000:0.0:1746065157.597468:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 43 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.597492:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6187 00000100:00100000:0.0:1746065157.597499:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881263700992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.597511:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.597528:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 43 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.597537:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 43 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.597558:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.597664:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881263700992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 165us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.597670:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6187 00000100:00100000:0.0:1746065157.597683:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 731 00000100:00100000:0.0:1746065157.597687:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+36:2007:x1830881263701120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.597695:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.597706:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856a00/0xad6b7ddc147062d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934232 expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.597726:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065157.597729:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.597741:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+35:2007:x1830881263701120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.597746:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 731 00000100:00100000:0.0:1746065157.597788:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.597801:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263701248 00000100:00100000:0.0:1746065157.597804:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263701248 00010000:00010000:0.0:1746065157.597814:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 26 pid: 10219 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.597828:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6188 00000100:00100000:0.0:1746065157.597832:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263701248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.597837:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.597844:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 26 pid: 10219 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.597851:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 26 pid: 10219 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.597861:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.597863:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.597868:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 26 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.597884:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 26 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.597910:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 26 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.597920:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263404032:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065157.597958:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.598224:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263700736 00000100:00100000:1.0:1746065157.598228:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263700736 00000100:00100000:2.0:1746065157.598497:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263700864 00000100:00100000:2.0:1746065157.598500:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263700864 00000100:00100000:2.0:1746065157.598519:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13621 00000100:00100000:2.0:1746065157.598524:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263700480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.598534:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.598543:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc1470642 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934239 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.598567:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263404160:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.598591:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.598605:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13622 00000100:00100000:2.0:1746065157.598611:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263700608:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.598618:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.598625:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1470649 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934240 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.598645:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263404288:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.598660:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.598674:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13623 00000100:00100000:2.0:1746065157.598679:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263700736:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.598685:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.598690:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1470650 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934247 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.598708:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263404416:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.598723:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d780 going to sleep for 11 seconds 00010000:00010000:2.0:1746065157.598746:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc14705bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ec expref: 43 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.598760:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263403776:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.598802:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1b800/0xad6b7ddc14705a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d0 expref: 26 pid: 10219 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.598811:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263403904:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.598827:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.598835:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9c00, rc 0) 00000100:00100000:2.0:1746065157.598850:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+25:32459:x1830881263699968:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8679us (9619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.598856:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13620 00000100:00100000:2.0:1746065157.598868:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13624 00000100:00100000:2.0:1746065157.598883:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+23:2006:x1830881263700864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.598891:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.598896:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1470657 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93424e expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.598914:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263404544:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.598930:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.600844:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.601065:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263404160:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.601090:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc1470642 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934239 expref: 42 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.601100:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6a00/0xad6b7ddc1470642 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934239 expref: 42 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.601109:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6a00, rc 0) 00000100:00100000:2.0:1746065157.601136:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881263700480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2611us (6118us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.601143:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13621 00010000:00010000:2.0:1746065157.601255:0:13375:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff8800957d9180 x1830881263404544) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 24 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.601273:0:13375:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 24 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.601287:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263404544:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.601298:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.601300:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.601305:0:13375:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.601312:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.601333:0:13375:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.601343:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263404672:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065157.601389:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.601466:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263404032:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065157.601476:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.601494:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263701248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3661us (3705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.601501:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6188 00000100:00100000:0.0:1746065157.601514:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263701376 00000100:00100000:0.0:1746065157.601518:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263701376 00000100:00100000:0.0:1746065157.604340:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 732 00000100:00100000:0.0:1746065157.604356:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263701376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.604369:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.604371:0:8352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc147060a) 00010000:00010000:0.0:1746065157.604373:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.604408:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263701376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 59us (3570us total) trans 0 rc 116/116 00000100:00100000:0.0:1746065157.604414:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 732 00010000:00010000:2.0:1746065157.607825:0:3068:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff88009a6dc700 x1830881263404288) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 24 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.607853:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8600/0xad6b7ddc147060a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93421d expref: 24 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.607863:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263404288:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.607897:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1470649 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934240 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.607907:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f47000/0xad6b7ddc1470649 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934240 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.607918:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47000, rc 0) 00000100:00100000:2.0:1746065157.607955:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881263700608:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9343us (12000us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.607962:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13622 00002000:00010000:2.0:1746065157.607994:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime: 1746065155 -> 1746065157 00002000:00010000:2.0:1746065157.607996:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime: 1746065155 -> 1746065157 00002000:00010000:2.0:1746065157.607998:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime: 1746065155 -> 1746065157 00000100:00100000:2.0:1746065157.608003:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263404416:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.608015:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1470650 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934247 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.608022:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1470650 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934247 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.608028:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47400, rc 0) 00000100:00100000:2.0:1746065157.608039:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ccc4a269-0136-4970-860c-c944630694a4+22:2006:x1830881263700736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9360us (12032us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.608043:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13623 00000100:00100000:2.0:1746065157.608291:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263404672:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065157.608305:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1470657 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93424e expref: 21 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.608314:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1470657 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93424e expref: 21 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.608325:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46200, rc 0) 00000100:00100000:2.0:1746065157.608353:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+20:2006:x1830881263700864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9470us (12331us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.608359:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13624 00000100:00100000:2.0:1746065157.620380:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.620444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.620478:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263701760 00000100:00100000:2.0:1746065157.620486:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263701760 00002000:00100000:2.0:1746065157.620521:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2523136->2527231) req@ffff8800957d9180 x1830881263701760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.620530:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9180 with x1830881263701760 ext(2523136->2527231) 00002000:00010000:2.0:1746065157.620534:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9180 00000100:00100000:2.0:1746065157.620549:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263701888 00000100:00100000:2.0:1746065157.620552:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263701888 00002000:00100000:2.0:1746065157.620563:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (3825664->3829759) req@ffff8800957d8000 x1830881263701888/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.620569:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8000 with x1830881263701888 ext(3825664->3829759) 00002000:00010000:2.0:1746065157.620571:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8000 00000100:00100000:2.0:1746065157.620584:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3955 00000100:00100000:2.0:1746065157.620590:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263701760:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065157.620724:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263701760:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 133us (351us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065157.620730:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3955 00002000:00100000:2.0:1746065157.620736:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2523136->2527231) req@ffff8800957d9180 x1830881263701760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.620742:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9180 with x1830881263701760 ext(2523136->2527231) 00002000:00010000:2.0:1746065157.620744:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9180 00000100:00100000:2.0:1746065157.620758:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3956 00000100:00100000:2.0:1746065157.620763:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263701888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065157.620830:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2006:x1830881263701888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 66us (386us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065157.620835:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3956 00002000:00100000:2.0:1746065157.620839:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (3825664->3829759) req@ffff8800957d8000 x1830881263701888/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.620845:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8000 with x1830881263701888 ext(3825664->3829759) 00002000:00010000:2.0:1746065157.620848:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8000 00000100:00100000:3.0:1746065157.624298:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.624364:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263702016 00000100:00100000:2.0:1746065157.624371:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263702016 00000100:00100000:2.0:1746065157.625051:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13625 00000100:00100000:2.0:1746065157.625058:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+20:32464:x1830881263702016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.625073:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.625087:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934255 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.625111:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.625118:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065157.625120:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065157.625122:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.625144:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.625153:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 32 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.625163:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263404800:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.627159:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.629083:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263702144 00000100:00100000:3.0:1746065157.629092:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263702144 00000100:00100000:3.0:1746065157.629127:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13626 00000100:00100000:3.0:1746065157.629134:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+41:32467:x1830881263702144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.629148:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.629160:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93425c expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.629186:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.629193:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.629195:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.629198:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.629221:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.629230:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 23 pid: 12258 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.629239:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263404928:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.629290:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.629306:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.631095:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.631568:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263702400 00000100:00100000:3.0:1746065157.631575:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263702400 00000100:00100000:3.0:1746065157.631626:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4971 00000100:00100000:3.0:1746065157.631633:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+35:32459:x1830881263702400:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065157.631836:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+36:32459:x1830881263702400:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 203us (743us total) trans 8589936074 rc 0/0 00000100:00100000:3.0:1746065157.631847:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4971 00000100:00100000:2.0:1746065157.633669:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263404800:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.633894:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263404928:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.633911:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.633925:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d800, rc 0) 00000100:00100000:3.0:1746065157.633953:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+42:32467:x1830881263702144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4819us (6799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.633960:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13626 00010000:00010000:2.0:1746065157.634021:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.634029:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9600, rc 0) 00000100:00100000:2.0:1746065157.634047:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+21:32464:x1830881263702016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8989us (9755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.634052:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13625 00000100:00100000:0.0:1746065157.634628:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.634696:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.635084:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263702528 00000100:00100000:2.0:1746065157.635090:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263702528 00002000:00100000:2.0:1746065157.635117:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1953792->2097151) req@ffff880099bd5880 x1830881263702528/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.635125:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5880 with x1830881263702528 ext(1953792->2097151) 00010000:00010000:2.0:1746065157.635130:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 33 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.635139:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 33 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.635144:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099bd5880 00000100:00100000:2.0:1746065157.635159:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263702656 00000100:00100000:2.0:1746065157.635161:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263702656 00002000:00100000:2.0:1746065157.635172:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6e:0x0] (1085440->1404927) req@ffff880099bd4380 x1830881263702656/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.635178:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4380 with x1830881263702656 ext(1085440->1404927) 00010000:00010000:2.0:1746065157.635182:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 24 pid: 12258 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.635188:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 24 pid: 12258 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.635193:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd4380 00000100:00100000:2.0:1746065157.635202:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1357 00000100:00100000:2.0:1746065157.635206:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263702528:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065157.635304:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1358 00000100:00100000:2.0:1746065157.635309:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+24:2005:x1830881263702656:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065157.643229:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263702528:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8014us (8593us total) trans 21474840981 rc 0/0 00000100:00100000:0.0:1746065157.643240:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1357 00002000:00100000:0.0:1746065157.643250:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1953792->2097151) req@ffff880099bd5880 x1830881263702528/t21474840981(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.643258:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5880 with x1830881263702528 ext(1953792->2097151) 00010000:00010000:0.0:1746065157.643266:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 35 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.643277:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 35 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746065157.643284:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099bd5880 00000100:00100000:3.0:1746065157.645316:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263702656:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10000us (10614us total) trans 17179873525 rc 0/0 00000100:00100000:3.0:1746065157.645325:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1358 00002000:00100000:3.0:1746065157.645333:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6e:0x0] (1085440->1404927) req@ffff880099bd4380 x1830881263702656/t17179873525(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.645341:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4380 with x1830881263702656 ext(1085440->1404927) 00010000:00010000:3.0:1746065157.645348:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 26 pid: 12258 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.645358:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 26 pid: 12258 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746065157.645363:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd4380 00000100:00100000:0.0:1746065157.648510:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.648584:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.648657:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263702912 00000100:00100000:1.0:1746065157.648664:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263702912 00010000:00010000:1.0:1746065157.648689:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 26 pid: 12258 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.648719:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6189 00000100:00100000:1.0:1746065157.648725:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263702912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.648735:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065157.648750:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 26 pid: 12258 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.648758:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 26 pid: 12258 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.648797:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3600/0xad6b7ddc1470577 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1085440->1404927) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341a6 expref: 26 pid: 12258 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.648812:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.648814:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.648819:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 41 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.648825:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 41 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.648848:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 41 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.648857:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263405056:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065157.648924:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.649062:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263702784 00000100:00100000:2.0:1746065157.649066:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263702784 00010000:00010000:2.0:1746065157.649083:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 35 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.649104:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6190 00000100:00100000:2.0:1746065157.649110:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881263702784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.649117:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.649126:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 35 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.649135:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 35 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.649147:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9a00/0xad6b7ddc1470603 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934216 expref: 35 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.649158:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.649160:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.649163:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.649169:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.649185:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.649192:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263405184:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065157.649216:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065157.651587:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263405056:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065157.651602:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.651629:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263702912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2903us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.651637:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6189 00000100:00100000:2.0:1746065157.651812:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263405184:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065157.651825:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.651839:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881263702784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2730us (3337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.651845:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6190 00000100:00100000:0.0:1746065157.653867:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.653931:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263703168 00000100:00100000:3.0:1746065157.653937:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263703168 00002000:00100000:3.0:1746065157.653977:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099bd7800 x1830881263703168/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.653986:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7800 with x1830881263703168 ext(1048576->2097151) 00002000:00010000:3.0:1746065157.653990:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7800 00000100:00100000:3.0:1746065157.654016:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3957 00000100:00100000:3.0:1746065157.654023:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263703168:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065157.658836:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.659132:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263703424 00000100:00100000:2.0:1746065157.659140:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263703424 00002000:00100000:2.0:1746065157.659176:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880099bd7100 x1830881263703424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.659186:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7100 with x1830881263703424 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.659193:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd7100 00000100:00100000:2.0:1746065157.659223:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3958 00000100:00100000:2.0:1746065157.659230:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263703424:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065157.665242:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2006:x1830881263703168:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11210us (11371us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.665254:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3957 00002000:00100000:3.0:1746065157.665264:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099bd7800 x1830881263703168/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.665275:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7800 with x1830881263703168 ext(1048576->2097151) 00002000:00010000:3.0:1746065157.665283:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7800 00000100:00100000:0.0:1746065157.672733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.673117:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263703552 00000100:00100000:3.0:1746065157.673125:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263703552 00000100:00100000:3.0:1746065157.673161:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13627 00000100:00100000:3.0:1746065157.673170:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+21:32464:x1830881263703552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.673184:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.673199:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934263 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.673222:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.673228:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.673230:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065157.673233:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.673256:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.673266:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 33 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.673276:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263405312:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.674540:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.674709:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881263703424:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15475us (15877us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.674717:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3958 00002000:00100000:2.0:1746065157.674725:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880099bd7100 x1830881263703424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.674733:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7100 with x1830881263703424 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.674736:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd7100 00000100:00100000:3.0:1746065157.676739:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263405312:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.676764:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.676825:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00000100:00100000:3.0:1746065157.676883:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:ccc4a269-0136-4970-860c-c944630694a4+22:32464:x1830881263703552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3714us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.676892:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13627 00000100:00100000:1.0:1746065157.677610:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263405440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065157.677648:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065157.677936:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405440 00000100:00100000:3.0:1746065157.677941:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405440 00000100:00100000:3.0:1746065157.677980:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1746065157.677993:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263405440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1746065157.678008:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 708608 granted 1141127488 pending 7077888 free 3910807552 avail 3679285248 00000100:00080000:0.0:1746065157.678099:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065157.678411:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263405440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 418us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.678417:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1746065157.678551:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263405440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065157.678946:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.678986:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263703680 00000100:00100000:2.0:1746065157.678990:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263703680 00002000:00100000:2.0:1746065157.679019:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2527231) req@ffff880099bd7480 x1830881263703680/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.679027:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7480 with x1830881263703680 ext(2097152->2527231) 00010000:00010000:2.0:1746065157.679034:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 34 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.679045:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 34 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.679051:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099bd7480 00000100:00100000:2.0:1746065157.679075:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1359 00000100:00100000:2.0:1746065157.679081:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881263703680:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065157.681270:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.681323:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263703808 00000100:00100000:3.0:1746065157.681328:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263703808 00000100:00100000:3.0:1746065157.681360:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13628 00000100:00100000:3.0:1746065157.681366:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+36:32467:x1830881263703808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065157.681379:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.681392:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93426a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.681410:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.681411:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.681418:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 37 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.681430:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 37 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.681438:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c400, rc 0) 00000100:00100000:3.0:1746065157.681477:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+37:32467:x1830881263703808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 111us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.681483:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13628 00000100:00100000:0.0:1746065157.683607:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263703680:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4520us (4656us total) trans 21474840982 rc 0/0 00000100:00100000:0.0:1746065157.683617:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1359 00002000:00100000:0.0:1746065157.683625:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->2527231) req@ffff880099bd7480 x1830881263703680/t21474840982(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.683634:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7480 with x1830881263703680 ext(2097152->2527231) 00010000:00010000:0.0:1746065157.683642:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 37 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.683655:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 37 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746065157.683661:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099bd7480 00000100:00100000:0.0:1746065157.684361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.684418:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263704064 00000100:00100000:2.0:1746065157.684423:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263704064 00002000:00100000:2.0:1746065157.684446:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099bd5c00 x1830881263704064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.684454:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5c00 with x1830881263704064 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.684458:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd5c00 00000100:00100000:2.0:1746065157.684504:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3959 00000100:00100000:2.0:1746065157.684511:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263704064:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065157.685179:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.685221:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263704192 00000100:00100000:3.0:1746065157.685225:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263704192 00010000:00010000:3.0:1746065157.685242:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 39 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.685273:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6191 00000100:00100000:3.0:1746065157.685279:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263704192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.685288:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.685302:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 39 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.685316:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 39 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.685335:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a8c00/0xad6b7ddc1470611 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934224 expref: 39 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.685362:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.685364:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.685371:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.685383:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.685412:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.685425:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263405568:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065157.685493:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.690212:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263405568:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065157.690228:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.690233:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263704064:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5722us (5873us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.690242:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3959 00000100:00100000:3.0:1746065157.690243:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263704192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4965us (5066us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.690249:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6191 00002000:00100000:2.0:1746065157.690251:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099bd5c00 x1830881263704064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.690259:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5c00 with x1830881263704064 ext(1048576->2097151) 00002000:00010000:2.0:1746065157.690263:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd5c00 00000100:00100000:0.0:1746065157.700272:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.700298:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.700320:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.700346:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263704448 00000100:00100000:3.0:1746065157.700353:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263704448 00000100:00100000:0.0:1746065157.700356:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.700380:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263704704 00000100:00100000:0.0:1746065157.700382:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263704704 00002000:00100000:3.0:1746065157.700389:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099bd4a80 x1830881263704448/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.700397:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4a80 with x1830881263704448 ext(2097152->4194303) 00002000:00010000:3.0:1746065157.700401:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4a80 00000100:00100000:0.0:1746065157.700405:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263704960 00000100:00100000:0.0:1746065157.700407:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263704960 00000100:00100000:3.0:1746065157.700409:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263704832 00000100:00100000:3.0:1746065157.700411:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263704832 00002000:00100000:3.0:1746065157.700419:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099bd6a00 x1830881263704832/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 504/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065157.700420:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13629 00002000:00100000:3.0:1746065157.700425:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd6a00 with x1830881263704832 ext(2097152->4194303) 00000100:00100000:0.0:1746065157.700425:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881263704704:12345-192.168.202.27@tcp:101:cat.0 00002000:00010000:3.0:1746065157.700428:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd6a00 00000100:00100000:3.0:1746065157.700435:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3960 00010000:00010000:0.0:1746065157.700436:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065157.700438:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263704448:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:0.0:1746065157.700448:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934271 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.700462:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.700464:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.700470:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 37 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.700482:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 37 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.700490:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856200, rc 0) 00000100:00100000:0.0:1746065157.700520:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263704704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.700525:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13629 00000100:00100000:0.0:1746065157.700536:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13630 00000100:00100000:0.0:1746065157.700539:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263704960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065157.700545:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.700551:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc1470681 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934278 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.700579:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263405696:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065157.700621:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.700688:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3961 00000100:00100000:0.0:1746065157.700693:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263704832:12345-192.168.202.27@tcp:3:cat.0 00002000:00010000:1.0:1746065157.706942:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime: 1746065156 -> 1746065157 00000100:00100000:1.0:1746065157.706964:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263405696:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065157.706992:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc1470681 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934278 expref: 43 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.707010:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc1470681 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934278 expref: 43 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.707032:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857a00, rc 0) 00000100:00100000:1.0:1746065157.707080:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881263704960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6537us (6721us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065157.707088:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13630 00000100:00100000:2.0:1746065157.714996:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263704832:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14294us (14687us total) trans 0 rc 1413120/1413120 00000100:00100000:2.0:1746065157.715007:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3961 00002000:00100000:2.0:1746065157.715017:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099bd6a00 x1830881263704832/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 504/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1413120/1413120 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.715025:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd6a00 with x1830881263704832 ext(2097152->4194303) 00002000:00010000:2.0:1746065157.715030:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd6a00 00000100:00100000:0.0:1746065157.715852:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.716949:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263705216 00000100:00100000:2.0:1746065157.716957:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263705216 00002000:00100000:2.0:1746065157.716986:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880099bd4000 x1830881263705216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.716994:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4000 with x1830881263705216 ext(2097152->3145727) 00002000:00010000:2.0:1746065157.716997:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4000 00000100:00100000:2.0:1746065157.717028:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3962 00000100:00100000:2.0:1746065157.717034:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263705216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065157.719330:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263704448:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18883us (19058us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065157.719495:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3960 00002000:00100000:3.0:1746065157.719505:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099bd4a80 x1830881263704448/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.719513:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4a80 with x1830881263704448 ext(2097152->4194303) 00002000:00010000:3.0:1746065157.719518:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4a80 00000100:00100000:2.0:1746065157.724127:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263705216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7084us (8267us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065157.724137:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3962 00002000:00100000:2.0:1746065157.724145:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->3145727) req@ffff880099bd4000 x1830881263705216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.724154:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4000 with x1830881263705216 ext(2097152->3145727) 00002000:00010000:2.0:1746065157.724159:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4000 00000100:00100000:0.0:1746065157.727409:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.727474:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263705344 00000100:00100000:1.0:1746065157.727482:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263705344 00000100:00100000:1.0:1746065157.727765:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13631 00000100:00100000:1.0:1746065157.727803:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+42:32467:x1830881263705344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065157.727819:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.727834:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93427f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.727860:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.727867:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.727868:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.727881:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 43 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.727905:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.727918:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 24 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.727928:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263405824:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.728007:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.729093:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.729605:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263405824:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.729626:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 43 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.729641:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdba00, rc 0) 00000100:00100000:1.0:1746065157.729673:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+43:32467:x1830881263705344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1901us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.729681:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13631 00000100:00100000:1.0:1746065157.729710:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263705472 00000100:00100000:1.0:1746065157.729713:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263705472 00000100:00100000:1.0:1746065157.729732:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13632 00000100:00100000:1.0:1746065157.729737:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263705472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065157.729747:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.729756:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934286 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.729768:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.729769:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.729792:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 26 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.729807:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 26 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.729813:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda800, rc 0) 00000100:00100000:1.0:1746065157.729825:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263705472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 88us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.729829:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13632 00000100:00100000:0.0:1746065157.730817:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.730898:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263705600 00000100:00100000:2.0:1746065157.730902:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263705600 00002000:00100000:2.0:1746065157.730925:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3829759) req@ffff88012edaea00 x1830881263705600/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.730937:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaea00 with x1830881263705600 ext(3145728->3829759) 00010000:00010000:2.0:1746065157.730943:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 26 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.730953:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 26 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.730958:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012edaea00 00000100:00100000:2.0:1746065157.730980:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1360 00000100:00100000:2.0:1746065157.730986:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+26:2005:x1830881263705600:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065157.734198:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.734770:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263705856 00000100:00100000:3.0:1746065157.734808:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263705856 00002000:00100000:3.0:1746065157.734843:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012edad880 x1830881263705856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.734851:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edad880 with x1830881263705856 ext(4194304->5021695) 00002000:00010000:3.0:1746065157.734855:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edad880 00000100:00100000:3.0:1746065157.734885:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3963 00000100:00100000:3.0:1746065157.734893:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263705856:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065157.743681:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ccc4a269-0136-4970-860c-c944630694a4+22:2007:x1830881263705856:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8780us (9481us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065157.743691:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3963 00002000:00100000:3.0:1746065157.743700:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff88012edad880 x1830881263705856/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.743713:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edad880 with x1830881263705856 ext(4194304->5021695) 00002000:00010000:3.0:1746065157.744224:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edad880 00000100:00100000:0.0:1746065157.744270:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263705600:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13283us (13454us total) trans 17179873526 rc 0/0 00000100:00100000:0.0:1746065157.744280:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1360 00002000:00100000:0.0:1746065157.744285:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (3145728->3829759) req@ffff88012edaea00 x1830881263705600/t17179873526(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065157.744293:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaea00 with x1830881263705600 ext(3145728->3829759) 00010000:00010000:0.0:1746065157.744300:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 28 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.744313:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 28 pid: 13375 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746065157.744318:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012edaea00 00000100:00100000:0.0:1746065157.751054:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.751144:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263705984 00000100:00100000:3.0:1746065157.751154:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263705984 00010000:00010000:3.0:1746065157.751186:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 28 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.751665:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6192 00000100:00100000:3.0:1746065157.751673:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263705984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.751685:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.751702:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 28 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.751713:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 28 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.751733:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a9c00/0xad6b7ddc1470634 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93422b expref: 28 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.751756:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.751758:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.751764:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.751796:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.751829:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.751839:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263405952:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065157.752913:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.753444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.753588:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263706112 00000100:00100000:2.0:1746065157.753595:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263706112 00000100:00100000:2.0:1746065157.753627:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13633 00000100:00100000:2.0:1746065157.753634:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+28:2007:x1830881263706112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.753649:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.753662:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93428d expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.753681:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.753683:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.753689:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.753701:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.753714:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7acc00, rc 0) 00000100:00100000:2.0:1746065157.753748:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+29:2007:x1830881263706112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.753753:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13633 00000100:00100000:0.0:1746065157.759284:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.759401:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263706368 00000100:00100000:2.0:1746065157.759411:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263706368 00000100:00100000:2.0:1746065157.759463:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4972 00000100:00100000:2.0:1746065157.759470:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+36:32464:x1830881263706368:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065157.759493:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263405952:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065157.759509:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.759545:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+28:2004:x1830881263705984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7873us (8499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.759554:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6192 00000100:00100000:2.0:1746065157.759637:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+37:32464:x1830881263706368:12345-192.168.202.27@tcp:35:cat.0 Request processed in 165us (361us total) trans 8589936075 rc 0/0 00000100:00100000:2.0:1746065157.759644:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4972 00000100:00100000:0.0:1746065157.764258:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.764305:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.764332:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263706752 00000100:00100000:1.0:1746065157.764339:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263706752 00002000:00100000:1.0:1746065157.764374:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880097f50000 x1830881263706752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.764383:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50000 with x1830881263706752 ext(2097152->4194303) 00002000:00010000:1.0:1746065157.764388:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f50000 00000100:00100000:1.0:1746065157.764413:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263706880 00000100:00100000:1.0:1746065157.764416:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263706880 00002000:00100000:1.0:1746065157.764433:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097f53b80 x1830881263706880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.764438:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53b80 with x1830881263706880 ext(3145728->4194303) 00002000:00010000:1.0:1746065157.764441:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53b80 00000100:00100000:1.0:1746065157.764465:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3964 00000100:00100000:1.0:1746065157.764472:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263706752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065157.765651:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3965 00000100:00100000:3.0:1746065157.765660:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263706880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065157.780584:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.780677:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263707008 00000100:00100000:2.0:1746065157.780685:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263707008 00000100:00100000:2.0:1746065157.780731:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13634 00000100:00100000:1.0:1746065157.780811:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263706752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16337us (16558us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065157.780820:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3964 00000100:00100000:2.0:1746065157.780821:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+39:32471:x1830881263707008:12345-192.168.202.27@tcp:101:multiop.0 00002000:00100000:1.0:1746065157.780830:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880097f50000 x1830881263706752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.780838:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f50000 with x1830881263706752 ext(2097152->4194303) 00010000:00010000:2.0:1746065157.780840:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746065157.780843:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097f50000 00010000:00010000:2.0:1746065157.780855:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934294 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.780886:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.780894:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 21 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.780905:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.780906:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.780910:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [172032->528383] (req 172032->528383) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 40 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.780935:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 21 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.780945:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 21 pid: 10219 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.780955:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263406080:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.781515:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 40 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.781523:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 40 pid: 12260 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.781530:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263406208:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.781555:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.789796:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881263706880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24110us (25462us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065157.789806:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3965 00002000:00100000:3.0:1746065157.789815:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8d:0x0] (3145728->4194303) req@ffff880097f53b80 x1830881263706880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.789823:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53b80 with x1830881263706880 ext(3145728->4194303) 00002000:00010000:3.0:1746065157.789828:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53b80 00000100:00100000:3.0:1746065157.796743:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.796762:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263707136 00000100:00100000:3.0:1746065157.796768:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263707136 00010000:00010000:3.0:1746065157.796808:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 39 pid: 12260 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.796839:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6193 00000100:00100000:3.0:1746065157.796846:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881263707136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.796856:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.796883:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 39 pid: 12260 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.796893:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 39 pid: 12260 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.796933:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263406080:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.796943:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263406208:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.796969:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [172032->528383] (req 172032->528383) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 39 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.796994:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc1470515 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934183 expref: 39 pid: 12260 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.796996:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3c00, rc 0) 00000100:00100000:2.0:1746065157.797037:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+38:32471:x1830881263707008:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 16218us (16460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.797044:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13634 00010000:00010000:3.0:1746065157.797045:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.797063:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881263707136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 217us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.797069:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6193 00000100:00100000:0.0:1746065157.798140:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.798281:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263707264 00000100:00100000:3.0:1746065157.798286:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263707264 00010000:00010000:3.0:1746065157.798304:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 22 pid: 10219 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746065157.798333:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6194 00000100:00100000:3.0:1746065157.798339:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+22:2004:x1830881263707264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.798348:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.798359:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 22 pid: 10219 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.798369:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 22 pid: 10219 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.798591:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090790600/0xad6b7ddc147057e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341ad expref: 22 pid: 10219 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.798673:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.798675:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.798682:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 36 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.798688:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 36 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.798714:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 36 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.798723:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263406336:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065157.799342:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.804694:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.804882:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263707392 00000100:00100000:2.0:1746065157.804890:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263707392 00000100:00100000:2.0:1746065157.804928:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13635 00000100:00100000:2.0:1746065157.804934:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263707392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065157.804951:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.804968:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14706a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93429b expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.805014:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263406464:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065157.805075:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.805216:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263406336:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065157.805229:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.805253:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+21:2004:x1830881263707264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6914us (7116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.805339:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6194 00000100:00100000:0.0:1746065157.810417:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.810633:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263707648 00000100:00100000:3.0:1746065157.810641:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263707648 00002000:00100000:3.0:1746065157.810678:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8a:0x0] (524288->528383) req@ffff880097f53100 x1830881263707648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.810687:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53100 with x1830881263707648 ext(524288->528383) 00002000:00010000:3.0:1746065157.810691:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53100 00000100:00100000:3.0:1746065157.810720:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3966 00000100:00100000:3.0:1746065157.810726:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263707648:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065157.810854:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881263707648:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 128us (444us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065157.810859:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3966 00002000:00100000:3.0:1746065157.810863:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x8a:0x0] (524288->528383) req@ffff880097f53100 x1830881263707648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065157.810880:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f53100 with x1830881263707648 ext(524288->528383) 00002000:00010000:3.0:1746065157.810883:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f53100 00002000:00010000:2.0:1746065157.811444:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime: 1746065157 -> 1746065158 00002000:00010000:2.0:1746065157.811448:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime: 1746065157 -> 1746065158 00002000:00010000:2.0:1746065157.811450:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime: 1746065157 -> 1746065158 00000100:00100000:2.0:1746065157.811459:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263406464:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.811486:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14706a4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93429b expref: 38 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.811496:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a5cea00/0xad6b7ddc14706a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93429b expref: 38 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.811513:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:2.0:1746065157.811535:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263707392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6600us (6849us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.811542:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13635 00000100:00100000:0.0:1746065157.820002:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.820641:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263707904 00000100:00100000:1.0:1746065157.820650:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263707904 00002000:00100000:1.0:1746065157.820686:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097f51180 x1830881263707904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.820696:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51180 with x1830881263707904 ext(4194304->5021695) 00002000:00010000:1.0:1746065157.820701:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f51180 00000100:00100000:1.0:1746065157.820726:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3967 00000100:00100000:1.0:1746065157.820732:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263707904:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065157.821253:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065157.821265:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263406592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746065157.821296:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.821341:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406592 00000100:00100000:2.0:1746065157.821344:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406592 00000100:00100000:2.0:1746065157.821366:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1746065157.821370:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263406592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746065157.821383:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 380928 granted 1208886720 pending 4550656 free 3903262720 avail 3671740416 00000100:00100000:2.0:1746065157.821410:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263406592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.821414:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1746065157.821445:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263406592:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1746065157.822363:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065157.833615:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881263707904:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12874us (13612us total) trans 0 rc 827392/827392 00000100:00100000:1.0:1746065157.833629:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3967 00002000:00100000:1.0:1746065157.833639:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880097f51180 x1830881263707904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/440 e 0 to 0 dl 1746065168 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065157.833648:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097f51180 with x1830881263707904 ext(4194304->5021695) 00002000:00010000:1.0:1746065157.833654:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097f51180 00000100:00100000:0.0:1746065157.855014:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.855071:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263708032 00000100:00100000:1.0:1746065157.855081:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263708032 00000100:00100000:1.0:1746065157.855133:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13725 00000100:00100000:1.0:1746065157.855140:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:32476:x1830881263708032:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065157.855160:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065157.855177:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14706ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342a2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.855227:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.855237:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.855245:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.855256:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.855261:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.855265:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.855317:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.855327:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 42 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.855332:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.855356:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 42 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.855366:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 42 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.855377:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263406720:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.855458:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.858401:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.858438:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263406720:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.858456:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065157.859495:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263708288 00000100:00100000:2.0:1746065157.859504:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263708288 00000100:00100000:2.0:1746065157.859556:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4973 00000100:00100000:2.0:1746065157.859562:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+43:27241:x1830881263708288:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065157.860983:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+44:27241:x1830881263708288:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1416us (2583us total) trans 8589936076 rc 0/0 00000100:00100000:2.0:1746065157.860991:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4973 00000100:00100000:0.0:1746065157.862989:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.863179:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263708416 00000100:00100000:3.0:1746065157.863186:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263708416 00010000:00010000:3.0:1746065157.863215:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 44 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.863249:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6195 00000100:00100000:3.0:1746065157.863255:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263708416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.863268:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.863273:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 44 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.863283:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 44 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.863302:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d000/0xad6b7ddc147050e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93417c expref: 44 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.863325:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065157.863330:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863338:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863343:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863362:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.863396:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263708416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.863402:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6195 00010000:00010000:3.0:1746065157.863501:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863508:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065157.863547:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:3.0:1746065157.863550:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065157.863563:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863571:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863581:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863586:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863591:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863596:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863601:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065157.863604:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863609:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863616:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065157.863619:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.863621:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863625:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc14706b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863633:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863637:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863641:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863644:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065157.863646:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863650:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863655:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800924c5600) 00010000:00010000:3.0:1746065157.863657:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065157.863659:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863663:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc14706b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.863688:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14706ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.863698:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 17 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.863703:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065157.863705:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065157.863707:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb800, rc 0) 00000100:00100000:3.0:1746065157.863729:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:32476:x1830881263708032:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 8591us (8724us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.863735:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13725 00000100:00100000:0.0:1746065157.868128:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.868693:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.868724:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.868740:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.868759:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263708544 00000100:00100000:0.0:1746065157.868766:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263708544 00000100:00100000:0.0:1746065157.868822:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263708672 00000100:00100000:0.0:1746065157.868824:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263708672 00000100:00100000:0.0:1746065157.868849:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263708800 00000100:00100000:0.0:1746065157.868852:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263708800 00000100:00100000:0.0:1746065157.868862:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263708928 00000100:00100000:0.0:1746065157.868863:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263708928 00000100:00100000:0.0:1746065157.868888:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13636 00000100:00100000:0.0:1746065157.868895:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263708544:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065157.868910:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.868924:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30200/0xad6b7ddc14706c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342a9 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.868969:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263406848:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065157.869034:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.869048:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13637 00000100:00100000:0.0:1746065157.869054:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263708672:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065157.869060:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.869068:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342b0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.869079:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.869081:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.869087:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.869105:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.869114:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683be00, rc 0) 00000100:00100000:0.0:1746065157.869134:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263708672:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 80us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.869139:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13637 00000100:00100000:0.0:1746065157.869153:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13638 00000100:00100000:0.0:1746065157.869157:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263708800:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065157.869162:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.869168:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342b7 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.869176:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.869177:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.869181:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.869189:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.869195:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a000, rc 0) 00000100:00100000:0.0:1746065157.869207:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263708800:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 50us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.869212:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13638 00000100:00100000:0.0:1746065157.869221:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13639 00000100:00100000:0.0:1746065157.869225:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263708928:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065157.869230:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.869235:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342be expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.869243:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.869245:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.869249:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.869257:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.869262:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683ba00, rc 0) 00000100:00100000:0.0:1746065157.869276:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263708928:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 51us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.869280:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13639 00000100:00100000:0.0:1746065157.869304:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.869316:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263709056 00000100:00100000:0.0:1746065157.869319:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263709056 00000100:00100000:0.0:1746065157.869332:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13640 00000100:00100000:0.0:1746065157.869336:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263709056:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065157.869341:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.869347:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342c5 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.869358:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.869359:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.869363:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.869370:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.869376:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a400, rc 0) 00000100:00100000:0.0:1746065157.869389:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2006:x1830881263709056:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 52us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.869393:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13640 00000100:00100000:0.0:1746065157.869814:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.869849:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263709184 00000100:00100000:2.0:1746065157.869853:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263709184 00000100:00100000:2.0:1746065157.869887:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13641 00000100:00100000:2.0:1746065157.869893:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263709184:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065157.869900:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.869907:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342cc expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.869916:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.869917:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.869921:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.869928:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.869934:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:2.0:1746065157.869964:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2007:x1830881263709184:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 71us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.869969:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13641 00000100:00100000:2.0:1746065157.871452:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263406848:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065157.871475:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30200/0xad6b7ddc14706c7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a9 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.871484:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30200/0xad6b7ddc14706c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a9 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.871550:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30200, rc 0) 00000100:00100000:2.0:1746065157.871588:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263708544:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 2693us (3466us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065157.871595:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13636 00000100:00100000:0.0:1746065157.873894:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.874014:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263709440 00000100:00100000:3.0:1746065157.874022:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263709440 00000100:00100000:3.0:1746065157.874063:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13726 00000100:00100000:3.0:1746065157.874070:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:32476:x1830881263709440:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065157.874088:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.874103:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14706f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342d3 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.874186:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.874198:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.874205:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.874227:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.874242:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 18 pid: 7203 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.874252:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263406976:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065157.874335:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065157.876612:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263406976:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065157.877084:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065157.877848:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.877939:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263709568 00000100:00100000:1.0:1746065157.877946:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263709568 00010000:00010000:1.0:1746065157.877973:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 19 pid: 7203 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.878008:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6196 00000100:00100000:1.0:1746065157.878015:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2004:x1830881263709568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.878027:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065157.878033:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 19 pid: 7203 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.878042:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 19 pid: 7203 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.878059:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14706c0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342a2 expref: 19 pid: 7203 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.878073:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.878078:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.878090:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.878096:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065157.878121:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.878156:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2004:x1830881263709568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.878162:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6196 00010000:00010000:3.0:1746065157.878165:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.878173:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065157.878192:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065157.878290:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14706f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342d3 expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.878317:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342d3 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.878323:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065157.878326:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065157.878328:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b600, rc 0) 00000100:00100000:3.0:1746065157.878352:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32476:x1830881263709440:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4283us (4465us total) trans 8589936077 rc 0/0 00000100:00100000:3.0:1746065157.878358:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13726 00000100:00100000:2.0:1746065157.880097:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.880800:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263709824 00000100:00100000:3.0:1746065157.880807:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263709824 00000100:00100000:3.0:1746065157.880849:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13727 00000100:00100000:3.0:1746065157.880855:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:32476:x1830881263709824:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065157.880883:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.880886:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065157.880904:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc14706f8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342d3 expref: 18 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.880915:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065157.880918:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065157.880926:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ac00/0xad6b7ddc1470706 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342da expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.881006:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc147070d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.881016:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc147070d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065157.881022:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc147070d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065157.881031:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065157.881103:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ac00/0xad6b7ddc1470706 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342da expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.882226:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc147070d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342da expref: 19 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.882233:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065157.882236:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065157.882238:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a800, rc 0) 00000100:00100000:3.0:1746065157.882292:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:32476:x1830881263709824:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1436us (2200us total) trans 8589936078 rc 0/0 00000100:00100000:3.0:1746065157.882299:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13727 00000100:00100000:0.0:1746065157.884903:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.884981:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263709952 00000100:00100000:3.0:1746065157.884989:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263709952 00000100:00100000:3.0:1746065157.885025:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13728 00000100:00100000:3.0:1746065157.885032:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:32476:x1830881263709952:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065157.885051:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.885067:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc147071b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342e1 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.885113:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc147071b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e1 expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.885124:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc147071b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e1 expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.885137:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065157.885140:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065157.885142:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ba00, rc 0) 00000100:00100000:3.0:1746065157.885198:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:32476:x1830881263709952:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 166us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.885203:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13728 00000100:00100000:0.0:1746065157.888813:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.888852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.888865:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.888890:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.888907:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.888927:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.888953:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263710080 00000100:00100000:1.0:1746065157.888961:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263710080 00000100:00100000:1.0:1746065157.888994:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263710208 00000100:00100000:1.0:1746065157.888996:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263710208 00000100:00100000:1.0:1746065157.889007:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263710336 00000100:00100000:1.0:1746065157.889009:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263710336 00000100:00100000:1.0:1746065157.889016:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263710464 00000100:00100000:1.0:1746065157.889018:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263710464 00000100:00100000:1.0:1746065157.889030:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263710592 00000100:00100000:1.0:1746065157.889032:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263710592 00000100:00100000:1.0:1746065157.889041:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263710720 00000100:00100000:1.0:1746065157.889042:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263710720 00000100:00100000:1.0:1746065157.889051:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13642 00000100:00100000:1.0:1746065157.889057:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263710080:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065157.889090:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.889104:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 36 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.889115:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.889117:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065157.889119:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.889141:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 36 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.889146:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13643 00010000:00010000:1.0:1746065157.889150:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 36 pid: 10219 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.889154:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263710208:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:1.0:1746065157.889162:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263407104:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.889177:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.889191:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.889198:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 16 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.889207:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.889211:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.889213:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.889214:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.889224:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13644 00000100:00100000:1.0:1746065157.889229:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263710336:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065157.889232:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.889239:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 27 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.889249:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263407232:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.889251:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.889259:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 27 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.889264:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 16 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.889270:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.889276:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13645 00010000:00010000:1.0:1746065157.889278:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.889280:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065157.889280:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263710464:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065157.889281:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.889293:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.889295:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.889302:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 42 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.889306:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.889310:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263407360:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.889312:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.889318:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.889322:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.889323:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.889325:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.889336:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.889339:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13646 00010000:00010000:0.0:1746065157.889342:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 36 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.889345:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2005:x1830881263710592:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:0.0:1746065157.889348:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263407488:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.889358:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.889367:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.889368:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13647 00000100:00100000:0.0:1746065157.889372:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2005:x1830881263710720:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065157.889373:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.889378:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 36 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.889384:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.889387:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.889388:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065157.889390:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 6/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.889395:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.889401:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.889402:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 36 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.889407:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.889409:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 36 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.889411:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.889412:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.889413:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.889416:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263407616:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.889424:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.889430:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 27 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.889435:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263407744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.890185:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a780 going to sleep for 11 seconds 00010000:00010000:2.0:1746065157.890392:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 16 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.890401:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 16 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.890409:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263407872:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.890461:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.890467:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.890474:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263408000:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.890488:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9349c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065157.890536:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 16 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.890543:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 16 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.890549:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263408128:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.890572:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 27 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.890578:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 27 pid: 13375 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.890589:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263408256:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.890601:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1ae40 going to sleep for 11 seconds 00010000:00010000:0.0:1746065157.890803:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.890811:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 18 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.890824:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263408384:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.890857:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.890865:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.890885:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263408512:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.890906:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a934480 going to sleep for 11 seconds 00010000:00010000:1.0:1746065157.891010:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065157.891017:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 18 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.891023:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263408640:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.891049:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.891056:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.891064:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263408768:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.891077:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1aa80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065157.891112:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.891120:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 16 pid: 9550 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.891126:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263408896:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.891147:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 42 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.891154:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 42 pid: 3068 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.891161:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263409024:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.891175:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098846e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065157.895802:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.895860:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263407488:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.895915:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263407744:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.895960:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263408384:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.895982:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263408512:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.896005:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.896035:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.896063:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.896076:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.896091:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263710848 00000100:00100000:0.0:1746065157.896096:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263710848 00010000:00010000:0.0:1746065157.896120:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 28 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.896139:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263711488 00000100:00100000:0.0:1746065157.896141:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263711488 00010000:00010000:0.0:1746065157.896148:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 37 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.896157:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263711616 00000100:00100000:0.0:1746065157.896159:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263711616 00010000:00010000:0.0:1746065157.896166:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.896178:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263711744 00000100:00100000:0.0:1746065157.896179:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263711744 00010000:00010000:0.0:1746065157.896186:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 19 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.896195:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6197 00000100:00100000:0.0:1746065157.896201:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+28:2005:x1830881263710848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.896212:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.896229:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 28 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.896237:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 28 pid: 3068 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.896258:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.896389:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6198 00000100:00100000:3.0:1746065157.896397:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881263711488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.896405:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.896415:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 37 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.896423:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 37 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.896435:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c400/0xad6b7ddc1470673 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93426a expref: 37 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.896449:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.896456:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6199 00000100:00100000:1.0:1746065157.896464:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263711616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.896471:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065157.896480:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.896492:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.896503:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065157.896838:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147068f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934286 expref: 28 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.896851:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263407232:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.896859:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263407872:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.896865:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263408000:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.896892:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.897152:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+27:2005:x1830881263710848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 948us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.897157:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6197 00000100:00100000:0.0:1746065157.897171:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6200 00000100:00100000:0.0:1746065157.897176:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+19:2006:x1830881263711744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.897183:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.897190:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 19 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.897202:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 19 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.897212:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683ba00/0xad6b7ddc14706dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342be expref: 19 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.897224:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.897238:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+18:2006:x1830881263711744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.897243:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6200 00000100:00100000:0.0:1746065157.897313:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.897343:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263712000 00000100:00100000:0.0:1746065157.897347:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263712000 00010000:00010000:0.0:1746065157.897359:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 21 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.897372:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2006:x1830881263711616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 908us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.897374:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6201 00000100:00100000:1.0:1746065157.897379:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6199 00000100:00100000:0.0:1746065157.897379:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+21:2007:x1830881263712000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.897384:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065157.897386:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065157.897391:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 21 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.897392:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263711104 00000100:00100000:1.0:1746065157.897394:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263711104 00010000:00010000:0.0:1746065157.897398:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 21 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.897406:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 43 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.897407:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065157.897413:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800727a9600/0xad6b7ddc147065e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934255 expref: 21 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.897414:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263711360 00000100:00100000:2.0:1746065157.897417:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263711360 00000100:00100000:1.0:1746065157.897418:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6202 00010000:00010000:0.0:1746065157.897421:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065157.897422:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263711104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.897423:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.897426:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897427:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.897428:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.897434:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.897435:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 43 pid: 3067 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.897437:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6203 00000100:00100000:2.0:1746065157.897441:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263711360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.897443:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 43 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.897446:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.897448:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065157.897452:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.897454:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065157.897459:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.897460:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+20:2007:x1830881263712000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.897465:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6201 00010000:00010000:2.0:1746065157.897469:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc14706ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b0 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.897469:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881263711104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.897474:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6202 00010000:00010000:2.0:1746065157.897477:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065157.897478:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.897485:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.897488:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263711360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.897493:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6203 00010000:00010000:0.0:1746065157.897497:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.897502:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3800/0xad6b7ddc14705a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341d7 expref: 42 pid: 3067 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.897504:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.897514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065157.897514:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.897520:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5aa00 already unused, calling callback (ffffffffa086fd70) 00000100:00100000:1.0:1746065157.897522:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263407360:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.897523:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.897529:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.897539:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263712128 00000100:00100000:2.0:1746065157.897541:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263712128 00010000:00010000:0.0:1746065157.897542:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.897547:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc1470737 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897550:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 37 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.897561:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6204 00000100:00100000:2.0:1746065157.897565:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263712128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.897571:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.897577:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 37 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.897579:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263710464:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 8299us (8688us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065157.897584:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 37 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.897586:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13645 00010000:00010000:2.0:1746065157.897593:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.897601:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263712128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.897605:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6204 00000100:00100000:2.0:1746065157.897626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.897640:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263710976 00000100:00100000:2.0:1746065157.897642:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263710976 00000100:00100000:0.0:1746065157.897645:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.897677:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.897689:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263711232 00000100:00100000:0.0:1746065157.897691:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263711232 00010000:00010000:0.0:1746065157.897701:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 27 pid: 12258 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.897716:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263711872 00000100:00100000:0.0:1746065157.897718:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263711872 00010000:00010000:0.0:1746065157.897725:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.897735:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6205 00000100:00100000:0.0:1746065157.897739:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+27:2004:x1830881263711232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.897745:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.897752:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 27 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.897759:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 27 pid: 12258 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.897769:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1470696 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93428d expref: 27 pid: 12258 timeout: 853 lvb_type: 1 00002000:00100000:2.0:1746065157.897786:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8a:0x0] (172032->528383) req@ffff8800957db480 x1830881263710976/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/0 e 0 to 0 dl 1746065168 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746065157.897791:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065157.897794:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db480 with x1830881263710976 ext(172032->528383) 00010000:00010000:2.0:1746065157.897800:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 37 pid: 10219 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.897805:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263711232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.897810:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6205 00010000:00010000:2.0:1746065157.897813:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 37 pid: 10219 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.897818:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957db480 00000100:00100000:0.0:1746065157.897818:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6206 00000100:00100000:0.0:1746065157.897822:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881263711872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.897827:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065157.897829:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1361 00000100:00100000:2.0:1746065157.897834:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263710976:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:0.0:1746065157.897834:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.897840:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.897849:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d800/0xad6b7ddc1470665 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93425c expref: 42 pid: 10219 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.897855:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.897856:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.897858:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.897863:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.897888:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.897901:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263711872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.897905:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6206 00010000:00010000:2.0:1746065157.897920:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897926:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897936:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897942:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897947:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897952:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683aa00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065157.897954:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897964:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897972:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.897978:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1470729 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.898014:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263710208:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 8860us (9161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.898019:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13643 00000100:00100000:3.0:1746065157.898079:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881263711488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1682us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.898085:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6198 00010000:00010000:0.0:1746065157.898180:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147067a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934271 expref: 37 pid: 3068 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.898188:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263407616:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.899307:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a000/0xad6b7ddc14706d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342b7 expref: 14 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746065157.899316:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263408128:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.899329:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263408256:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.899346:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.900019:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.900068:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263407104:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065157.900081:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.900219:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263712256 00000100:00100000:2.0:1746065157.900224:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263712256 00010000:00010000:2.0:1746065157.900243:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 26 pid: 13375 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746065157.900262:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6207 00000100:00100000:2.0:1746065157.900266:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+26:2004:x1830881263712256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.900275:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.900288:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 26 pid: 13375 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746065157.900297:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 26 pid: 13375 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746065157.900316:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131bef600/0xad6b7ddc147058c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9341bb expref: 26 pid: 13375 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746065157.900327:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.900328:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.900331:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.900337:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.900350:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.900375:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc4a269-0136-4970-860c-c944630694a4+25:2004:x1830881263712256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.900381:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6207 00010000:00010000:1.0:1746065157.901389:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.901399:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.901415:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.901421:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.901427:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.901437:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f0bba00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065157.901440:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.901445:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.901454:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.901459:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f0bba00/0xad6b7ddc1470730 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.901525:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263710336:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 12294us (12657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.901533:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13644 00000100:00100000:2.0:1746065157.903905:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.903905:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263408768:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.903905:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263408896:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065157.903963:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263409024:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.903991:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.904245:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263712384 00000100:00100000:3.0:1746065157.904250:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263712384 00010000:00010000:3.0:1746065157.904273:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 13 pid: 9550 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.908411:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.908464:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263408640:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065157.908490:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.908911:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263712512 00000100:00100000:1.0:1746065157.908916:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263712512 00000100:00100000:3.0:1746065157.908920:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6208 00000100:00100000:0.0:1746065157.908923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.908930:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2007:x1830881263712384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065157.908934:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263712640 00010000:00010000:1.0:1746065157.908936:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.908937:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263712640 00010000:00010000:3.0:1746065157.908943:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.908948:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 41 pid: 3068 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.908954:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6209 00000100:00100000:1.0:1746065157.908959:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2004:x1830881263712512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.908960:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 13 pid: 9550 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746065157.908960:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6210 00000100:00100000:0.0:1746065157.908964:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881263712640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.908967:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.908969:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.908970:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 13 pid: 9550 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.908976:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746065157.908984:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.908985:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 41 pid: 3068 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.908999:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a400/0xad6b7ddc14706e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342c5 expref: 17 pid: 12260 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746065157.909000:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14706ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342cc expref: 13 pid: 9550 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746065157.909001:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 41 pid: 3068 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.909010:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1470688 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93427f expref: 41 pid: 3068 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.909011:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065157.909013:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.909015:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.909019:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.909026:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065157.909039:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263712512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (637us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065157.909039:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.909045:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6209 00010000:00010000:3.0:1746065157.909049:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.909050:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881263712640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.909057:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6210 00010000:00010000:1.0:1746065157.909066:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.909069:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2007:x1830881263712384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (5168us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065157.909072:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065157.909075:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6208 00010000:00010000:1.0:1746065157.909086:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.909092:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.909098:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.909103:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c285e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065157.909106:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.909112:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.909121:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065157.909126:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc1470745 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.909138:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.909161:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263710720:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 19788us (20233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.909168:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13647 00000100:00100000:3.0:1746065157.909509:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263712768 00000100:00100000:3.0:1746065157.909512:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263712768 00010000:00010000:3.0:1746065157.909525:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.909551:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6211 00000100:00100000:3.0:1746065157.909556:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+20:2005:x1830881263712768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.909562:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.909570:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.909578:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.909589:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147066c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934263 expref: 20 pid: 13375 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.909597:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.909598:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.909600:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.909610:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.909622:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.909640:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+19:2005:x1830881263712768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.909645:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6211 00010000:00010000:0.0:1746065157.909744:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.909752:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.909764:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.909769:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.909790:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.909795:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a656e600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065157.909798:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.909804:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.909813:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.910025:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147073e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.910132:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263710592:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 20786us (21221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.910138:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13646 00000100:00100000:2.0:1746065157.910206:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881263710976:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12370us (12577us total) trans 21474840983 rc 0/0 00000100:00100000:2.0:1746065157.910213:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1361 00002000:00100000:2.0:1746065157.910220:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8a:0x0] (172032->528383) req@ffff8800957db480 x1830881263710976/t21474840983(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:73/0 lens 488/448 e 0 to 0 dl 1746065168 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065157.910228:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db480 with x1830881263710976 ext(172032->528383) 00010000:00010000:2.0:1746065157.910233:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 37 pid: 10219 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.910241:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 37 pid: 10219 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746065157.910247:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957db480 00000001:00080000:0.0:1746065157.911333:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840983 is committed 00000001:00080000:0.0:1746065157.911347:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840980 is committed 00000001:00080000:0.0:1746065157.911375:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840971 is committed 00000001:00080000:0.0:1746065157.911399:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840953 is committed 00000100:00100000:0.0:1746065157.912839:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.912990:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263712896 00000100:00100000:2.0:1746065157.912997:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263712896 00010000:00010000:2.0:1746065157.913019:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 19 pid: 10219 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.913052:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6212 00000100:00100000:2.0:1746065157.913059:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+19:2005:x1830881263712896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.913069:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.913084:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 19 pid: 10219 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.913124:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 19 pid: 10219 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.913142:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147069d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->528383) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934294 expref: 19 pid: 10219 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.913156:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.913157:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.913161:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.913168:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.913324:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065157.913382:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.913395:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.913410:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.913416:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.913422:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065157.913446:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+18:2005:x1830881263712896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 386us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.913452:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6212 00010000:00010000:0.0:1746065157.913488:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065157.913492:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.913498:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.913507:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.913513:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fda600/0xad6b7ddc1470722 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065157.913551:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263710080:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 24494us (24780us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.913558:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13642 00000100:00100000:0.0:1746065157.916526:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.916624:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263713152 00000100:00100000:2.0:1746065157.916630:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263713152 00000100:00100000:2.0:1746065157.916679:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13729 00000100:00100000:2.0:1746065157.916685:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+20:32476:x1830881263713152:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:2.0:1746065157.916727:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.916746:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ba00/0xad6b7ddc147071b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e1 expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.916761:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.916765:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065157.916968:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.916982:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 42 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.916988:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 36 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.916995:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.917001:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 42 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.917007:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 7/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.917039:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 42 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.917050:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 42 pid: 7231 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.917061:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263409152:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.917154:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 36 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.917162:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 36 pid: 7203 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.917169:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263409280:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.917190:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 36 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.917196:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 36 pid: 7205 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.917205:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263409408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.917220:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 42 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.917230:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 42 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.917237:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263409536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.917248:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065157.923685:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263409280:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.923696:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263409408:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065157.923697:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.923703:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263409536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065157.923710:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263409152:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065157.923735:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065157.923763:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.923809:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263713408 00000100:00100000:0.0:1746065157.923812:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.923815:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263713408 00010000:00010000:3.0:1746065157.923840:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 37 pid: 7205 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.923888:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.924178:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263713280 00000100:00100000:3.0:1746065157.924181:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263713280 00010000:00010000:3.0:1746065157.924193:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 38 pid: 7203 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.924207:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263713536 00000100:00100000:3.0:1746065157.924209:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263713536 00010000:00010000:3.0:1746065157.924218:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 43 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.924225:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263713664 00000100:00100000:3.0:1746065157.924226:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263713664 00010000:00010000:3.0:1746065157.924233:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 44 pid: 7231 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746065157.924242:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6213 00000100:00100000:3.0:1746065157.924248:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+38:2005:x1830881263713408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065157.924259:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065157.924264:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 38 pid: 7205 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746065157.924284:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6214 00000100:00100000:0.0:1746065157.924290:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+38:2005:x1830881263713280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065157.924307:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065157.924311:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 38 pid: 7203 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746065157.924338:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6215 00000100:00100000:1.0:1746065157.924347:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881263713536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065157.924353:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065157.924357:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 44 pid: 13395 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746065157.924642:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6216 00000100:00100000:2.0:1746065157.924648:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881263713664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065157.924655:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065157.924658:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 44 pid: 7231 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.927141:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 38 pid: 7205 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.927177:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 38 pid: 7203 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.927213:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1470045 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e6c expref: 38 pid: 7205 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746065157.927233:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065157.927238:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065157.927246:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065157.927325:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+37:2005:x1830881263713408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3075us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.927334:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6213 00010000:00010000:1.0:1746065157.927481:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 44 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.927494:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc146ffce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933e42 expref: 44 pid: 13395 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746065157.927508:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065157.927511:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065157.927516:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065157.927538:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881263713536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3193us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.927544:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6215 00010000:00010000:0.0:1746065157.927910:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a24c00/0xad6b7ddc146fe62 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d4d expref: 36 pid: 7203 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746065157.927927:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065157.927930:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.927935:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065157.927953:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+35:2005:x1830881263713280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3663us (4190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.927958:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6214 00010000:00010000:0.0:1746065157.928054:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065157.928467:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 42 pid: 7231 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.928480:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0c00/0xad6b7ddc146feb6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933d70 expref: 42 pid: 7231 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746065157.928496:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.928499:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.928505:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.928510:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.928536:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065157.928564:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881263713664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3916us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.928569:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6216 00010000:00010000:0.0:1746065157.928695:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.928701:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000040:00080000:0.0:1746065157.930945:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].604, 88 off61216 00000004:00080000:0.0:1746065157.930954:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949179887ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.930981:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].541, 88 off55664 00000004:00080000:0.0:1746065157.930986:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753949212056ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065157.931002:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].542, 88 off55752 00000004:00080000:0.0:1746065157.931005:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753949231041ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065157.931013:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].605, 88 off61304 00000004:00080000:0.0:1746065157.931017:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949243126ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.931024:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].606, 88 off61392 00000004:00080000:0.0:1746065157.931027:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949253720ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.931043:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].543, 88 off55840 00000004:00080000:0.0:1746065157.931047:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753949273076ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065157.931067:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].544, 88 off55928 00000004:00080000:0.0:1746065157.931070:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753949296193ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065157.931079:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].545, 88 off56016 00000004:00080000:0.0:1746065157.931082:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753949308046ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065157.931374:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].607, 88 off61480 00000004:00080000:0.0:1746065157.931379:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949605413ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.931395:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].546, 88 off56104 00000004:00080000:0.0:1746065157.931397:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753949623773ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065157.931499:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].608, 88 off61568 00000004:00080000:0.0:1746065157.931504:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949730333ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.931516:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].547, 88 off56192 00000004:00080000:0.0:1746065157.931518:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753949744548ns, next at 615601404258ns, rc = 0 00000040:00080000:0.0:1746065157.931524:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].609, 88 off61656 00000004:00080000:0.0:1746065157.931526:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949752591ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.931532:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].610, 88 off61744 00000004:00080000:0.0:1746065157.931534:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949760305ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.931539:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].611, 88 off61832 00000004:00080000:0.0:1746065157.931541:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949767681ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.931546:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].612, 88 off61920 00000004:00080000:0.0:1746065157.931548:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753949774688ns, next at 615601378837ns, rc = 0 00000040:00080000:0.0:1746065157.931554:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].548, 88 off56280 00000004:00080000:0.0:1746065157.931556:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753949782849ns, next at 615601404258ns, rc = 0 00000001:00080000:3.0:1746065157.933308:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936079 is committed 00000004:00080000:3.0:1746065157.933318:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 542 committed 00000004:00080000:3.0:1746065157.933336:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 604 committed 00000004:00080000:3.0:1746065157.933350:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 603 committed 00000004:00080000:3.0:1746065157.933351:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 602 committed 00000004:00080000:3.0:1746065157.933353:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 601 committed 00000004:00080000:3.0:1746065157.933354:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 541 committed 00000004:00080000:3.0:1746065157.933355:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 600 committed 00000004:00080000:3.0:1746065157.933356:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 540 committed 00000004:00080000:3.0:1746065157.933358:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 599 committed 00000004:00080000:3.0:1746065157.933359:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 539 committed 00000004:00080000:3.0:1746065157.933361:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 538 committed 00000004:00080000:3.0:1746065157.933363:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 537 committed 00000004:00080000:3.0:1746065157.933365:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 598 committed 00000004:00080000:3.0:1746065157.933367:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 597 committed 00000004:00080000:3.0:1746065157.933368:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 536 committed 00000004:00080000:3.0:1746065157.933370:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 535 committed 00000004:00080000:3.0:1746065157.933371:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 596 committed 00000001:00080000:3.0:1746065157.933378:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936076 is committed 00000001:00080000:3.0:1746065157.933382:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936075 is committed 00000100:00100000:2.0:1746065157.933750:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263409792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065157.933801:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263410048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065157.933820:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.933861:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263410304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065157.933889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065157.933931:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263409920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065157.933951:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065157.934070:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263409664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065157.934109:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263410432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065157.934123:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065157.934131:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263410944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065157.934142:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065157.934149:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263411456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065157.934159:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065157.934172:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065157.934176:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263410816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065157.934188:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409792 00000100:00100000:1.0:1746065157.934195:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409792 00000100:00100000:0.0:1746065157.934202:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065157.934213:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263411328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065157.934220:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410304 00000100:00100000:2.0:1746065157.934223:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410304 00000100:00100000:0.0:1746065157.934225:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065157.934232:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409920 00000100:00100000:1.0:1746065157.934235:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409920 00000100:00100000:2.0:1746065157.934238:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410432 00000100:00100000:2.0:1746065157.934240:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410432 00000100:00100000:0.0:1746065157.934244:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410944 00000100:00100000:1.0:1746065157.934245:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411456 00000100:00100000:0.0:1746065157.934246:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410944 00000100:00100000:2.0:1746065157.934247:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410816 00000100:00100000:1.0:1746065157.934247:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411456 00000100:00100000:2.0:1746065157.934248:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410816 00000100:00100000:1.0:1746065157.934256:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411328 00000100:00100000:1.0:1746065157.934257:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411328 00000100:00100000:2.0:1746065157.934258:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13648 00000100:00100000:2.0:1746065157.934264:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263409792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065157.934343:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065157.934353:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263410176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065157.934367:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065157.934373:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263410688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065157.934377:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263409792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (557us total) trans 21474840984 rc 0/0 00000100:00100000:3.0:1746065157.934384:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065157.934390:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263411200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065157.934436:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13649 00000100:00100000:2.0:1746065157.934442:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13648 00000100:00100000:0.0:1746065157.934443:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263410304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065157.934446:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409664 00000100:00100000:1.0:1746065157.934449:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409664 00000100:00100000:2.0:1746065157.934454:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410176 00000100:00100000:2.0:1746065157.934457:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410176 00000100:00100000:1.0:1746065157.934459:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410688 00000100:00100000:1.0:1746065157.934461:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410688 00000100:00100000:2.0:1746065157.934467:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13650 00000100:00100000:2.0:1746065157.934472:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263409920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065157.934472:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13651 00000100:00100000:1.0:1746065157.934477:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263410432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065157.934501:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263410304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (611us total) trans 21474840985 rc 0/0 00000100:00100000:0.0:1746065157.934507:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13649 00000100:00100000:2.0:1746065157.934515:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881263409920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (563us total) trans 21474840986 rc 0/0 00000100:00100000:0.0:1746065157.934519:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13652 00000100:00100000:0.0:1746065157.934523:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3760:x1830881263411456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065157.934524:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065157.934528:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065157.934530:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065157.934531:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:1.0:1746065157.934533:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:1.0:1746065157.934555:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881263410432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (430us total) trans 21474840987 rc 0/0 00000100:00100000:1.0:1746065157.934561:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13651 00000100:00100000:1.0:1746065157.934571:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13653 00000100:00100000:1.0:1746065157.934576:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263410816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065157.934590:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263411456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (429us total) trans 17179873527 rc 0/0 00000100:00100000:0.0:1746065157.934595:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13652 00000100:00100000:0.0:1746065157.934605:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13654 00000100:00100000:0.0:1746065157.934609:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263410944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065157.934630:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263410816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (425us total) trans 17179873528 rc 0/0 00000100:00100000:1.0:1746065157.934635:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13653 00000100:00100000:1.0:1746065157.934644:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13655 00000100:00100000:1.0:1746065157.934648:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263411328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065157.934657:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263410944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (513us total) trans 17179873529 rc 0/0 00000100:00100000:0.0:1746065157.934662:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13654 00000100:00100000:0.0:1746065157.934675:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13656 00000100:00100000:0.0:1746065157.934678:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881263409664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065157.934697:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263411328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (470us total) trans 17179873530 rc 0/0 00000100:00100000:1.0:1746065157.934702:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13655 00000100:00100000:1.0:1746065157.934711:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13657 00000100:00100000:1.0:1746065157.934715:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263410176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065157.934729:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263409664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (384us total) trans 21474840988 rc 0/0 00000100:00100000:0.0:1746065157.934734:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13656 00000100:00100000:0.0:1746065157.934744:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13658 00000100:00100000:0.0:1746065157.934748:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881263410688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065157.934752:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:1.0:1746065157.934754:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065157.934757:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065157.934758:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065157.934760:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:1.0:1746065157.934796:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263410176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (428us total) trans 21474840989 rc 0/0 00000100:00100000:3.0:1746065157.935003:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065157.935024:0:3762:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840971 gen 2 00000004:00080000:3.0:1746065157.935031:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edae300, transno 21474840919 00000004:00080000:3.0:1746065157.935037:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edac700, transno 21474840920 00000004:00080000:3.0:1746065157.935039:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf480, transno 21474840921 00000004:00080000:3.0:1746065157.935041:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edae680, transno 21474840922 00000004:00080000:3.0:1746065157.935043:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edace00, transno 21474840923 00000004:00080000:3.0:1746065157.935045:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaed80, transno 21474840924 00000004:00080000:3.0:1746065157.935046:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edac000, transno 21474840925 00000004:00080000:3.0:1746065157.935048:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e52d80, transno 21474840926 00000004:00080000:3.0:1746065157.935050:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b64700, transno 21474840927 00000004:00080000:3.0:1746065157.935052:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856d880, transno 21474840929 00000004:00080000:3.0:1746065157.935055:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856e680, transno 21474840930 00000004:00080000:3.0:1746065157.935057:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bf800, transno 21474840931 00000004:00080000:3.0:1746065157.935059:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097241880, transno 21474840932 00000004:00080000:3.0:1746065157.935061:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f480, transno 21474840933 00000004:00080000:3.0:1746065157.935063:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f100, transno 21474840934 00000004:00080000:3.0:1746065157.935065:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097242300, transno 21474840935 00000004:00080000:3.0:1746065157.935067:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097242a00, transno 21474840936 00000004:00080000:3.0:1746065157.935069:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097241180, transno 21474840937 00000004:00080000:3.0:1746065157.935071:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834df80, transno 21474840941 00000004:00080000:3.0:1746065157.935073:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834dc00, transno 21474840942 00000004:00080000:3.0:1746065157.935075:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d180, transno 21474840943 00000004:00080000:3.0:1746065157.935077:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834e680, transno 21474840944 00000100:00100000:2.0:1746065157.935078:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13650 00000004:00080000:3.0:1746065157.935079:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834e300, transno 21474840945 00000004:00080000:3.0:1746065157.935081:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c000, transno 21474840946 00000004:00080000:3.0:1746065157.935082:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c380, transno 21474840947 00000100:00100000:1.0:1746065157.935083:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13657 00000004:00080000:3.0:1746065157.935085:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8700, transno 21474840948 00000004:00080000:3.0:1746065157.935087:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834ed80, transno 21474840949 00000100:00100000:2.0:1746065157.935088:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411200 00000004:00080000:3.0:1746065157.935089:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092745f80, transno 21474840954 00000100:00100000:2.0:1746065157.935090:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411200 00000004:00080000:3.0:1746065157.935091:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf6a00, transno 21474840955 00000004:00080000:3.0:1746065157.935093:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d880, transno 21474840956 00000004:00080000:3.0:1746065157.935095:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52b100, transno 21474840957 00000004:00080000:3.0:1746065157.935097:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092746300, transno 21474840958 00000004:00080000:3.0:1746065157.935099:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52aa00, transno 21474840959 00000100:00080000:1.0:1746065157.935100:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1746065157.935101:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf5c00, transno 21474840960 00000100:00080000:1.0:1746065157.935102:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746065157.935103:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c700, transno 21474840961 00000100:00100000:2.0:1746065157.935103:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13659 00000004:00080000:3.0:1746065157.935106:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90700, transno 21474840962 00000100:00100000:2.0:1746065157.935106:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3762:x1830881263411200:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065157.935108:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800983b9500, transno 21474840963 00000004:00080000:3.0:1746065157.935110:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800983baa00, transno 21474840964 00000004:00080000:3.0:1746065157.935112:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800983b8000, transno 21474840965 00000004:00080000:3.0:1746065157.935114:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800983bad80, transno 21474840966 00000100:00100000:1.0:1746065157.935115:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065157.935116:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a93480, transno 21474840967 00000004:00080000:3.0:1746065157.935118:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a91500, transno 21474840968 00000004:00080000:3.0:1746065157.935120:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800983b9c00, transno 21474840969 00000004:00080000:3.0:1746065157.935122:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800983b8700, transno 21474840970 00000004:00080000:3.0:1746065157.935124:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a79880, transno 21474840971 00000100:00100000:3.0:1746065157.935129:0:3762:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880097f52d80 x1830881263409664/t21474840988(21474840988) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065173 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746065157.935138:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f52d80/2, rc 0, transno 21474840988 00000100:00100000:1.0:1746065157.935138:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263410560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065157.935142:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263409664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065157.935152:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f53480/2, rc 0, transno 21474840989 00000100:00100000:3.0:1746065157.935154:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263410176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065157.935156:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.935157:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3762:x1830881263411200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (154us total) trans 17179873531 rc 0/0 00000004:00080000:3.0:1746065157.935161:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f42a00/2, rc 0, transno 17179873531 00000100:00100000:2.0:1746065157.935162:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13659 00000100:00100000:3.0:1746065157.935163:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263411200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065157.935168:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263411072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065157.935169:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410048 00000100:00100000:2.0:1746065157.935171:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410048 00000100:00100000:3.0:1746065157.935175:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410560 00000100:00100000:3.0:1746065157.935177:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410560 00000100:00100000:2.0:1746065157.935179:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13660 00000100:00100000:1.0:1746065157.935180:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065157.935183:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263410048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065157.935186:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411072 00000100:00100000:3.0:1746065157.935187:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411072 00000100:00100000:1.0:1746065157.935187:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263411584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065157.935194:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13661 00000100:00100000:3.0:1746065157.935197:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263410560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065157.935198:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065157.935213:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411584 00000100:00100000:1.0:1746065157.935216:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411584 00002000:00010000:2.0:1746065157.935218:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065157.935221:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065157.935223:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065157.935224:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065157.935226:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746065157.935227:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13662 00002000:00010000:3.0:1746065157.935230:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00000100:00100000:1.0:1746065157.935231:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3761:x1830881263411072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065157.935232:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065157.935233:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065157.935235:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065157.935236:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:2.0:1746065157.935246:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263410048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (131us total) trans 21474840990 rc 0/0 00000100:00100000:3.0:1746065157.935250:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263410560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (94us total) trans 21474840991 rc 0/0 00000100:00100000:2.0:1746065157.935254:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13660 00002000:00010000:1.0:1746065157.935271:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065157.935273:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065157.935275:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065157.935409:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065157.935411:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:1.0:1746065157.935433:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3761:x1830881263411072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (251us total) trans 17179873532 rc 0/0 00000100:00100000:3.0:1746065157.935458:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13661 00000100:00100000:2.0:1746065157.935462:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13663 00000100:00100000:2.0:1746065157.935467:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3761:x1830881263411584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065157.935520:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3761:x1830881263411584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (321us total) trans 17179873533 rc 0/0 00000100:00100000:2.0:1746065157.935525:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13663 00000004:00080000:2.0:1746065157.935550:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f52a00/2, rc 0, transno 21474840984 00000100:00100000:2.0:1746065157.935553:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263409792:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065157.935558:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f50700/2, rc 0, transno 21474840985 00000100:00100000:2.0:1746065157.935560:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263410304:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065157.935637:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 45 done 00000100:00100000:1.0:1746065157.935674:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13662 00000004:00080000:1.0:1746065157.935699:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f41880/2, rc 0, transno 17179873532 00000100:00100000:1.0:1746065157.935702:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263411072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065157.935705:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263410688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 956us (1318us total) trans 17179873534 rc 0/0 00000004:00080000:1.0:1746065157.935708:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd5180/2, rc 0, transno 17179873533 00000100:00100000:0.0:1746065157.935710:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13658 00000100:00100000:1.0:1746065157.935711:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263411584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065157.935717:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f50a80/2, rc 0, transno 21474840990 00000100:00100000:1.0:1746065157.935719:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263410048:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065157.935724:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f51880/2, rc 0, transno 21474840991 00000100:00100000:1.0:1746065157.935727:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263410560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065157.935732:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065157.935736:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263411712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065157.935736:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f42d80/2, rc 0, transno 17179873528 00000100:00100000:0.0:1746065157.935739:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263410816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065157.935745:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f40a80/2, rc 0, transno 17179873534 00000004:00080000:0.0:1746065157.935746:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f40380/2, rc 0, transno 17179873530 00000100:00100000:2.0:1746065157.935748:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263410688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065157.935748:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263411328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065157.935752:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065157.935755:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f51500/2, rc 0, transno 21474840986 00000100:00100000:0.0:1746065157.935757:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263409920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065157.935764:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097f50e00/2, rc 0, transno 21474840987 00000100:00100000:0.0:1746065157.935766:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263410432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065157.935768:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411712 00000100:00100000:2.0:1746065157.935770:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411712 00000004:00080000:0.0:1746065157.935783:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f43100/2, rc 0, transno 17179873529 00000100:00100000:0.0:1746065157.935786:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263410944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065157.935793:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f43800/2, rc 0, transno 17179873527 00000100:00100000:0.0:1746065157.935796:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263411456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065157.935799:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13664 00000100:00100000:2.0:1746065157.935803:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263411712:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1746065157.935827:0:13395:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88013513a300 reply state ffff880099e55c00 transno 8589936079 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.935842:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065157.935850:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065157.935853:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065157.935855:0:13395:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065157.935861:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263411712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (109us total) trans 21474840992 rc 0/0 00000100:00100000:2.0:1746065157.935865:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13664 00010000:00080000:0.0:1746065157.935925:0:13395:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065157.935935:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32476:x1830881263713152:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 19249us (19414us total) trans 8589936079 rc 0/0 00000100:00100000:0.0:1746065157.935941:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13729 00000004:00080000:1.0:1746065157.935944:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6d80/2, rc 0, transno 21474840992 00000100:00100000:1.0:1746065157.935947:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263411712:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065157.935978:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.935985:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.935990:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.935995:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065157.935999:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.936004:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.936089:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.936092:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065157.936095:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.936100:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147074c lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00000100:00100000:2.0:1746065157.938479:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.938626:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263713792 00000100:00100000:0.0:1746065157.938632:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263713792 00000100:00100000:0.0:1746065157.938672:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13730 00000100:00100000:0.0:1746065157.938679:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+7:32476:x1830881263713792:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065157.938696:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.938710:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342e8 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.938755:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.938766:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065157.938799:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065157.938801:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065157.938803:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358800, rc 0) 00000100:00100000:0.0:1746065157.938846:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32476:x1830881263713792:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 167us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.938851:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13730 00000100:00100000:0.0:1746065157.942864:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065157.943076:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263713920 00000100:00100000:2.0:1746065157.943083:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263713920 00000100:00100000:2.0:1746065157.943123:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13731 00000100:00100000:2.0:1746065157.943129:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32476:x1830881263713920:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065157.943144:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.943158:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6e400/0xad6b7ddc147075a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342ef expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.943224:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.943235:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.943243:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:2.0:1746065157.943263:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065157.943266:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065157.943277:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065157.943294:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab6e400/0xad6b7ddc147075a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.943304:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.943311:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065157.943313:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065157.943315:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:2.0:1746065157.943362:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32476:x1830881263713920:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 233us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.943367:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13731 00000100:00100000:0.0:1746065157.945279:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.945314:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.945343:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.945375:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263714048 00000100:00100000:0.0:1746065157.945375:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.945382:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263714048 00000100:00100000:0.0:1746065157.945388:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.945445:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.945483:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263714304 00000100:00100000:0.0:1746065157.945486:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263714304 00000100:00100000:0.0:1746065157.945516:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263714560 00000100:00100000:0.0:1746065157.945518:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263714560 00000100:00100000:0.0:1746065157.945530:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263714176 00000100:00100000:3.0:1746065157.945547:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263714432 00000100:00100000:3.0:1746065157.945550:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263714432 00000100:00100000:3.0:1746065157.945562:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263714688 00000100:00100000:3.0:1746065157.945563:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263714688 00000100:00100000:2.0:1746065157.945572:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13665 00000100:00100000:3.0:1746065157.945579:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13666 00000100:00100000:2.0:1746065157.945581:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263714304:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:3.0:1746065157.945585:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263714560:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065157.945594:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.945594:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.945608:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934312 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065157.945608:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934304 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065157.945626:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d705, atime: 0x6812d705, ctime: 0x6812d705, blocks: 0x1650 00002000:00010000:2.0:1746065157.945626:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d704, atime: 0x6812d704, ctime: 0x6812d704, blocks: 0x800 00010000:00010000:3.0:1746065157.945638:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.945638:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.945639:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.945640:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.945646:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.945646:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.945658:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.945658:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.945666:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00010000:00010000:2.0:1746065157.945666:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8c00, rc 0) 00000100:00100000:2.0:1746065157.945699:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263714304:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 120us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.945701:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263714560:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.945704:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13665 00000100:00100000:3.0:1746065157.945707:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13666 00000100:00100000:2.0:1746065157.945717:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13667 00000100:00100000:3.0:1746065157.945720:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13668 00000100:00100000:2.0:1746065157.945721:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263714048:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:3.0:1746065157.945725:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263714432:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065157.945726:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065157.945731:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.945732:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1470776 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342f6 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065157.945739:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93430b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065157.945740:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d706, atime: 0x6812d706, ctime: 0x6812d706, blocks: 0x7f8 00010000:00010000:2.0:1746065157.945745:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.945746:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746065157.945747:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d705, atime: 0x6812d703, ctime: 0x6812d705, blocks: 0x808 00010000:00010000:2.0:1746065157.945749:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1470776 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342f6 expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.945755:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065157.945756:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.945757:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1470776 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342f6 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.945760:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.945762:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00010000:00010000:3.0:1746065157.945768:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065157.945795:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f877000, rc 0) 00000100:00100000:2.0:1746065157.945796:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263714048:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 75us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.945804:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13667 00000100:00100000:3.0:1746065157.945810:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263714432:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 85us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.945812:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13669 00000100:00100000:3.0:1746065157.945815:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13668 00000100:00100000:2.0:1746065157.945816:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263714688:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065157.945821:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065157.945827:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1470784 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934319 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065157.945835:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d705, atime: 0x6812d705, ctime: 0x6812d705, blocks: 0x1000 00010000:00010000:2.0:1746065157.945840:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.945841:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065157.945844:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1470784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934319 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.945851:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1470784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934319 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065157.945856:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ac00, rc 0) 00000100:00100000:2.0:1746065157.945878:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263714688:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 52us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.945883:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13669 00000100:00100000:0.0:1746065157.946551:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263714176 00000100:00100000:0.0:1746065157.946572:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13670 00000100:00100000:0.0:1746065157.946577:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263714176:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065157.946583:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065157.946591:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147078b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9342fd expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065157.946606:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d705, atime: 0x6812d705, ctime: 0x6812d705, blocks: 0x808 00010000:00010000:0.0:1746065157.946616:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.946617:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065157.946622:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147078b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342fd expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.946630:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147078b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342fd expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065157.946637:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166e00, rc 0) 00000100:00100000:0.0:1746065157.946654:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2005:x1830881263714176:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 77us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.946658:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13670 00000100:00100000:0.0:1746065157.988770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.988846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.988892:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.988901:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263715072 00000100:00100000:3.0:1746065157.988909:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263715072 00000100:00100000:0.0:1746065157.988912:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.988930:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.988944:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263715328 00000100:00100000:0.0:1746065157.988947:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263715328 00000100:00100000:3.0:1746065157.988950:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263715584 00000100:00100000:3.0:1746065157.988952:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263715584 00000100:00100000:3.0:1746065157.988965:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1026 00000100:00100000:0.0:1746065157.988966:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263715840 00000100:00100000:0.0:1746065157.988968:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263715840 00000100:00100000:3.0:1746065157.988972:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:2005:x1830881263715072:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065157.988978:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 641 00000100:00100000:0.0:1746065157.988982:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263715328:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1746065157.989018:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263714816 00000100:00100000:2.0:1746065157.989022:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263714816 00000100:00100000:2.0:1746065157.989048:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 190 00000100:00100000:1.0:1746065157.989049:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 642 00000100:00100000:2.0:1746065157.989053:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800902f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881263714816:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065157.989057:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263715840:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065157.989090:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881263715328:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 105us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.989096:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 641 00000100:00100000:3.0:1746065157.989127:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+294:2005:x1830881263715072:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 155us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.989127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065157.989132:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1026 00000100:00100000:0.0:1746065157.989140:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263714944 00000100:00100000:0.0:1746065157.989142:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263714944 00000100:00100000:3.0:1746065157.989143:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1027 00000100:00100000:1.0:1746065157.989916:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+25:2005:x1830881263715840:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 858us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.989922:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 642 00000100:00080000:1.0:1746065157.989937:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746065157.990005:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263715584:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065157.990016:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1028 00000100:00100000:0.0:1746065157.990022:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263714944:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065157.990027:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263715584:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 25us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065157.990032:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1027 00000100:00100000:0.0:1746065157.990047:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263714944:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 26us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.990052:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1028 00000100:00100000:2.0:1746065157.990102:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800902f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881263714816:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 1045us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.990108:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 190 00000100:00100000:1.0:1746065157.990405:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.990419:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263715200 00000100:00100000:1.0:1746065157.990421:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263715200 00000100:00100000:1.0:1746065157.990441:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 643 00000100:00100000:1.0:1746065157.990445:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+18:2005:x1830881263715200:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065157.990464:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+18:2005:x1830881263715200:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 19us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065157.990468:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 643 00000100:00100000:1.0:1746065157.990493:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065157.990830:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.990849:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263715456 00000100:00100000:0.0:1746065157.990852:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263715456 00000100:00100000:0.0:1746065157.990884:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1029 00000100:00100000:0.0:1746065157.990889:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263715456:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065157.990917:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263715456:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.990922:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1029 00000100:00100000:1.0:1746065157.991986:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065157.992689:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263715968 00000100:00100000:0.0:1746065157.992693:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263715968 00000100:00100000:2.0:1746065157.992833:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263715712 00000100:00100000:2.0:1746065157.992837:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263715712 00000100:00100000:0.0:1746065157.993236:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1030 00000100:00100000:0.0:1746065157.993242:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881263715968:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065157.993288:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2005:x1830881263715968:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 47us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065157.993294:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1030 00000100:00080000:1.0:1746065157.993599:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065157.993664:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 644 00000100:00100000:2.0:1746065157.993671:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263715712:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1746065157.993709:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+5:2005:x1830881263715712:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 39us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065157.993714:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 644 00010000:00010000:3.0:1746065158.930080:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065158.955627:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065158.955669:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065158.955691:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065158.955704:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065158.955717:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065158.955751:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263716224 00000100:00100000:0.0:1746065158.955756:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065158.955759:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263716224 00000100:00100000:0.0:1746065158.955793:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263716480 00000100:00100000:0.0:1746065158.955796:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263716480 00000100:00100000:2.0:1746065158.955812:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263716736 00000100:00100000:2.0:1746065158.955814:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263716736 00000100:00100000:0.0:1746065158.955814:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263716096 00000100:00100000:0.0:1746065158.955816:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263716096 00000100:00100000:2.0:1746065158.955828:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13671 00000100:00100000:0.0:1746065158.955828:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263716352 00000100:00100000:0.0:1746065158.955829:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263716352 00000100:00100000:2.0:1746065158.955834:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263716224:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065158.955839:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263716608 00000100:00100000:0.0:1746065158.955840:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263716608 00000100:00100000:0.0:1746065158.955848:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13672 00000100:00100000:0.0:1746065158.955853:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263716480:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065158.955938:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263716480:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065158.955944:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13672 00000100:00100000:0.0:1746065158.955957:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13673 00000100:00100000:0.0:1746065158.955961:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263716736:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065158.957337:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13674 00000100:00100000:1.0:1746065158.957349:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263716096:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:3.0:1746065158.957434:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13675 00000100:00100000:3.0:1746065158.957442:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263716352:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065158.957565:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2004:x1830881263716224:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 1729us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.957572:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13671 00000100:00100000:2.0:1746065158.957587:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13676 00000100:00100000:2.0:1746065158.957592:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263716608:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065158.957626:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2004:x1830881263716608:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 34us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.957631:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13676 00000100:00100000:0.0:1746065158.957761:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263716736:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 1797us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065158.957767:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13673 00000100:00100000:1.0:1746065158.957898:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263716096:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 551us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065158.957904:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13674 00000100:00100000:3.0:1746065158.957978:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263716352:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 537us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065158.957982:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13675 00000100:00100000:2.0:1746065158.965647:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065158.965684:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065158.965708:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263716992 00000100:00100000:2.0:1746065158.965713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065158.965716:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263716992 00000100:00100000:2.0:1746065158.965728:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065158.965740:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065158.965841:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263717248 00000100:00100000:3.0:1746065158.965844:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263717248 00000100:00100000:2.0:1746065158.965852:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065158.965882:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263717504 00000100:00100000:2.0:1746065158.965886:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263716864 00000100:00100000:1.0:1746065158.965886:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263717504 00000100:00100000:2.0:1746065158.965890:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263716864 00000100:00100000:1.0:1746065158.965903:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263717120 00000100:00100000:1.0:1746065158.965905:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263717120 00000100:00100000:2.0:1746065158.965907:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263717376 00000100:00100000:2.0:1746065158.965909:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263717376 00000100:00100000:1.0:1746065158.965920:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13677 00000100:00100000:2.0:1746065158.965927:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13678 00000100:00100000:1.0:1746065158.965927:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263716992:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065158.965932:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263717248:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:3.0:1746065158.966014:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13679 00000100:00100000:2.0:1746065158.966014:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263717248:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 81us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065158.966020:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263717504:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065158.966020:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13678 00000100:00100000:2.0:1746065158.966034:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13680 00000100:00100000:2.0:1746065158.966039:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263716864:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065158.966069:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+16:2006:x1830881263716992:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 143us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065158.966075:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13677 00000100:00100000:2.0:1746065158.966076:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263716864:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 36us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.966081:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13680 00000100:00100000:1.0:1746065158.966085:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13681 00000100:00100000:1.0:1746065158.966089:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263717120:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065158.966092:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13682 00000100:00100000:2.0:1746065158.966097:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263717376:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065158.966120:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2006:x1830881263717120:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065158.966126:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263717376:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065158.966126:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13681 00000100:00100000:2.0:1746065158.966131:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13682 00000100:00100000:3.0:1746065158.966282:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2006:x1830881263717504:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 257us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065158.966288:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13679 00000100:00100000:0.0:1746065158.974043:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065158.974188:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263717632 00000100:00100000:3.0:1746065158.974195:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263717632 00000100:00100000:3.0:1746065158.974232:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13683 00000100:00100000:3.0:1746065158.974240:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+14:2004:x1830881263717632:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:3.0:1746065158.974403:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065158.974405:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065158.974408:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065158.974409:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065158.974411:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065158.974448:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2004:x1830881263717632:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 209us (414us total) trans 17179873535 rc 0/0 00000100:00100000:3.0:1746065158.974455:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13683 00000100:00100000:1.0:1746065158.981742:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065158.981817:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263717760 00000100:00100000:0.0:1746065158.981825:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263717760 00000100:00100000:0.0:1746065158.981878:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13684 00000100:00100000:0.0:1746065158.981885:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2006:x1830881263717760:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:0.0:1746065158.982036:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065158.982039:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065158.982041:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065158.982044:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:0.0:1746065158.982045:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:0.0:1746065158.982083:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2006:x1830881263717760:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 198us (349us total) trans 21474840993 rc 0/0 00000100:00100000:0.0:1746065158.982089:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13684 00000001:00080000:2.0:1746065158.986578:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873535 is committed 00000001:00080000:2.0:1746065158.986589:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873534 is committed 00000001:00080000:2.0:1746065158.986607:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873526 is committed 00000001:00080000:2.0:1746065158.986618:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873523 is committed 00000100:00100000:0.0:1746065158.996514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065158.996552:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065158.996619:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263718144 00000100:00100000:2.0:1746065158.996627:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263718144 00000100:00100000:2.0:1746065158.996665:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263718272 00000100:00100000:2.0:1746065158.996666:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263718272 00000100:00100000:2.0:1746065158.996688:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3968 00000100:00100000:2.0:1746065158.996694:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263718144:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:2.0:1746065158.996722:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.996734:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.996736:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065158.996740:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065158.996753:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065158.997398:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3969 00000100:00100000:0.0:1746065158.997407:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263718272:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065158.997425:0:29489:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.997432:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.997434:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065158.997450:0:29489:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065158.997459:0:29489:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.015698:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.016763:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263718784 00000100:00100000:3.0:1746065159.016787:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263718784 00000100:00100000:3.0:1746065159.016847:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3970 00000100:00100000:3.0:1746065159.016853:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263718784:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065159.016892:0:9553:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746065159.016896:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746065159.016904:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.016906:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.016910:0:9553:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.016922:0:9553:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.021542:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.022274:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.024114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.024148:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263719040 00000100:00100000:1.0:1746065159.024157:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263719040 00000100:00100000:1.0:1746065159.024240:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3971 00000100:00100000:1.0:1746065159.024248:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263719040:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065159.024281:0:20324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.024292:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.024294:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.024299:0:20324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.024310:0:20324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746065159.025578:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065159.025697:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263719168 00000100:00100000:1.0:1746065159.025704:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263719168 00000100:00100000:1.0:1746065159.025735:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3972 00000100:00100000:1.0:1746065159.025740:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263719168:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065159.025758:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.025767:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.025769:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.025786:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.025795:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.028627:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263718656 00000100:00100000:0.0:1746065159.028641:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263718656 00000100:00100000:0.0:1746065159.029059:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3973 00000100:00100000:0.0:1746065159.029066:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263718656:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065159.029094:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.029111:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.029113:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.029117:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.029127:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.039253:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.039268:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.039276:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.039282:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065159.039286:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.039293:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.039307:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.039312:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1470792 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.039378:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263718144:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 42680us (42866us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.039386:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3968 00010000:00010000:2.0:1746065159.054045:0:29489:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.054061:0:29489:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.054068:0:29489:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.054075:0:29489:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a852a200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065159.054079:0:29489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.054085:0:29489:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.054101:0:29489:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.054106:0:29489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470799 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.055395:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8adb6cf4-807a-4620-a3cb-7b9d021f2493+17:2005:x1830881263718272:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 57979us (58831us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746065159.055405:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3969 00010000:00010000:1.0:1746065159.064765:0:20324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.064803:0:20324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.064811:0:20324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.064817:0:20324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065159.064820:0:20324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.064828:0:20324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.064842:0:20324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.064847:0:20324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc14707a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.064947:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2005:x1830881263719040:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 40694us (42667us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.064958:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3971 00010000:00010000:2.0:1746065159.080095:0:9555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.080113:0:9555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.080122:0:9555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.080130:0:9555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065159.080135:0:9555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.080146:0:9555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.080166:0:9555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.080172:0:9555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14707b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065159.082957:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+15:2005:x1830881263718656:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 53883us (61416us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.082970:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3973 00010000:00010000:1.0:1746065159.083127:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.083139:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.083146:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.083152:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065159.083155:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.083161:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.083176:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.083182:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc14707ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.083218:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263719168:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 57476us (59108us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065159.083224:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3972 00010000:00010000:3.0:1746065159.087845:0:9553:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.087872:0:9553:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.087879:0:9553:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.087886:0:9553:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065159.087890:0:9553:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.087898:0:9553:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.087914:0:9553:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.087921:0:9553:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc14707a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.088017:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263718784:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 71159us (72322us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065159.088027:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3970 00000100:00100000:0.0:1746065159.097929:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.098477:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263719424 00000100:00100000:2.0:1746065159.098487:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263719424 00000100:00100000:2.0:1746065159.098562:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 733 00000100:00100000:2.0:1746065159.098570:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32476:x1830881263719424:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:2.0:1746065159.098583:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065159.098604:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc147070d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342da expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.098632:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065159.098636:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065159.098674:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32476:x1830881263719424:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 105us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.098680:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 733 00000100:00080000:1.0:1746065159.098901:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065159.106389:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.106532:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263719680 00000100:00100000:2.0:1746065159.106543:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263719680 00000100:00100000:2.0:1746065159.107584:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4974 00000100:00100000:2.0:1746065159.107593:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:32476:x1830881263719680:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065159.107783:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32476:x1830881263719680:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 179us (1392us total) trans 8589936080 rc 0/0 00000100:00100000:2.0:1746065159.107789:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4974 00000100:00100000:0.0:1746065159.111035:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.111257:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263719936 00000100:00100000:1.0:1746065159.111264:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263719936 00000100:00100000:2.0:1746065159.111814:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4975 00000100:00100000:2.0:1746065159.111827:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:32476:x1830881263719936:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065159.112853:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:32476:x1830881263719936:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 1029us (1823us total) trans 8589936081 rc 0/0 00000100:00100000:2.0:1746065159.112872:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4975 00000100:00100000:0.0:1746065159.136375:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.136837:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263720192 00000100:00100000:3.0:1746065159.136844:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263720192 00000100:00100000:3.0:1746065159.137279:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13732 00000100:00100000:3.0:1746065159.137286:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+7:32486:x1830881263720192:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065159.137304:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.137321:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488e00/0xad6b7ddc14707bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934320 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.137380:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137390:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137399:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137412:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137416:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137420:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137500:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137507:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137512:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065159.137518:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:3.0:1746065159.137575:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137580:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137585:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137589:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065159.137592:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137597:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137606:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065159.137608:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065159.137612:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137616:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14707c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137629:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137633:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137637:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137640:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065159.137642:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137645:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137650:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e3d9600) 00010000:00010000:3.0:1746065159.137652:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065159.137654:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137657:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14707ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065159.137685:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488e00/0xad6b7ddc14707bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.137695:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.137699:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065159.137701:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065159.137703:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:3.0:1746065159.137750:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ccc4a269-0136-4970-860c-c944630694a4+9:32486:x1830881263720192:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 465us (1382us total) trans 8589936082 rc 0/0 00000100:00100000:3.0:1746065159.137755:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13732 00000100:00080000:1.0:1746065159.138351:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065159.138980:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.139240:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263720448 00000100:00100000:2.0:1746065159.139246:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263720448 00000100:00100000:2.0:1746065159.139294:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13733 00000100:00100000:2.0:1746065159.139300:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+27:32489:x1830881263720448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065159.139311:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.139320:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091bafe00/0xad6b7ddc14707df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934327 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.139361:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139370:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139376:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139389:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139393:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139398:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139455:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139462:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139467:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065159.139472:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065159.139510:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139514:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139519:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139523:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139527:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065159.139529:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139537:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139544:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065159.139546:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065159.139548:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.139553:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc14707e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00000100:00080000:1.0:1746065159.139620:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065159.140457:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.140466:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.140471:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.140474:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065159.140476:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.140481:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.140489:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090dc5300) 00010000:00010000:2.0:1746065159.140491:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065159.140493:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.140497:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc14707ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.140533:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091bafe00/0xad6b7ddc14707df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.140542:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.140548:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065159.140549:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065159.140551:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67600, rc 0) 00000100:00100000:2.0:1746065159.140589:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32489:x1830881263720448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1289us (1610us total) trans 8589936083 rc 0/0 00000100:00100000:2.0:1746065159.140595:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13733 00000100:00100000:1.0:1746065159.146554:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.146627:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263720960 00000100:00100000:3.0:1746065159.146635:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263720960 00000100:00100000:3.0:1746065159.146678:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4976 00000100:00100000:3.0:1746065159.146686:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+29:32489:x1830881263720960:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065159.146846:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.146876:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263720704 00000100:00100000:2.0:1746065159.146880:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263720704 00000100:00100000:3.0:1746065159.146892:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+30:32489:x1830881263720960:12345-192.168.202.27@tcp:35:cat.0 Request processed in 206us (344us total) trans 8589936084 rc 0/0 00000100:00100000:3.0:1746065159.146899:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4976 00000100:00100000:2.0:1746065159.146904:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13734 00000100:00100000:2.0:1746065159.146909:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+9:32490:x1830881263720704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065159.146921:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.146938:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1470802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93432e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.146998:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.147010:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.147019:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065159.147028:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065159.147072:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1470802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 12 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.147253:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 11 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.147260:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065159.147262:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065159.147264:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67200, rc 0) 00000100:00100000:2.0:1746065159.147337:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+11:32490:x1830881263720704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 428us (493us total) trans 8589936085 rc 0/0 00000100:00100000:2.0:1746065159.147343:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13734 00000100:00100000:2.0:1746065159.153064:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.153149:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.153228:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.153361:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.153436:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263721088 00000100:00100000:3.0:1746065159.153444:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263721088 00000100:00100000:3.0:1746065159.153486:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263721216 00000100:00100000:3.0:1746065159.153489:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263721216 00000100:00100000:3.0:1746065159.153499:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263721344 00000100:00100000:3.0:1746065159.153501:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263721344 00000100:00100000:3.0:1746065159.153515:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13685 00000100:00100000:3.0:1746065159.153521:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+5:2007:x1830881263721088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.153537:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.153552:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1470817 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934335 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.153573:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.153574:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.153581:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1470817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934335 expref: 6 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.153594:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1470817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934335 expref: 6 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.153602:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:3.0:1746065159.153636:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ccc4a269-0136-4970-860c-c944630694a4+6:2007:x1830881263721088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 115us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.153640:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13685 00000100:00100000:3.0:1746065159.153652:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13686 00000100:00100000:3.0:1746065159.153657:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+18:2004:x1830881263721216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.153662:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.153667:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93433c expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.153676:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.153678:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.153681:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.153689:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.153700:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:3.0:1746065159.153714:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+19:2004:x1830881263721216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.153718:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13686 00000100:00100000:3.0:1746065159.153727:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13687 00000100:00100000:3.0:1746065159.153731:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263721344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.153737:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.153744:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934343 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.153755:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.153756:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.153759:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 25 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.153768:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 25 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.153794:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488800, rc 0) 00000100:00100000:3.0:1746065159.153807:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263721344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 76us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.153812:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13687 00000100:00100000:2.0:1746065159.154015:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263721472 00000100:00100000:2.0:1746065159.154019:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263721472 00000100:00100000:2.0:1746065159.154036:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13688 00000100:00100000:2.0:1746065159.154040:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263721472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065159.154046:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.154052:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93434a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.154062:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.154063:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.154068:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 26 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.154076:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 26 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.154083:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66600, rc 0) 00000100:00100000:2.0:1746065159.154098:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263721472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 57us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.154102:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13688 00000100:00080000:2.0:1746065159.154123:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065159.154126:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065159.154507:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.154788:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.154816:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.154999:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.155098:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263722240 00000100:00100000:0.0:1746065159.155102:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263722240 00000100:00100000:0.0:1746065159.155128:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13735 00000100:00100000:0.0:1746065159.155134:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32485:x1830881263722240:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065159.155146:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.155157:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc1470833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93436d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.155233:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065159.155244:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.155254:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.155259:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 31 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.155264:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 6/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065159.155344:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263721600 00000100:00100000:3.0:1746065159.155347:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263721600 00000100:00100000:3.0:1746065159.155364:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263721728 00000100:00100000:3.0:1746065159.155367:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263721728 00000100:00100000:3.0:1746065159.155376:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263721856 00000100:00100000:3.0:1746065159.155378:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263721856 00000100:00100000:3.0:1746065159.155390:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13689 00000100:00100000:3.0:1746065159.155395:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881263721600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.155401:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.155409:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934351 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.155420:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.155421:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.155426:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 21 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.155435:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 21 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.155441:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852a200, rc 0) 00000100:00100000:1.0:1746065159.155466:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13690 00000100:00100000:1.0:1746065159.155474:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263721728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065159.155485:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.155491:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934358 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.155501:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.155502:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.155506:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.155514:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.155520:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac000, rc 0) 00000100:00100000:1.0:1746065159.155546:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263721728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 73us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.155550:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13690 00000100:00100000:1.0:1746065159.155563:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13691 00000100:00100000:1.0:1746065159.155567:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263721856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065159.155574:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.155581:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93435f expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.155594:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.155595:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.155598:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.155605:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.155611:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00000100:00100000:1.0:1746065159.155625:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263721856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 58us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.155629:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13691 00000100:00100000:3.0:1746065159.156380:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263721600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 983us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.156385:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13689 00010000:00010000:0.0:1746065159.156751:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 31 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.156766:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 31 pid: 7204 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065159.156793:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263411840:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065159.156850:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.156889:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 10 pid: 13395 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065159.156897:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263411968:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065159.156923:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.156929:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 9 pid: 13395 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065159.156936:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263412096:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065159.156951:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065159.157225:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.157252:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.157272:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.157294:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.157308:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263722112 00000100:00100000:1.0:1746065159.157313:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263722112 00000100:00100000:1.0:1746065159.157340:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263722368 00000100:00100000:1.0:1746065159.157342:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263722368 00000100:00100000:1.0:1746065159.157349:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263722624 00000100:00100000:1.0:1746065159.157350:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263722624 00000100:00100000:1.0:1746065159.157358:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263722496 00000100:00100000:1.0:1746065159.157360:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263722496 00000100:00100000:1.0:1746065159.157370:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13692 00000100:00100000:1.0:1746065159.157375:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+6:2007:x1830881263722112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065159.157383:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.157392:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc1470856 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934366 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.157406:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.157407:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065159.157495:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13693 00000100:00100000:3.0:1746065159.157501:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263722368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.157507:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.157514:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934374 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.157524:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.157525:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.157529:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.157539:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.157546:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852aa00, rc 0) 00000100:00100000:3.0:1746065159.157562:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263722368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 61us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.157567:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13693 00000100:00100000:3.0:1746065159.157580:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13694 00000100:00100000:3.0:1746065159.157584:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263722624:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.157590:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.157597:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934382 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.157606:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.157607:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.157611:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.157620:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.157625:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6e400, rc 0) 00000100:00100000:3.0:1746065159.157639:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263722624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.157645:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13694 00000100:00100000:3.0:1746065159.157654:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13695 00000100:00100000:3.0:1746065159.157658:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263722496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.157663:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.157669:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93437b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.157678:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.157680:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.157683:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.157691:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065159.157697:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:3.0:1746065159.157710:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263722496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 52us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.157714:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13695 00010000:00010000:1.0:1746065159.158384:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc1470856 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934366 expref: 7 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.158395:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc1470856 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934366 expref: 7 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.158402:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abadc00, rc 0) 00000100:00100000:1.0:1746065159.158418:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ccc4a269-0136-4970-860c-c944630694a4+7:2007:x1830881263722112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1043us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.158423:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13692 00000100:00080000:3.0:1746065159.159071:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065159.159212:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.159272:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263722752 00000100:00100000:0.0:1746065159.159277:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263722752 00000100:00100000:0.0:1746065159.159307:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13696 00000100:00100000:0.0:1746065159.159314:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263722752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065159.159324:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.159336:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc1470872 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934389 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.159350:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.159351:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.159357:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc1470872 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934389 expref: 8 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.159365:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc1470872 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934389 expref: 8 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.159371:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:0.0:1746065159.159665:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263722752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 350us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.159670:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13696 00000100:00100000:0.0:1746065159.173013:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.173039:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.173063:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.173089:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.173120:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263722880 00000100:00100000:0.0:1746065159.173127:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263722880 00010000:00010000:0.0:1746065159.173159:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 32 pid: 7204 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065159.173180:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263723008 00000100:00100000:0.0:1746065159.173181:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263723008 00010000:00010000:0.0:1746065159.173188:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 11 pid: 13395 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065159.173198:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263723136 00000100:00100000:0.0:1746065159.173199:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263723136 00010000:00010000:0.0:1746065159.173205:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 10 pid: 13395 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065159.173217:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6217 00000100:00100000:0.0:1746065159.173224:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263722880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065159.173237:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065159.173243:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 32 pid: 7204 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065159.173251:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 32 pid: 7204 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065159.173270:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065159.173274:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065159.173280:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00000100:00100000:1.0:1746065159.173332:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6218 00000100:00100000:1.0:1746065159.173340:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263723008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065159.173347:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065159.173351:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 11 pid: 13395 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746065159.173408:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6219 00000100:00100000:3.0:1746065159.173415:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2004:x1830881263723136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.173421:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.173425:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 10 pid: 13395 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.173491:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc14707f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934327 expref: 32 pid: 7204 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746065159.173509:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263411840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.173517:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263411968:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.173524:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263412096:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065159.174230:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065159.174257:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 11 pid: 13395 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.174270:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14707d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934320 expref: 11 pid: 13395 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065159.174287:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263722880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1059us (1283us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065159.174289:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065159.174293:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00000100:00100000:0.0:1746065159.174295:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6217 00010000:00010000:1.0:1746065159.174299:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065159.174303:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065159.174322:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263723008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 984us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.174328:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6218 00000100:00100000:0.0:1746065159.174734:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263723264 00000100:00100000:0.0:1746065159.174739:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263723264 00010000:00010000:3.0:1746065159.174761:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 10 pid: 13395 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746065159.174796:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1470761 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342ef expref: 10 pid: 13395 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746065159.174808:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065159.174811:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065159.174821:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065159.174826:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065159.174837:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.174869:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2004:x1830881263723136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1454us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.174874:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6219 00000100:00100000:0.0:1746065159.175007:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13736 00000100:00100000:0.0:1746065159.175016:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+31:32489:x1830881263723264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065159.175034:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.175049:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc1470879 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934390 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.175104:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc1470879 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934390 expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.175116:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc1470879 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934390 expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.175135:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:0.0:1746065159.175138:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065159.175141:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47e00, rc 0) 00000100:00100000:0.0:1746065159.175175:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+32:32489:x1830881263723264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 159us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.175181:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13736 00010000:00010000:2.0:1746065159.175463:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.175472:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.175479:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065159.175494:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065159.175594:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718200/0xad6b7ddc1470833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 33 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.175605:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 32 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.175610:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065159.175612:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065159.175614:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719c00, rc 0) 00000100:00100000:2.0:1746065159.176456:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+32:32485:x1830881263722240:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 21319us (21946us total) trans 8589936086 rc 0/0 00000100:00100000:2.0:1746065159.176462:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13735 00000100:00100000:0.0:1746065159.192426:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.192594:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.193141:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.193558:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.193628:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263723520 00000100:00100000:3.0:1746065159.193638:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263723520 00002000:00100000:3.0:1746065159.193685:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009077f800 x1830881263723520/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.193695:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881263723520 ext(0->1048575) 00002000:00010000:3.0:1746065159.193701:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f800 00000100:00100000:1.0:1746065159.193757:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263723776 00000100:00100000:1.0:1746065159.193763:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263723776 00002000:00100000:1.0:1746065159.193811:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009077d880 x1830881263723776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.193818:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881263723776 ext(0->1048575) 00002000:00010000:1.0:1746065159.193822:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077d880 00000100:00100000:1.0:1746065159.193840:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263724032 00000100:00100000:1.0:1746065159.193844:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263724032 00002000:00100000:1.0:1746065159.193872:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009077dc00 x1830881263724032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.193878:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881263724032 ext(1048576->2097151) 00002000:00010000:1.0:1746065159.193881:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:1.0:1746065159.193903:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3974 00000100:00100000:1.0:1746065159.193912:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263723520:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065159.194316:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263724416 00000100:00100000:0.0:1746065159.194319:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263724416 00002000:00100000:0.0:1746065159.196364:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009577ea00 x1830881263724416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.196373:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ea00 with x1830881263724416 ext(1048576->2097151) 00002000:00010000:0.0:1746065159.196378:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577ea00 00000100:00100000:0.0:1746065159.196403:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3975 00000100:00100000:0.0:1746065159.196410:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263723776:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065159.196509:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3976 00000100:00100000:1.0:1746065159.196517:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263724032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065159.196905:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3977 00000100:00100000:3.0:1746065159.196913:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263724416:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065159.198184:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.198202:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.198219:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.198235:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.199077:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263724544 00000100:00100000:3.0:1746065159.199083:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263724800 00000100:00100000:3.0:1746065159.199086:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263724800 00000100:00100000:2.0:1746065159.199086:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263724544 00000100:00100000:0.0:1746065159.199102:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263724928 00000100:00100000:0.0:1746065159.199106:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263724928 00002000:00100000:3.0:1746065159.199114:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009577f480 x1830881263724800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.199114:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009577c700 x1830881263724544/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.199122:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009577c000 x1830881263724928/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.199123:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f480 with x1830881263724800 ext(1048576->2097151) 00002000:00100000:2.0:1746065159.199123:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c700 with x1830881263724544 ext(1048576->2097151) 00002000:00010000:3.0:1746065159.199128:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577f480 00002000:00010000:2.0:1746065159.199128:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577c700 00002000:00100000:0.0:1746065159.199129:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c000 with x1830881263724928 ext(1048576->2097151) 00002000:00010000:0.0:1746065159.199132:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577c000 00000100:00100000:2.0:1746065159.199151:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263725312 00000100:00100000:2.0:1746065159.199154:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263725312 00000100:00100000:3.0:1746065159.199156:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3978 00000100:00100000:3.0:1746065159.199163:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263724800:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:2.0:1746065159.199163:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009577dc00 x1830881263725312/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.199169:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577dc00 with x1830881263725312 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.199172:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577dc00 00000100:00100000:3.0:1746065159.200270:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3979 00000100:00100000:3.0:1746065159.200278:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263724544:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065159.200457:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3980 00000100:00100000:1.0:1746065159.200467:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263724928:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065159.201018:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3981 00000100:00100000:2.0:1746065159.201026:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263725312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065159.211196:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.211575:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263725568 00000100:00100000:2.0:1746065159.211583:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263725568 00000100:00100000:2.0:1746065159.211634:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13737 00000100:00100000:2.0:1746065159.211642:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+32:32485:x1830881263725568:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065159.211662:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.211664:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065159.211686:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc1470879 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934390 expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.211713:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065159.211717:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065159.211726:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e400/0xad6b7ddc1470887 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934397 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.211765:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.211800:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.211806:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.211812:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 5/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065159.211887:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.211899:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 9 pid: 7204 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746065159.211909:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263412224:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065159.212007:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.212015:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 8 pid: 13395 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746065159.212022:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263412352:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065159.212044:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7b2d300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065159.214740:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263723520:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20822us (22313us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.214750:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3974 00002000:00100000:1.0:1746065159.214761:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009077f800 x1830881263723520/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.214769:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881263723520 ext(0->1048575) 00002000:00010000:1.0:1746065159.214815:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077f800 00000100:00100000:2.0:1746065159.221362:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.221375:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263412224:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065159.221385:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263412352:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.221396:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263725824 00000100:00100000:2.0:1746065159.221401:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263725824 00010000:00010000:3.0:1746065159.221409:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.221427:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 9 pid: 13395 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746065159.221447:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6220 00000100:00100000:2.0:1746065159.221453:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2007:x1830881263725824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065159.221464:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065159.221468:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 9 pid: 13395 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.221477:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 9 pid: 13395 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.221499:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1470753 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342e8 expref: 9 pid: 13395 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.221521:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065159.221526:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.221533:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.221537:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065159.221576:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263724032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25059us (28436us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.221584:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3976 00002000:00100000:1.0:1746065159.221592:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009077dc00 x1830881263724032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.221600:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881263724032 ext(1048576->2097151) 00002000:00010000:1.0:1746065159.221604:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:2.0:1746065159.221673:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2007:x1830881263725824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 219us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.221681:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6220 00000100:00100000:2.0:1746065159.225848:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.225887:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263725696 00000100:00100000:2.0:1746065159.225894:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263725696 00010000:00010000:2.0:1746065159.225930:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 10 pid: 7204 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746065159.226115:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6221 00000100:00100000:2.0:1746065159.226123:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263725696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065159.226136:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065159.226141:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 10 pid: 7204 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.226152:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 10 pid: 7204 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.226170:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1470809 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93432e expref: 10 pid: 7204 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.226182:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065159.226186:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.226193:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.226199:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.226223:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065159.226267:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+9:2007:x1830881263725696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 145us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.226273:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6221 00010000:00010000:3.0:1746065159.226599:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065159.226608:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000040:00080000:3.0:1746065159.226852:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].613, 88 off62008 00000004:00080000:3.0:1746065159.226873:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245098590ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.226898:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].549, 88 off56368 00000004:00080000:3.0:1746065159.226902:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755245128478ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065159.226928:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].550, 88 off56456 00000004:00080000:3.0:1746065159.226930:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755245156838ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065159.226938:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].614, 88 off62096 00000004:00080000:3.0:1746065159.226940:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245166688ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.226947:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].615, 88 off62184 00000004:00080000:3.0:1746065159.226949:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245175436ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.226956:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].551, 88 off56544 00000004:00080000:3.0:1746065159.226958:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755245184723ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065159.226965:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].552, 88 off56632 00000004:00080000:3.0:1746065159.226967:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755245193398ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065159.226973:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].553, 88 off56720 00000004:00080000:3.0:1746065159.226975:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755245201737ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065159.226982:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].616, 88 off62272 00000004:00080000:3.0:1746065159.226985:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245211128ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.226991:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].554, 88 off56808 00000004:00080000:3.0:1746065159.226994:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755245220400ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065159.227001:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].617, 88 off62360 00000004:00080000:3.0:1746065159.227003:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245229580ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.227010:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].555, 88 off56896 00000004:00080000:3.0:1746065159.227012:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755245238167ns, next at 615601404258ns, rc = 0 00000040:00080000:3.0:1746065159.227018:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].618, 88 off62448 00000004:00080000:3.0:1746065159.227020:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245247018ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.227028:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].619, 88 off62536 00000004:00080000:3.0:1746065159.227030:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245256767ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.227037:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].620, 88 off62624 00000004:00080000:3.0:1746065159.227039:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245265268ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.227046:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].621, 88 off62712 00000004:00080000:3.0:1746065159.227048:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 755245274457ns, next at 615601378837ns, rc = 0 00000040:00080000:3.0:1746065159.227055:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].556, 88 off56984 00000004:00080000:3.0:1746065159.227057:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755245283173ns, next at 615601404258ns, rc = 0 00000100:00100000:1.0:1746065159.236820:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.236874:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263723776:12345-192.168.202.27@tcp:3:cat.0 Request processed in 40448us (44266us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065159.236885:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3975 00002000:00100000:0.0:1746065159.236895:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8a:0x0] (0->1048575) req@ffff88009077d880 x1830881263723776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.236910:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881263723776 ext(0->1048575) 00002000:00010000:0.0:1746065159.236915:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077d880 00000100:00100000:2.0:1746065159.237615:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263724416:12345-192.168.202.27@tcp:3:cat.0 Request processed in 40702us (44059us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.237623:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3977 00002000:00100000:2.0:1746065159.237628:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009577ea00 x1830881263724416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.237636:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ea00 with x1830881263724416 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.237639:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577ea00 00000100:00100000:2.0:1746065159.238224:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263725952 00000100:00100000:2.0:1746065159.238231:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263725952 00000100:00100000:2.0:1746065159.238270:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13738 00000100:00100000:2.0:1746065159.238276:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+9:32490:x1830881263725952:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065159.238293:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.238314:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93439e expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.238359:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.238367:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93439e expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.238380:0:9571:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065159.238391:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93439e expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.238402:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065159.238405:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065159.238408:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93439e expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.238414:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3a00, rc 0) 00000100:00100000:2.0:1746065159.238441:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ccc4a269-0136-4970-860c-c944630694a4+10:32490:x1830881263725952:12345-192.168.202.27@tcp:101:cat.0 Request processed in 165us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.238446:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13738 00000001:00080000:2.0:1746065159.238481:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936087 is committed 00000004:00080000:2.0:1746065159.238485:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 550 committed 00000004:00080000:2.0:1746065159.238497:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 613 committed 00000004:00080000:2.0:1746065159.238502:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 612 committed 00000004:00080000:2.0:1746065159.238504:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 611 committed 00000004:00080000:2.0:1746065159.238505:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 610 committed 00000004:00080000:2.0:1746065159.238507:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 549 committed 00000004:00080000:2.0:1746065159.238508:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 609 committed 00000004:00080000:2.0:1746065159.238510:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 548 committed 00000004:00080000:2.0:1746065159.238511:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 608 committed 00000004:00080000:2.0:1746065159.238512:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 547 committed 00000004:00080000:2.0:1746065159.238514:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 546 committed 00000004:00080000:2.0:1746065159.238515:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 545 committed 00000004:00080000:2.0:1746065159.238516:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 607 committed 00000004:00080000:2.0:1746065159.238517:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 606 committed 00000004:00080000:2.0:1746065159.238519:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 544 committed 00000004:00080000:2.0:1746065159.238521:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 543 committed 00000004:00080000:2.0:1746065159.238522:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 605 committed 00000001:00080000:2.0:1746065159.238527:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936085 is committed 00000001:00080000:2.0:1746065159.238533:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936081 is committed 00000100:00100000:2.0:1746065159.238550:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263412480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065159.238581:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.238581:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263412736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065159.238603:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.238618:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263413248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065159.238621:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263412992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065159.238632:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.238638:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263412864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065159.238651:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.238657:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412480 00000100:00100000:1.0:1746065159.238659:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412480 00000100:00100000:2.0:1746065159.238662:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263413376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065159.238673:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.238683:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412736 00000100:00100000:1.0:1746065159.238685:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412736 00000100:00100000:2.0:1746065159.238692:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413248 00000100:00100000:1.0:1746065159.238694:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412864 00000100:00100000:2.0:1746065159.238695:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413248 00000100:00100000:1.0:1746065159.238696:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412864 00000100:00100000:1.0:1746065159.238703:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413376 00000100:00100000:1.0:1746065159.238705:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413376 00000100:00100000:2.0:1746065159.238712:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13697 00000100:00100000:2.0:1746065159.238716:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263412480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065159.238834:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065159.238836:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065157 -> 1746065157 00002000:00010000:2.0:1746065159.238838:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065157 -> 1746065157 00002000:00010000:2.0:1746065159.238840:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065157 -> 1746065157 00002000:00010000:2.0:1746065159.238842:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065159.238873:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263412480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (291us total) trans 17179873536 rc 0/0 00000100:00080000:3.0:1746065159.238913:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065159.238963:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263412608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065159.238983:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.238987:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13698 00000100:00100000:1.0:1746065159.238993:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3761:x1830881263412736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065159.239000:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263413120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065159.239012:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065159.239039:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065159.239041:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065157 -> 1746065157 00002000:00010000:1.0:1746065159.239043:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065157 -> 1746065157 00002000:00010000:1.0:1746065159.239045:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065157 -> 1746065157 00002000:00010000:1.0:1746065159.239046:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746065159.239069:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3761:x1830881263412736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (465us total) trans 17179873537 rc 0/0 00000100:00100000:1.0:1746065159.239075:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13698 00000100:00100000:1.0:1746065159.239085:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412608 00000100:00100000:1.0:1746065159.239087:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412608 00000100:00100000:1.0:1746065159.239095:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413120 00000100:00100000:1.0:1746065159.239097:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413120 00000100:00100000:1.0:1746065159.239104:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13699 00000100:00100000:1.0:1746065159.239108:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263412864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065159.239151:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065159.239153:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065159.239155:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065159.239157:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:1.0:1746065159.239159:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:1.0:1746065159.239184:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263412864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (532us total) trans 17179873538 rc 0/0 00000100:00100000:1.0:1746065159.239189:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13699 00000100:00100000:1.0:1746065159.239200:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13700 00000100:00100000:1.0:1746065159.239204:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263413248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065159.239247:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263413248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (614us total) trans 17179873539 rc 0/0 00000100:00100000:1.0:1746065159.239251:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13700 00000100:00100000:1.0:1746065159.239257:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13701 00000100:00100000:1.0:1746065159.239259:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263413376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065159.239288:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263413376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 28us (614us total) trans 17179873540 rc 0/0 00000100:00100000:1.0:1746065159.239291:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13701 00000100:00100000:1.0:1746065159.239296:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13702 00000100:00100000:1.0:1746065159.239298:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881263412608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065159.239318:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746065159.239319:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13703 00002000:00010000:1.0:1746065159.239320:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065156 -> 1746065156 00002000:00010000:1.0:1746065159.239321:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065156 -> 1746065156 00002000:00010000:1.0:1746065159.239322:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065156 -> 1746065156 00002000:00010000:1.0:1746065159.239323:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065159.239325:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263413120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065159.239335:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263412608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 36us (353us total) trans 17179873541 rc 0/0 00000100:00100000:1.0:1746065159.239338:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13702 00000100:00100000:1.0:1746065159.239359:0:3761:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873534 gen 2 00000004:00080000:1.0:1746065159.239362:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b67800, transno 17179873473 00000004:00080000:1.0:1746065159.239365:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc0380, transno 17179873474 00000004:00080000:1.0:1746065159.239367:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b66a00, transno 17179873475 00000004:00080000:1.0:1746065159.239369:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc1500, transno 17179873476 00000004:00080000:1.0:1746065159.239371:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3800, transno 17179873477 00000004:00080000:1.0:1746065159.239373:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b65c00, transno 17179873478 00000004:00080000:1.0:1746065159.239375:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b66680, transno 17179873479 00000004:00080000:1.0:1746065159.239377:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cc3b80, transno 17179873480 00000004:00080000:1.0:1746065159.239379:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f2a00, transno 17179873487 00000004:00080000:1.0:1746065159.239380:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1180, transno 17179873488 00000100:00100000:0.0:1746065159.239381:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3760:x1830881263413120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (368us total) trans 17179873542 rc 0/0 00000004:00080000:1.0:1746065159.239382:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3800, transno 17179873489 00000004:00080000:1.0:1746065159.239384:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3100, transno 17179873490 00000004:00080000:1.0:1746065159.239386:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1c00, transno 17179873491 00000100:00100000:0.0:1746065159.239387:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13703 00000004:00080000:1.0:1746065159.239388:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0700, transno 17179873492 00000004:00080000:1.0:1746065159.239390:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0e00, transno 17179873493 00000004:00080000:1.0:1746065159.239391:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1f80, transno 17179873494 00000004:00080000:1.0:1746065159.239393:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e11c00, transno 17179873499 00000004:00080000:1.0:1746065159.239395:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e10e00, transno 17179873500 00000004:00080000:1.0:1746065159.239397:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d04a80, transno 17179873501 00000004:00080000:1.0:1746065159.239399:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06a00, transno 17179873502 00000004:00080000:1.0:1746065159.239401:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e10700, transno 17179873503 00000004:00080000:1.0:1746065159.239403:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d05880, transno 17179873504 00000004:00080000:1.0:1746065159.239405:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12a00, transno 17179873505 00000004:00080000:1.0:1746065159.239407:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d04000, transno 17179873506 00000004:00080000:1.0:1746065159.239409:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577d180, transno 17179873507 00000004:00080000:1.0:1746065159.239411:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577e300, transno 17179873508 00000004:00080000:1.0:1746065159.239412:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f800, transno 17179873509 00000004:00080000:1.0:1746065159.239414:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577df80, transno 17179873510 00000004:00080000:1.0:1746065159.239416:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577fb80, transno 17179873511 00000004:00080000:1.0:1746065159.239417:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577d500, transno 17179873512 00000004:00080000:1.0:1746065159.239419:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f100, transno 17179873513 00000004:00080000:1.0:1746065159.239421:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577e680, transno 17179873514 00000004:00080000:1.0:1746065159.239423:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f43800, transno 17179873527 00000004:00080000:1.0:1746065159.239424:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f42d80, transno 17179873528 00000004:00080000:1.0:1746065159.239426:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f43100, transno 17179873529 00000004:00080000:1.0:1746065159.239428:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f40380, transno 17179873530 00000004:00080000:1.0:1746065159.239430:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f42a00, transno 17179873531 00000004:00080000:1.0:1746065159.239432:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f41880, transno 17179873532 00000004:00080000:1.0:1746065159.239434:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd5180, transno 17179873533 00000004:00080000:1.0:1746065159.239436:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f40a80, transno 17179873534 00000100:00100000:1.0:1746065159.239440:0:3761:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012edaf480 x1830881263412736/t17179873537(17179873537) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065175 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065159.239448:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaf480/2, rc 0, transno 17179873537 00000100:00100000:1.0:1746065159.239451:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263412736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065159.239491:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13697 00010000:00010000:3.0:1746065159.239596:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934397 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.239605:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065159.239607:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065159.239610:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93439e expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.239622:0:7204:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93439e expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.239632:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93439e expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.239649:0:7204:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93439e expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.239657:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263413504:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065159.239689:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065159.239738:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065159.240538:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edae300/2, rc 0, transno 17179873541 00000100:00100000:0.0:1746065159.240543:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263412608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065159.240556:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa1f80/2, rc 0, transno 17179873542 00000100:00100000:0.0:1746065159.240559:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263413120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065159.240619:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263413760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065159.240640:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065159.240652:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263414272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065159.240664:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065159.240674:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065159.240678:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263413632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065159.240691:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065159.240700:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263414144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065159.240712:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065159.240726:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412992 00000100:00100000:0.0:1746065159.240730:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412992 00000100:00100000:0.0:1746065159.240745:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413760 00000100:00100000:0.0:1746065159.240747:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413760 00000100:00100000:0.0:1746065159.240762:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414272 00000100:00100000:0.0:1746065159.240763:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414272 00000004:00080000:3.0:1746065159.240880:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaf800/2, rc 0, transno 17179873536 00000100:00100000:3.0:1746065159.240884:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263412480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065159.240898:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413632 00000100:00100000:3.0:1746065159.240901:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413632 00000100:00100000:3.0:1746065159.240914:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414144 00000100:00100000:3.0:1746065159.240916:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414144 00000100:00100000:3.0:1746065159.240924:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13704 00000100:00100000:3.0:1746065159.240929:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263412992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065159.241003:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263412992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1264us total) trans 17179873543 rc 0/0 00000100:00100000:3.0:1746065159.241009:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13704 00000100:00100000:3.0:1746065159.241019:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13705 00000100:00100000:3.0:1746065159.241024:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881263413760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065159.241071:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065159.241074:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065157 -> 1746065157 00002000:00010000:3.0:1746065159.241076:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065155 -> 1746065155 00002000:00010000:3.0:1746065159.241078:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065157 -> 1746065157 00002000:00010000:3.0:1746065159.241079:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065159.241097:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3760:x1830881263413760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (456us total) trans 21474840994 rc 0/0 00000100:00100000:3.0:1746065159.241101:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13705 00000100:00100000:3.0:1746065159.241109:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13706 00000100:00100000:3.0:1746065159.241112:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881263414272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065159.241150:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3760:x1830881263414272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (486us total) trans 21474840995 rc 0/0 00000100:00100000:3.0:1746065159.241154:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13706 00000100:00100000:3.0:1746065159.241161:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13707 00000100:00100000:3.0:1746065159.241164:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881263413632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065159.241191:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065159.241193:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065158 -> 1746065158 00002000:00010000:3.0:1746065159.241194:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065158 -> 1746065158 00002000:00010000:3.0:1746065159.241196:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065158 -> 1746065158 00002000:00010000:3.0:1746065159.241198:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:3.0:1746065159.241209:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3760:x1830881263413632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (517us total) trans 21474840996 rc 0/0 00000100:00100000:3.0:1746065159.241212:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13707 00000100:00100000:3.0:1746065159.241219:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13708 00000100:00100000:3.0:1746065159.241222:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881263414144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065159.241247:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb size from disk: 3940352 -> 3940352 00002000:00010000:3.0:1746065159.241249:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065159.241251:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065159.241253:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065159.241254:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8f:0x0] updating lvb blocks from disk: 1552 -> 1552 00000100:00100000:3.0:1746065159.241267:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3760:x1830881263414144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (554us total) trans 21474840997 rc 0/0 00000100:00100000:3.0:1746065159.241271:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13708 00000100:00080000:3.0:1746065159.241282:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746065159.241295:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa0a80/2, rc 0, transno 17179873543 00000100:00100000:3.0:1746065159.241298:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263412992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065159.241479:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 3 in flight, 40 done 00000004:00080000:2.0:1746065159.241513:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa3800/2, rc 0, transno 17179873538 00000100:00100000:2.0:1746065159.241517:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263412864:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065159.241530:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa2d80/2, rc 0, transno 17179873540 00000100:00100000:2.0:1746065159.241533:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263413376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065159.241541:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263414016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065159.241559:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.241571:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263414528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065159.241580:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.241588:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065159.241591:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263413888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065159.241600:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.241607:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263414400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065159.241615:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.241628:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414016 00000100:00100000:2.0:1746065159.241630:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414016 00000100:00100000:2.0:1746065159.241641:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414528 00000100:00100000:2.0:1746065159.241643:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414528 00000100:00100000:2.0:1746065159.241650:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413888 00000100:00100000:2.0:1746065159.241651:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413888 00000100:00100000:2.0:1746065159.241656:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414400 00000100:00100000:2.0:1746065159.241658:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414400 00000100:00100000:2.0:1746065159.241665:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13709 00000100:00100000:2.0:1746065159.241668:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263414016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065159.241705:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065159.241707:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065159.241708:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065159.241710:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065159.241711:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8e:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746065159.241727:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3762:x1830881263414016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (167us total) trans 21474840998 rc 0/0 00000100:00100000:2.0:1746065159.241733:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13709 00000100:00100000:2.0:1746065159.241741:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13710 00000100:00100000:2.0:1746065159.241744:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263414528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065159.241770:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb size from disk: 8134656 -> 8134656 00002000:00010000:2.0:1746065159.241788:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065159.241790:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065159.241791:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065159.241793:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x91:0x0] updating lvb blocks from disk: 7624 -> 7624 00000100:00100000:2.0:1746065159.241806:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3762:x1830881263414528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (225us total) trans 21474840999 rc 0/0 00000100:00100000:2.0:1746065159.241810:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13710 00000100:00100000:2.0:1746065159.241818:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13711 00000100:00100000:2.0:1746065159.241821:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263413888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065159.241854:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:2.0:1746065159.241865:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065157 -> 1746065157 00002000:00010000:2.0:1746065159.241867:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065157 -> 1746065157 00002000:00010000:2.0:1746065159.241868:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065157 -> 1746065157 00002000:00010000:2.0:1746065159.241870:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:2.0:1746065159.241886:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3762:x1830881263413888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (285us total) trans 21474841000 rc 0/0 00000100:00100000:2.0:1746065159.241890:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13711 00000100:00100000:2.0:1746065159.241899:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13712 00000100:00100000:2.0:1746065159.241903:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263414400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065159.241936:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065159.241939:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065159.241940:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065159.241942:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065159.241943:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:2.0:1746065159.241959:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3762:x1830881263414400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (342us total) trans 21474841001 rc 0/0 00000100:00100000:2.0:1746065159.241963:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13712 00000004:00080000:2.0:1746065159.241985:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907be680/2, rc 0, transno 21474841000 00000100:00100000:2.0:1746065159.241991:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263413888:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065159.241997:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907be300/2, rc 0, transno 21474841001 00000100:00100000:2.0:1746065159.242000:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263414400:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065159.242005:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bd880/2, rc 0, transno 21474840998 00000100:00100000:2.0:1746065159.242007:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263414016:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065159.242013:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bce00/2, rc 0, transno 21474840999 00000100:00100000:2.0:1746065159.242015:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263414528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065159.242040:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263414656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065159.242054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.242068:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414656 00000100:00100000:2.0:1746065159.242070:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414656 00000100:00100000:2.0:1746065159.242082:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13713 00000100:00100000:2.0:1746065159.242086:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263414656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065159.242131:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263414656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (75us total) trans 21474841002 rc 0/0 00000100:00100000:2.0:1746065159.242135:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13713 00000004:00080000:2.0:1746065159.242152:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f3100/2, rc 0, transno 21474841002 00000100:00100000:2.0:1746065159.242155:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263414656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065159.242700:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa1500/2, rc 0, transno 17179873539 00000100:00100000:1.0:1746065159.242704:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263413248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065159.242900:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bea00/2, rc 0, transno 21474840996 00000100:00100000:3.0:1746065159.242904:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263413632:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065159.242910:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bdf80/2, rc 0, transno 21474840997 00000100:00100000:3.0:1746065159.242913:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263414144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065159.242919:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bed80/2, rc 0, transno 21474840994 00000100:00100000:3.0:1746065159.242921:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263413760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065159.242927:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bca80/2, rc 0, transno 21474840995 00000100:00100000:3.0:1746065159.242929:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263414272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065159.243504:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+10:2007:x1830881263724800:12345-192.168.202.27@tcp:3:cat.0 Request processed in 44340us (45298us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.243512:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3978 00002000:00100000:3.0:1746065159.243519:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff88009577f480 x1830881263724800/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.243527:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f480 with x1830881263724800 ext(1048576->2097151) 00002000:00010000:3.0:1746065159.243532:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577f480 00000100:00100000:3.0:1746065159.250682:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263413504:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065159.250719:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e400/0xad6b7ddc1470887 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934397 expref: 30 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065159.251885:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934397 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.251914:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f600, rc 0) 00000100:00100000:3.0:1746065159.251965:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32485:x1830881263725568:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 40323us (40775us total) trans 8589936087 rc 0/0 00000100:00100000:3.0:1746065159.251973:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13737 00000100:00100000:0.0:1746065159.252295:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.253635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.253788:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263726080 00000100:00100000:1.0:1746065159.253795:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263726080 00000100:00100000:2.0:1746065159.254412:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263724928:12345-192.168.202.27@tcp:3:cat.0 Request processed in 53945us (56190us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.254420:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3980 00002000:00100000:2.0:1746065159.254429:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009577c000 x1830881263724928/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.254437:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c000 with x1830881263724928 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.254441:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577c000 00000100:00100000:1.0:1746065159.254737:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4977 00000100:00100000:1.0:1746065159.254747:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+8:32490:x1830881263726080:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:1.0:1746065159.255434:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ccc4a269-0136-4970-860c-c944630694a4+8:32490:x1830881263726080:12345-192.168.202.27@tcp:49:cat.0 Request processed in 688us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.255441:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4977 00000100:00100000:3.0:1746065159.256389:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263726208 00000100:00100000:3.0:1746065159.256395:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263726208 00000100:00100000:3.0:1746065159.256435:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13739 00000100:00100000:3.0:1746065159.256442:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32489:x1830881263726208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.256457:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065159.256471:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc147089c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343a5 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.256508:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc147089c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343a5 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.256523:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc147089c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343a5 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.256536:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065159.256539:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065159.256542:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5e00, rc 0) 00000100:00100000:3.0:1746065159.256572:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+30:32489:x1830881263726208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 131us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.256577:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13739 00000100:00100000:2.0:1746065159.266490:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263725312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 65457us (68245us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.266500:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3981 00002000:00100000:2.0:1746065159.266509:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009577dc00 x1830881263725312/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.266518:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577dc00 with x1830881263725312 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.266523:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577dc00 00000100:00100000:3.0:1746065159.268040:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263724544:12345-192.168.202.27@tcp:3:cat.0 Request processed in 67758us (69854us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.268050:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3979 00002000:00100000:3.0:1746065159.268058:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff88009577c700 x1830881263724544/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.268065:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c700 with x1830881263724544 ext(1048576->2097151) 00002000:00010000:3.0:1746065159.268069:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577c700 00000100:00100000:0.0:1746065159.268261:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.268490:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263726336 00000100:00100000:3.0:1746065159.268497:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263726336 00000100:00100000:3.0:1746065159.268531:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 734 00000100:00100000:3.0:1746065159.268537:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881263726336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.268547:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.268567:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5e00/0xad6b7ddc147089c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343a5 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.268595:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065159.268599:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.268622:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881263726336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.268627:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 734 00000100:00100000:0.0:1746065159.281441:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.281701:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.281809:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263726720 00000100:00100000:3.0:1746065159.281818:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263726720 00002000:00100000:3.0:1746065159.281866:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880099cc1500 x1830881263726720/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.281874:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1500 with x1830881263726720 ext(1048576->2097151) 00002000:00010000:3.0:1746065159.281878:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc1500 00000100:00100000:3.0:1746065159.281898:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3982 00000100:00100000:3.0:1746065159.281905:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263726720:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065159.282158:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263726464 00000100:00100000:2.0:1746065159.282162:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263726464 00000100:00100000:2.0:1746065159.282196:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13714 00000100:00100000:2.0:1746065159.282201:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+21:32485:x1830881263726464:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065159.282211:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.282225:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343ac expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.282246:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.282258:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 7 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.282264:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.282270:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.282272:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.282274:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2486272->2871295] (req 2486272->2871295) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.282297:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.282307:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 22 pid: 9548 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.282531:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263414784:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065159.282631:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 7 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.282639:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 7 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.282646:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263414912:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065159.282671:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.282678:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 12 pid: 11461 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.282684:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263415040:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.282698:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065159.287099:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.287125:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.287191:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263414784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.287224:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263414912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.287245:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263415040:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065159.287272:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [2486272->2871295] (req 2486272->2871295) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.287287:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927c00, rc 0) 00000100:00100000:2.0:1746065159.287325:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:32485:x1830881263726464:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5123us (5893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.287383:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263726976 00000100:00100000:1.0:1746065159.287389:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263726976 00002000:00100000:1.0:1746065159.287420:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880134b01180 x1830881263726976/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.287428:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881263726976 ext(1048576->2097151) 00002000:00010000:1.0:1746065159.287431:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01180 00000100:00100000:1.0:1746065159.287443:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3983 00000100:00100000:1.0:1746065159.287449:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263726976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065159.288102:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263727232 00000100:00100000:3.0:1746065159.288106:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263727232 00002000:00100000:3.0:1746065159.288126:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880134b00700 x1830881263727232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.288132:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00700 with x1830881263727232 ext(1048576->2097151) 00002000:00010000:3.0:1746065159.288135:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00700 00000100:00100000:3.0:1746065159.288149:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3984 00000100:00100000:3.0:1746065159.288154:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263727232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065159.288746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.288768:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263727360 00000100:00100000:3.0:1746065159.288771:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263727360 00010000:00010000:3.0:1746065159.288802:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 23 pid: 9548 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746065159.288819:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6222 00000100:00100000:3.0:1746065159.288823:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263727360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.288832:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.288845:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 23 pid: 9548 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.288868:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 23 pid: 9548 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.288886:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abac000/0xad6b7ddc1470848 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934358 expref: 23 pid: 9548 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.288901:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.288916:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263727360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.288921:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6222 00000100:00100000:3.0:1746065159.288995:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.289003:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263727616 00000100:00100000:3.0:1746065159.289006:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263727616 00010000:00010000:3.0:1746065159.289015:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 13 pid: 11461 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746065159.289027:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6223 00000100:00100000:3.0:1746065159.289031:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+13:2005:x1830881263727616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.289035:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.289040:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 13 pid: 11461 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.289047:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 13 pid: 11461 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.289060:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1470768 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934312 expref: 13 pid: 11461 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.289067:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.289077:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2005:x1830881263727616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.289081:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6223 00000100:00100000:3.0:1746065159.289133:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.289144:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263727488 00000100:00100000:3.0:1746065159.289147:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263727488 00010000:00010000:3.0:1746065159.289156:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 10 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746065159.289170:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6224 00000100:00100000:3.0:1746065159.289175:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263727488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.289179:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.289185:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 10 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.289193:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 10 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.289203:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc1470864 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934382 expref: 10 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.289215:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.289217:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.289222:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 21 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.289229:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 21 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.289253:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 21 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.289263:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263415168:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065159.289297:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065159.289405:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13714 00000100:00100000:0.0:1746065159.293228:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.293260:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.293279:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263727872 00000100:00100000:0.0:1746065159.293280:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.293286:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263727872 00000100:00100000:0.0:1746065159.293315:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263728128 00000100:00100000:0.0:1746065159.293319:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263728128 00002000:00100000:2.0:1746065159.293321:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880099cc3800 x1830881263727872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.293329:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc3800 with x1830881263727872 ext(1048576->2097151) 00002000:00100000:0.0:1746065159.293333:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880099cc3b80 x1830881263728128/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:2.0:1746065159.293335:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc3800 00002000:00100000:0.0:1746065159.293338:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc3b80 with x1830881263728128 ext(1048576->2097151) 00002000:00010000:0.0:1746065159.293341:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc3b80 00000100:00100000:2.0:1746065159.293348:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263728384 00000100:00100000:2.0:1746065159.293350:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263728384 00000100:00100000:0.0:1746065159.293351:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3985 00000100:00100000:0.0:1746065159.293357:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263727872:12345-192.168.202.27@tcp:3:multiop.0 00002000:00100000:2.0:1746065159.293358:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cc0700 x1830881263728384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.293363:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0700 with x1830881263728384 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.293366:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc0700 00000100:00100000:2.0:1746065159.293374:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3986 00000100:00100000:2.0:1746065159.293378:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263728128:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065159.293971:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3987 00000100:00100000:0.0:1746065159.293978:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263728384:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065159.302965:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.303099:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263415168:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065159.303117:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.303155:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263727488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 13978us (14020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.303165:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6224 00000100:00100000:1.0:1746065159.303298:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263728640 00000100:00100000:1.0:1746065159.303304:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263728640 00002000:00100000:1.0:1746065159.303336:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2486272->2490367) req@ffff880099cc3100 x1830881263728640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.303343:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc3100 with x1830881263728640 ext(2486272->2490367) 00002000:00010000:1.0:1746065159.303347:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc3100 00000100:00100000:1.0:1746065159.303361:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3988 00000100:00100000:1.0:1746065159.303367:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263728640:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065159.303452:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263728640:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 85us (497us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065159.303457:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3988 00002000:00100000:1.0:1746065159.303461:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x8d:0x0] (2486272->2490367) req@ffff880099cc3100 x1830881263728640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/4536 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.303466:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc3100 with x1830881263728640 ext(2486272->2490367) 00002000:00010000:1.0:1746065159.303469:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc3100 00000100:00100000:2.0:1746065159.303709:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263726720:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21804us (22007us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.303715:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3982 00002000:00100000:2.0:1746065159.303720:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880099cc1500 x1830881263726720/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.303726:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1500 with x1830881263726720 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.303729:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc1500 00000100:00100000:1.0:1746065159.313266:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263726976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25803us (26161us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.313277:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3983 00002000:00100000:1.0:1746065159.313286:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880134b01180 x1830881263726976/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.313295:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881263726976 ext(1048576->2097151) 00002000:00010000:1.0:1746065159.313300:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01180 00000100:00100000:3.0:1746065159.316232:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ccc4a269-0136-4970-860c-c944630694a4+7:2006:x1830881263727232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28068us (29097us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065159.316243:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3984 00002000:00100000:3.0:1746065159.316252:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880134b00700 x1830881263727232/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.316261:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00700 with x1830881263727232 ext(1048576->2097151) 00002000:00010000:3.0:1746065159.316268:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00700 00000100:00100000:2.0:1746065159.322918:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263727872:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 29551us (29689us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.322928:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3985 00002000:00100000:2.0:1746065159.322936:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6e:0x0] (1048576->2097151) req@ffff880099cc3800 x1830881263727872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.322944:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc3800 with x1830881263727872 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.322949:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc3800 00000100:00100000:0.0:1746065159.328411:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.328473:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263728768 00000100:00100000:3.0:1746065159.328482:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263728768 00000100:00100000:0.0:1746065159.328560:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13715 00000100:00100000:0.0:1746065159.328569:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+8:32486:x1830881263728768:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065159.328584:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.328599:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343b3 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.328624:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.328632:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.328639:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 28 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.328646:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.328648:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.328652:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.328679:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 28 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.328690:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 28 pid: 9550 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746065159.328701:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263415296:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065159.329112:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.329120:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 9 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746065159.329128:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263415424:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.329677:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263728128:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 36296us (36414us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.329686:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3986 00002000:00100000:2.0:1746065159.329697:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff880099cc3b80 x1830881263728128/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.329705:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc3b80 with x1830881263728128 ext(1048576->2097151) 00010000:00010000:2.0:1746065159.329713:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 27 pid: 9550 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746065159.329722:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 27 pid: 9550 timeout: 855 lvb_type: 1 00002000:00010000:2.0:1746065159.329728:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc3b80 00010000:00010000:0.0:1746065159.329892:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.329902:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 8 pid: 12258 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746065159.329910:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263415552:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065159.330945:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065159.335025:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263728384:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 41040us (41737us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065159.335034:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3987 00002000:00100000:1.0:1746065159.335043:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cc0700 x1830881263728384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.335052:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0700 with x1830881263728384 ext(1048576->2097151) 00002000:00010000:1.0:1746065159.335057:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc0700 00000100:00100000:2.0:1746065159.335661:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263415296:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.335675:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263415424:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065159.338551:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.338591:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.338669:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263728896 00000100:00100000:2.0:1746065159.338677:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263728896 00000100:00100000:0.0:1746065159.338679:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263415552:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065159.338709:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.338710:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 27 pid: 9550 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746065159.338725:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718800, rc 0) 00000100:00100000:0.0:1746065159.338761:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+9:32486:x1830881263728768:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10194us (10359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.338769:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13715 00000100:00100000:2.0:1746065159.339574:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263729024 00000100:00100000:2.0:1746065159.339578:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263729024 00010000:00010000:2.0:1746065159.339590:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 9 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746065159.339947:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6225 00000100:00100000:3.0:1746065159.339956:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263728896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.339967:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.339983:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 27 pid: 9550 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.339992:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 27 pid: 9550 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.340011:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66600/0xad6b7ddc147082c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93434a expref: 27 pid: 9550 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.340026:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.340048:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881263728896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.340053:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6225 00000100:00100000:3.0:1746065159.340064:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6226 00000100:00100000:3.0:1746065159.340068:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263729024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.340073:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.340078:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 9 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.340084:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 9 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.340093:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a852aa00/0xad6b7ddc147085d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934374 expref: 9 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.340100:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.340108:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263729024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.340112:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6226 00000100:00100000:2.0:1746065159.340712:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.340741:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.340783:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263729280 00000100:00100000:3.0:1746065159.340787:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263729280 00010000:00010000:3.0:1746065159.340799:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 9 pid: 12258 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.340815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.340873:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263729152 00000100:00100000:0.0:1746065159.340877:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263729152 00000100:00100000:0.0:1746065159.340898:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13716 00000100:00100000:0.0:1746065159.340902:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:32489:x1830881263729152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065159.340912:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.340921:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343ba expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.340932:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.340936:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.340942:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065159.340945:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.340968:0:12260:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.340978:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.340985:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835dc00, rc 0) 00000100:00100000:0.0:1746065159.341008:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+27:32489:x1830881263729152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.341013:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13716 00000100:00100000:3.0:1746065159.341238:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6227 00000100:00100000:3.0:1746065159.341243:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+9:2005:x1830881263729280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.341249:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065159.341251:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065159.341256:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 9 pid: 12258 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.341264:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 9 pid: 12258 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.341274:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8c00/0xad6b7ddc147076f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934304 expref: 9 pid: 12258 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.341279:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065159.341282:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.341283:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065159.341288:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.341294:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.341309:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065159.341317:0:7190:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 7 pid: 12260 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746065159.341325:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263415808:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065159.341326:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263729664 00000100:00100000:0.0:1746065159.341329:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263729664 00000100:00100000:0.0:1746065159.341353:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263729792 00000100:00100000:0.0:1746065159.341355:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263729792 00000100:00100000:3.0:1746065159.341365:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065159.341365:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13717 00000100:00100000:0.0:1746065159.341368:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263729664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065159.341373:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.341377:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc14708b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343c1 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065159.341379:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13718 00000100:00100000:3.0:1746065159.341383:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263729792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065159.341390:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065159.341396:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263415936:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065159.341397:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc14708bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343c8 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.341412:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065159.341415:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263416064:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065159.341424:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263729536 00000100:00100000:0.0:1746065159.341426:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263729536 00000100:00100000:3.0:1746065159.341430:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535780 going to sleep for 11 seconds 00002000:00100000:0.0:1746065159.341442:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2867200->2871295) req@ffff880134b02300 x1830881263729536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.341447:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02300 with x1830881263729536 ext(2867200->2871295) 00002000:00010000:0.0:1746065159.341450:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b02300 00000100:00100000:0.0:1746065159.341457:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3989 00000100:00100000:0.0:1746065159.341460:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881263729536:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065159.341683:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881263729536:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 221us (868us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065159.341687:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3989 00002000:00100000:0.0:1746065159.341690:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2867200->2871295) req@ffff880134b02300 x1830881263729536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/4536 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.341695:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02300 with x1830881263729536 ext(2867200->2871295) 00002000:00010000:0.0:1746065159.341697:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b02300 00000100:00100000:3.0:1746065159.343055:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263415808:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065159.343066:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.343088:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2005:x1830881263729280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1844us (2346us total) trans 0 rc 0/0 00002000:00010000:2.0:1746065159.343092:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime: 1746065157 -> 1746065159 00002000:00010000:0.0:1746065159.343092:0:12258:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime: 1746065156 -> 1746065159 00000100:00100000:3.0:1746065159.343094:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6227 00002000:00010000:2.0:1746065159.343095:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime: 1746065157 -> 1746065159 00002000:00010000:0.0:1746065159.343095:0:12258:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime: 1746065156 -> 1746065159 00002000:00010000:2.0:1746065159.343097:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime: 1746065157 -> 1746065159 00002000:00010000:0.0:1746065159.343097:0:12258:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime: 1746065156 -> 1746065159 00000100:00100000:2.0:1746065159.343106:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263416064:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065159.343106:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263415936:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065159.343121:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc14708bf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343c8 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.343121:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc14708b8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343c1 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.343130:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4600/0xad6b7ddc14708bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343c8 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.343130:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835c200/0xad6b7ddc14708b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343c1 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.343481:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4600, rc 0) 00010000:00010000:0.0:1746065159.343483:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:2.0:1746065159.343511:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:2005:x1830881263729792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2127us (2231us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065159.343511:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263729664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2141us (2261us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065159.343517:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13717 00000100:00100000:2.0:1746065159.343523:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13718 00000100:00100000:0.0:1746065159.343740:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.343800:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263730048 00000100:00100000:2.0:1746065159.343805:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263730048 00002000:00100000:2.0:1746065159.343826:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1863680->1867775) req@ffff880099cc1180 x1830881263730048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.343834:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1180 with x1830881263730048 ext(1863680->1867775) 00010000:00010000:2.0:1746065159.343838:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 8 pid: 12260 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.343848:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 8 pid: 12260 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746065159.343853:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc1180 00000100:00100000:2.0:1746065159.343884:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1362 00000100:00100000:2.0:1746065159.343890:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263730048:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065159.343979:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263730048:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 89us (240us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065159.343984:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1362 00002000:00100000:2.0:1746065159.343989:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1863680->1867775) req@ffff880099cc1180 x1830881263730048/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/4536 e 0 to 0 dl 1746065170 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.343994:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1180 with x1830881263730048 ext(1863680->1867775) 00010000:00010000:2.0:1746065159.343998:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 8 pid: 12260 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.344005:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 8 pid: 12260 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746065159.344009:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc1180 00000100:00100000:0.0:1746065159.350380:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.350532:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263730432 00000100:00100000:2.0:1746065159.350541:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263730432 00000100:00100000:2.0:1746065159.350575:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13719 00000100:00100000:2.0:1746065159.350582:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+7:32486:x1830881263730432:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065159.350598:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065159.350613:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343cf expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.350641:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.350650:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.350657:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 20 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.350663:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.350664:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065159.350667:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->1757183] (req 1048576->1757183) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.350928:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 20 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.350941:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 20 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.350952:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263416192:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065159.351450:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.351458:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 8 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.351471:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263416320:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065159.351499:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065159.351507:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 11 pid: 11461 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.351514:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263416448:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.351529:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065159.355350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.355390:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.355588:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263730560 00000100:00100000:1.0:1746065159.355596:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263730560 00000100:00100000:1.0:1746065159.355632:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13720 00000100:00100000:1.0:1746065159.355639:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+9:32490:x1830881263730560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065159.355654:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.355667:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14708cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343d6 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.355690:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 20 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.355697:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065159.355699:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065159.355702:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14708cd lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343d6 expref: 10 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.355728:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 20 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.355738:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 20 pid: 12258 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746065159.355752:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263416576:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065159.355836:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065159.355989:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263416192:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.355998:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263416320:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065159.356004:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263416448:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065159.356026:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [1048576->1757183] (req 1048576->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065159.356036:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538600, rc 0) 00000100:00100000:2.0:1746065159.356056:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+10:32486:x1830881263730432:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5475us (5686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.356062:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13719 00000100:00100000:3.0:1746065159.356218:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263730304 00000100:00100000:3.0:1746065159.356223:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263730304 00002000:00100000:3.0:1746065159.356245:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1863680->2097151) req@ffff880099cc0000 x1830881263730304/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.356254:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0000 with x1830881263730304 ext(1863680->2097151) 00010000:00010000:3.0:1746065159.356260:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 8 pid: 12260 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746065159.356269:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 8 pid: 12260 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746065159.356274:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc0000 00000100:00100000:3.0:1746065159.356288:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1363 00000100:00100000:3.0:1746065159.356293:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+8:2006:x1830881263730304:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065159.356888:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.356960:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263730688 00000100:00100000:3.0:1746065159.356964:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263730688 00010000:00010000:3.0:1746065159.356980:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 12 pid: 11461 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746065159.356998:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6228 00000100:00100000:3.0:1746065159.357003:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+12:2004:x1830881263730688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065159.357010:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065159.357024:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 12 pid: 11461 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.357036:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 12 pid: 11461 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.357053:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147077d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93430b expref: 12 pid: 11461 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746065159.357067:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065159.357084:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8adb6cf4-807a-4620-a3cb-7b9d021f2493+11:2004:x1830881263730688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.357089:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6228 00000100:00100000:0.0:1746065159.361161:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.361183:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263730944 00000100:00100000:0.0:1746065159.361189:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263730944 00010000:00010000:0.0:1746065159.361216:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 10 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.361244:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.361252:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263730816 00000100:00100000:0.0:1746065159.361255:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263730816 00000100:00100000:2.0:1746065159.361265:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6229 00010000:00010000:0.0:1746065159.361265:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 21 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746065159.361273:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263730944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065159.361285:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065159.361302:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 10 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746065159.361310:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 10 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746065159.361329:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147086b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93437b expref: 10 pid: 3068 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746065159.361399:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263416576:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065159.361420:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14708cd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343d6 expref: 9 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.361433:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab6e400, rc 0) 00000100:00100000:1.0:1746065159.361466:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+9:32490:x1830881263730560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5828us (6076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.361472:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13720 00000100:00100000:1.0:1746065159.361524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.361543:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263731072 00000100:00100000:1.0:1746065159.361546:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263731072 00002000:00100000:1.0:1746065159.361566:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2486272->2871295) req@ffff88009834df80 x1830881263731072/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.361574:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834df80 with x1830881263731072 ext(2486272->2871295) 00010000:00010000:1.0:1746065159.361580:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.361588:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746065159.361593:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009834df80 00000100:00100000:1.0:1746065159.361606:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1364 00000100:00100000:1.0:1746065159.361617:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881263731072:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065159.361629:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6230 00000100:00100000:0.0:1746065159.361635:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881263730816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065159.361643:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065159.361650:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 22 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746065159.361659:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 22 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746065159.361670:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1470841 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934351 expref: 22 pid: 3068 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746065159.361682:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.361683:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.361689:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.361696:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.361718:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.361727:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263416704:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065159.361798:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00010000:00010000:2.0:1746065159.361836:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065159.361868:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263730944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 596us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.361873:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6229 00000100:00100000:0.0:1746065159.366103:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263416704:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065159.366335:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065159.366369:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881263730816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4733us (5124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.366378:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6230 00000100:00100000:3.0:1746065159.367157:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263730304:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 10861us (11812us total) trans 17179873544 rc 0/0 00000100:00100000:3.0:1746065159.367165:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1363 00002000:00100000:3.0:1746065159.367174:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x6f:0x0] (1863680->2097151) req@ffff880099cc0000 x1830881263730304/t17179873544(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.367183:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0000 with x1830881263730304 ext(1863680->2097151) 00010000:00010000:3.0:1746065159.367191:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 10 pid: 12260 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746065159.367202:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 10 pid: 12260 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746065159.367208:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cc0000 00000100:00100000:1.0:1746065159.370460:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881263731072:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 8833us (8925us total) trans 21474841003 rc 0/0 00000100:00100000:2.0:1746065159.370468:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.370470:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1364 00002000:00100000:1.0:1746065159.370479:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2486272->2871295) req@ffff88009834df80 x1830881263731072/t21474841003(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.370486:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834df80 with x1830881263731072 ext(2486272->2871295) 00010000:00010000:1.0:1746065159.370495:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.370504:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746065159.370510:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009834df80 00000100:00100000:0.0:1746065159.370573:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263731200 00000100:00100000:0.0:1746065159.370579:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263731200 00010000:00010000:0.0:1746065159.370602:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 10 pid: 12260 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746065159.370629:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6231 00000100:00100000:0.0:1746065159.370636:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263731200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065159.370646:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065159.370661:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 10 pid: 12260 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065159.370669:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 10 pid: 12260 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065159.370687:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718800/0xad6b7ddc14708aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343b3 expref: 10 pid: 12260 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065159.370702:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.370703:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.370709:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.370721:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.370814:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065159.370827:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263416832:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065159.371547:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065159.372381:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.372438:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263731456 00000100:00100000:1.0:1746065159.372443:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263731456 00002000:00100000:1.0:1746065159.372473:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1753088->1757183) req@ffff880099cc1c00 x1830881263731456/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.372480:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1c00 with x1830881263731456 ext(1753088->1757183) 00002000:00010000:1.0:1746065159.372484:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1c00 00000100:00100000:1.0:1746065159.372509:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3990 00000100:00100000:1.0:1746065159.372515:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263731456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065159.372967:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263731456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 450us (587us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065159.372977:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3990 00002000:00100000:1.0:1746065159.372982:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1753088->1757183) req@ffff880099cc1c00 x1830881263731456/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/4536 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.372988:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1c00 with x1830881263731456 ext(1753088->1757183) 00002000:00010000:1.0:1746065159.372991:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1c00 00000100:00100000:0.0:1746065159.374602:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.374761:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263416832:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065159.374804:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065159.374834:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263731200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4198us (4365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.374842:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6231 00000100:00100000:1.0:1746065159.374875:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263731584 00000100:00100000:1.0:1746065159.374879:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263731584 00010000:00010000:1.0:1746065159.374900:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746065159.374931:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6232 00000100:00100000:1.0:1746065159.374937:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881263731584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065159.374948:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065159.374965:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.374975:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.374994:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d927c00/0xad6b7ddc14708a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2486272->2871295) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ac expref: 22 pid: 12258 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.375016:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.375018:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.375024:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14708cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343d6 expref: 7 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.375031:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14708cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343d6 expref: 7 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.375056:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14708cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343d6 expref: 7 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.375066:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263416960:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065159.375237:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065159.376245:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.376278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.376301:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263732096 00000100:00100000:0.0:1746065159.376305:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263732096 00000100:00100000:0.0:1746065159.376334:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4978 00000100:00100000:0.0:1746065159.376340:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+8:32486:x1830881263732096:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065159.376965:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+9:32486:x1830881263732096:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 623us (684us total) trans 8589936088 rc 0/0 00000100:00100000:0.0:1746065159.376971:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4978 00000100:00100000:1.0:1746065159.376978:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263416960:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065159.376989:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065159.377005:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263731584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2068us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.377011:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6232 00000100:00100000:2.0:1746065159.377178:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263731840 00000100:00100000:2.0:1746065159.377183:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263731840 00002000:00100000:2.0:1746065159.377205:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009834d180 x1830881263731840/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.377214:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834d180 with x1830881263731840 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.377218:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834d180 00000100:00100000:2.0:1746065159.377240:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3991 00000100:00100000:2.0:1746065159.377246:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263731840:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065159.394971:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.395006:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.395316:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263732480 00000100:00100000:2.0:1746065159.395324:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263732480 00002000:00100000:2.0:1746065159.395359:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099cc2d80 x1830881263732480/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.395369:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2d80 with x1830881263732480 ext(2097152->4194303) 00002000:00010000:2.0:1746065159.395374:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc2d80 00000100:00100000:2.0:1746065159.395387:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263732608 00000100:00100000:2.0:1746065159.395389:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263732608 00002000:00100000:2.0:1746065159.395398:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099cc1880 x1830881263732608/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.395405:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1880 with x1830881263732608 ext(2097152->4194303) 00002000:00010000:2.0:1746065159.395407:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1880 00000100:00100000:2.0:1746065159.395428:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3992 00000100:00100000:2.0:1746065159.395434:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263732480:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065159.395460:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3993 00000100:00100000:1.0:1746065159.395468:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+8:2004:x1830881263732608:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065159.396290:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263731840:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 19042us (20045us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065159.396299:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3991 00002000:00100000:0.0:1746065159.396305:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x6f:0x0] (1048576->2097151) req@ffff88009834d180 x1830881263731840/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.396321:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834d180 with x1830881263731840 ext(1048576->2097151) 00002000:00010000:0.0:1746065159.396325:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834d180 00000100:00100000:2.0:1746065159.402918:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.403015:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263732736 00000100:00100000:1.0:1746065159.403023:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263732736 00000100:00100000:1.0:1746065159.403074:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13721 00000100:00100000:1.0:1746065159.403080:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+21:32489:x1830881263732736:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065159.403097:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.403114:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343dd expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.403138:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.403144:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065159.403146:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065159.403149:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.403175:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.403185:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 9 pid: 3068 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746065159.403194:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263417088:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065159.404494:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065159.409301:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.409374:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263417088:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065159.409401:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.409416:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30000, rc 0) 00000100:00100000:1.0:1746065159.409460:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:32489:x1830881263732736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6378us (6550us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.409469:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13721 00000100:00100000:2.0:1746065159.409886:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263732864 00000100:00100000:2.0:1746065159.409892:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263732864 00002000:00100000:2.0:1746065159.409920:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1757183) req@ffff880099cc0e00 x1830881263732864/t0(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.409929:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0e00 with x1830881263732864 ext(1048576->1757183) 00010000:00010000:2.0:1746065159.409934:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746065159.409945:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746065159.409951:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cc0e00 00000100:00100000:2.0:1746065159.410046:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1365 00000100:00100000:2.0:1746065159.410053:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263732864:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065159.411325:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263732608:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15854us (16314us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065159.411334:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3993 00002000:00100000:1.0:1746065159.411341:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880099cc1880 x1830881263732608/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065159.411348:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc1880 with x1830881263732608 ext(2097152->4194303) 00002000:00010000:1.0:1746065159.411352:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc1880 00000100:00100000:3.0:1746065159.418713:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263732480:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23270us (23740us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065159.418724:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3992 00002000:00100000:3.0:1746065159.418733:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff880099cc2d80 x1830881263732480/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.418741:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2d80 with x1830881263732480 ext(2097152->4194303) 00002000:00010000:3.0:1746065159.418747:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cc2d80 00000100:00100000:0.0:1746065159.422281:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263732864:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12219us (12976us total) trans 21474841004 rc 0/0 00000100:00100000:0.0:1746065159.422294:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1365 00002000:00100000:0.0:1746065159.422303:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->1757183) req@ffff880099cc0e00 x1830881263732864/t21474841004(0) o4->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/448 e 0 to 0 dl 1746065170 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.422379:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc0e00 with x1830881263732864 ext(1048576->1757183) 00010000:00010000:0.0:1746065159.422390:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746065159.422404:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 855 lvb_type: 0 00002000:00010000:0.0:1746065159.422411:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cc0e00 00000100:00100000:0.0:1746065159.431831:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.432006:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263732992 00000100:00100000:1.0:1746065159.432015:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263732992 00010000:00010000:1.0:1746065159.432047:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746065159.432086:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6233 00000100:00100000:1.0:1746065159.432094:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+10:2004:x1830881263732992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065159.432107:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065159.432124:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065157 -> 1746065159 00002000:00010000:1.0:1746065159.432126:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065157 -> 1746065159 00010000:00010000:1.0:1746065159.432131:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.432143:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.432167:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538600/0xad6b7ddc14708c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343cf expref: 10 pid: 3068 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746065159.432197:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.432199:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.432205:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 21 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.432212:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 21 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.432238:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 21 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065159.432250:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263417216:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065159.433419:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065159.434482:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.434515:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.434587:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263417216:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065159.434602:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065159.435170:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc4a269-0136-4970-860c-c944630694a4+9:2004:x1830881263732992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3075us (3344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.435179:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6233 00000100:00100000:1.0:1746065159.435309:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263733120 00000100:00100000:1.0:1746065159.435315:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263733120 00000100:00100000:1.0:1746065159.435349:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263733248 00000100:00100000:1.0:1746065159.435352:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263733248 00000100:00100000:1.0:1746065159.435371:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13722 00000100:00100000:1.0:1746065159.435377:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263733120:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065159.435378:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13723 00000100:00100000:0.0:1746065159.435383:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+9:2006:x1830881263733248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065159.435391:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065159.435391:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.435403:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14708e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343e4 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065159.435403:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc14708db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343eb expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.435421:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.435421:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.435422:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.435422:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065159.435428:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc14708db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343eb expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.435441:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc14708db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343eb expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065159.435450:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:0.0:1746065159.435469:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263733248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 86us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.435474:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13723 00010000:00010000:1.0:1746065159.435735:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14708e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343e4 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.435747:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14708e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343e4 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.435754:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31a00, rc 0) 00000100:00100000:1.0:1746065159.435798:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263733120:12345-192.168.202.27@tcp:101:cat.0 Request processed in 421us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.435802:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13722 00000100:00100000:0.0:1746065159.436836:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.436890:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263733504 00000100:00100000:2.0:1746065159.436895:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263733504 00002000:00100000:2.0:1746065159.436928:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cc2680 x1830881263733504/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.436937:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2680 with x1830881263733504 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.436942:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc2680 00000100:00100000:2.0:1746065159.437246:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3994 00000100:00100000:2.0:1746065159.437254:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263733504:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065159.444901:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.446364:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263733504:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9106us (9525us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065159.446375:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3994 00002000:00100000:2.0:1746065159.446384:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8c:0x0] (1048576->2097151) req@ffff880099cc2680 x1830881263733504/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.446393:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cc2680 with x1830881263733504 ext(1048576->2097151) 00002000:00010000:2.0:1746065159.446398:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cc2680 00000100:00100000:2.0:1746065159.446416:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263733760 00000100:00100000:2.0:1746065159.446422:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263733760 00002000:00100000:2.0:1746065159.446448:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880090dd9180 x1830881263733760/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.446454:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9180 with x1830881263733760 ext(4194304->5021695) 00002000:00010000:2.0:1746065159.446457:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9180 00000100:00100000:2.0:1746065159.446489:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3995 00000100:00100000:2.0:1746065159.446495:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263733760:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065159.453222:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065159.453284:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263733888 00000100:00100000:1.0:1746065159.453292:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263733888 00000100:00100000:1.0:1746065159.453345:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13724 00000100:00100000:1.0:1746065159.453353:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881263733888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065159.453370:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065159.453385:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343f2 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065159.453405:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.453407:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065159.453414:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.453425:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065159.453438:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30c00, rc 0) 00000100:00100000:1.0:1746065159.453488:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263733888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 135us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.453493:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13724 00000100:00100000:3.0:1746065159.454951:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ccc4a269-0136-4970-860c-c944630694a4+10:2006:x1830881263733760:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8451us (10098us total) trans 0 rc 827392/827392 00000100:00100000:3.0:1746065159.454960:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3995 00002000:00100000:3.0:1746065159.456189:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880090dd9180 x1830881263733760/t0(0) o3->ccc4a269-0136-4970-860c-c944630694a4@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.456199:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9180 with x1830881263733760 ext(4194304->5021695) 00002000:00010000:3.0:1746065159.456205:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9180 00000100:00100000:0.0:1746065159.463390:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.463448:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263734144 00000100:00100000:2.0:1746065159.463455:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263734144 00000100:00100000:2.0:1746065159.463496:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4979 00000100:00100000:2.0:1746065159.463501:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+9:32490:x1830881263734144:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065159.463651:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ccc4a269-0136-4970-860c-c944630694a4+10:32490:x1830881263734144:12345-192.168.202.27@tcp:35:cat.0 Request processed in 149us (269us total) trans 8589936089 rc 0/0 00000100:00100000:2.0:1746065159.463657:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4979 00000100:00100000:0.0:1746065159.469880:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065159.469999:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263734400 00000100:00100000:3.0:1746065159.470007:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263734400 00002000:00100000:3.0:1746065159.470040:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880090dd9500 x1830881263734400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.470049:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9500 with x1830881263734400 ext(2097152->4194303) 00002000:00010000:3.0:1746065159.470053:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9500 00000100:00100000:3.0:1746065159.470071:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3996 00000100:00100000:3.0:1746065159.470077:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263734400:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065159.470363:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065159.470404:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263734656 00000100:00100000:0.0:1746065159.470408:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263734656 00002000:00100000:0.0:1746065159.470425:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009834e300 x1830881263734656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065159.470437:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834e300 with x1830881263734656 ext(2097152->4194303) 00002000:00010000:0.0:1746065159.470440:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834e300 00000100:00100000:0.0:1746065159.470462:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3997 00000100:00100000:0.0:1746065159.470467:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263734656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065159.484354:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881263734400:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14269us (14475us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065159.484364:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3996 00002000:00100000:3.0:1746065159.484373:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x8d:0x0] (2097152->4194303) req@ffff880090dd9500 x1830881263734400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065159.484382:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9500 with x1830881263734400 ext(2097152->4194303) 00002000:00010000:3.0:1746065159.484388:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9500 00000100:00100000:2.0:1746065159.492731:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881263734656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22253us (22357us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065159.492741:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3997 00002000:00100000:2.0:1746065159.493063:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x70:0x0] (2097152->4194303) req@ffff88009834e300 x1830881263734656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.493073:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834e300 with x1830881263734656 ext(2097152->4194303) 00002000:00010000:2.0:1746065159.493079:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834e300 00000100:00100000:0.0:1746065159.504708:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065159.504769:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263734912 00000100:00100000:2.0:1746065159.504810:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263734912 00002000:00100000:2.0:1746065159.504850:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880090ddad80 x1830881263734912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/0 e 0 to 0 dl 1746065170 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.504867:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddad80 with x1830881263734912 ext(4194304->5021695) 00002000:00010000:2.0:1746065159.504872:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddad80 00000100:00100000:2.0:1746065159.505113:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3998 00000100:00100000:2.0:1746065159.505121:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263734912:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065159.510243:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263734912:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5115us (5535us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746065159.510256:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3998 00002000:00100000:2.0:1746065159.510267:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x8d:0x0] (4194304->5021695) req@ffff880090ddad80 x1830881263734912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:75/0 lens 488/440 e 0 to 0 dl 1746065170 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065159.510276:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddad80 with x1830881263734912 ext(4194304->5021695) 00002000:00010000:2.0:1746065159.510282:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090ddad80 00000100:00100000:2.0:1746065159.693595:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746065159.693613:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263417344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746065159.693672:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065159.693969:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417344 00000100:00100000:0.0:1746065159.693976:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417344 00000100:00100000:0.0:1746065159.694017:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1746065159.694024:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263417344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065159.694050:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065159.694094:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881263417344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.694100:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1746065159.694126:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263417344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746065159.708991:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263417600:0@lo:400:kworker.0 00000100:00100000:2.0:1746065159.709018:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881263417728:0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.709048:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.709048:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065159.709081:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263417856:0@lo:400:kworker.0 00000100:00100000:2.0:1746065159.709089:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3759:1830881263418240:0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.709099:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.709103:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.709120:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417728 00000100:00100000:3.0:1746065159.709125:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3760:1830881263418368:0@lo:400:kworker.0 00000100:00100000:2.0:1746065159.709126:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417728 00000100:00100000:3.0:1746065159.709139:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.709158:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418240 00000100:00100000:2.0:1746065159.709160:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418240 00000100:00100000:3.0:1746065159.709163:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417856 00000100:00100000:3.0:1746065159.709165:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417856 00000100:00100000:2.0:1746065159.709174:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418368 00000100:00100000:2.0:1746065159.709176:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418368 00000100:00100000:3.0:1746065159.709187:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1746065159.709187:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1746065159.709192:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263417856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065159.709192:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881263417728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065159.709256:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417600 00000100:00100000:0.0:1746065159.709259:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417600 00000100:00100000:1.0:1746065159.709262:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881263417472:0@lo:400:kworker.0 00000100:00100000:0.0:1746065159.709281:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1746065159.709614:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263417600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.709918:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.709938:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263417984:0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.709954:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.709965:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3761:1830881263418496:0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.709975:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263417856:12345-0@lo:400:kworker.0 Request processed in 781us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.709980:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065159.709981:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1746065159.709991:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746065159.709995:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3761:1830881263418112:0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.710001:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417984 00000100:00100000:3.0:1746065159.710004:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417984 00000100:00100000:1.0:1746065159.710010:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.710018:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3761:1830881263418624:0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.710020:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1746065159.710024:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881263417984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710029:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.710044:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418496 00000100:00100000:1.0:1746065159.710047:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418496 00000100:00100000:3.0:1746065159.710048:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881263417984:12345-0@lo:400:kworker.0 Request processed in 23us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.710052:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1746065159.710064:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418112 00000100:00080000:3.0:1746065159.710065:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065159.710065:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418112 00000100:00080000:3.0:1746065159.710067:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746065159.710070:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746065159.710072:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746065159.710072:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418624 00000100:00100000:1.0:1746065159.710074:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418624 00000100:00100000:3.0:1746065159.710081:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1746065159.710086:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3759:x1830881263418240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710091:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1746065159.710095:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3760:x1830881263418368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.710106:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3759:x1830881263418240:12345-0@lo:400:kworker.0 Request processed in 20us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.710111:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1746065159.710122:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1746065159.710122:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3760:x1830881263418368:12345-0@lo:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.710125:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3761:x1830881263418496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710127:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1746065159.710138:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1746065159.710140:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3761:x1830881263418496:12345-0@lo:400:kworker.0 Request processed in 14us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.710141:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3761:x1830881263418112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.710144:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1746065159.710153:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1746065159.710156:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3761:x1830881263418624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710161:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3761:x1830881263418112:12345-0@lo:400:kworker.0 Request processed in 19us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.710165:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1746065159.710171:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3761:x1830881263418624:12345-0@lo:400:kworker.0 Request processed in 14us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065159.710175:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1746065159.710182:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417472 00000100:00100000:1.0:1746065159.710185:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417472 00000100:00100000:1.0:1746065159.710200:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1746065159.710203:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263417856:0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710204:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800902f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881263417472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.710211:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3760:1830881263418368:0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710224:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800902f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881263417472:12345-0@lo:400:kworker.0 Request processed in 20us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.710228:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1746065159.710238:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3759:1830881263418240:0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.710250:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881263417728:0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710256:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3761:1830881263418112:0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710264:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3761:1830881263418624:0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710270:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881263417472:0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710276:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263417984:0@lo:400:kworker.0 00000100:00100000:1.0:1746065159.710282:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3761:1830881263418496:0@lo:400:kworker.0 00000100:00100000:2.0:1746065159.710349:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881263417728:12345-0@lo:400:kworker.0 Request processed in 1156us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.710354:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1746065159.710465:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263417600:12345-0@lo:400:kworker.0 Request processed in 853us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065159.710471:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1746065159.711160:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263417600:0@lo:400:kworker.0 00000100:00100000:3.0:1746065159.773836:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263418752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746065159.773920:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.773976:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418752 00000100:00100000:1.0:1746065159.773982:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418752 00000100:00100000:1.0:1746065159.774017:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1746065159.774024:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263418752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746065159.774050:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445650432 avail 1316188160 00000100:00100000:1.0:1746065159.774092:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263418752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.774098:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1746065159.774122:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263418752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065159.805160:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263418880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065159.805220:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065159.805349:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418880 00000100:00100000:1.0:1746065159.805356:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418880 00000100:00100000:1.0:1746065159.805394:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:1.0:1746065159.805400:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881263418880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746065159.805420:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1205478848 pending 1142784 free 3903262720 avail 3671740416 00000100:00100000:1.0:1746065159.805448:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881263418880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065159.805454:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1746065159.805517:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263418880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065159.820996:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263419008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065159.821059:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065159.821123:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419008 00000100:00100000:2.0:1746065159.821131:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419008 00000100:00100000:2.0:1746065159.821175:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1746065159.821182:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263419008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746065159.821202:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1133599040 pending 258048 free 3910807552 avail 3679285248 00000100:00100000:2.0:1746065159.821238:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263419008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065159.821243:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1746065159.823886:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263419008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1746065159.933001:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065160.087913:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.087941:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.087956:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.087966:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.087987:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.088006:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.088027:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263735168 00000100:00100000:0.0:1746065160.088034:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263735168 00000100:00100000:0.0:1746065160.088066:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263735424 00000100:00100000:0.0:1746065160.088068:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263735424 00000100:00100000:0.0:1746065160.088077:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263735680 00000100:00100000:0.0:1746065160.088079:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263735680 00000100:00100000:0.0:1746065160.088087:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263735040 00000100:00100000:0.0:1746065160.088089:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263735040 00000100:00100000:0.0:1746065160.088096:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263735296 00000100:00100000:0.0:1746065160.088098:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263735296 00000100:00100000:0.0:1746065160.088104:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263735552 00000100:00100000:0.0:1746065160.088105:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263735552 00000100:00100000:0.0:1746065160.088113:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13725 00000100:00100000:0.0:1746065160.088120:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263735168:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:0.0:1746065160.088205:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263735168:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.088210:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13725 00000100:00100000:0.0:1746065160.088223:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13726 00000100:00100000:0.0:1746065160.088227:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263735424:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:0.0:1746065160.088264:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13727 00000100:00100000:0.0:1746065160.088267:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263735680:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:0.0:1746065160.088290:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263735680:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 22us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.088294:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13727 00000100:00100000:0.0:1746065160.088302:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13728 00000100:00100000:0.0:1746065160.088305:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263735040:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:0.0:1746065160.088327:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+12:2005:x1830881263735040:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.088331:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13728 00000100:00100000:0.0:1746065160.088337:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13729 00000100:00100000:0.0:1746065160.088340:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+10:2005:x1830881263735296:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:0.0:1746065160.088567:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13730 00000100:00100000:0.0:1746065160.088573:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+11:2005:x1830881263735552:12345-192.168.202.27@tcp:16:kworker.0 00000001:00080000:1.0:1746065160.090860:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841004 is committed 00000001:00080000:1.0:1746065160.090873:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841003 is committed 00000001:00080000:1.0:1746065160.090878:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841002 is committed 00000001:00080000:1.0:1746065160.090888:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840993 is committed 00000100:00100000:1.0:1746065160.090987:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2005:x1830881263735424:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 2755us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.090995:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13726 00000100:00100000:0.0:1746065160.091189:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263735552:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 2614us (3180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.091195:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13730 00000001:00080000:0.0:1746065160.091474:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873544 is committed 00000001:00080000:0.0:1746065160.091480:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873543 is committed 00000100:00100000:1.0:1746065160.091596:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ccc4a269-0136-4970-860c-c944630694a4+8:2005:x1830881263735296:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 3253us (3607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.091601:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13729 00000100:00100000:0.0:1746065160.113286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.113330:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.113374:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.113414:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263735936 00000100:00100000:0.0:1746065160.113422:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263735936 00000100:00100000:0.0:1746065160.113478:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263735808 00000100:00100000:0.0:1746065160.113480:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263735808 00000100:00100000:0.0:1746065160.113496:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 735 00000100:00100000:0.0:1746065160.113502:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:124d38bc-0f92-4827-84b7-a543154654fd+16:2005:x1830881263735936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065160.113515:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263736064 00010000:00010000:0.0:1746065160.113517:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065160.113519:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263736064 00010000:00010000:0.0:1746065160.113533:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880097b60000/0xad6b7ddc146531a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d859 expref: 17 pid: 8142 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.113541:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 736 00000100:00100000:1.0:1746065160.113546:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124d38bc-0f92-4827-84b7-a543154654fd+16:2005:x1830881263735808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065160.113550:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065160.113553:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.113561:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880097b60400/0xad6b7ddc1465313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d828 expref: 16 pid: 8144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.113571:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065160.113586:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881263735936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.113588:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881263735808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.113593:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 735 00000100:00100000:1.0:1746065160.114071:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 736 00000100:00100000:1.0:1746065160.114086:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 737 00000100:00100000:1.0:1746065160.114092:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124d38bc-0f92-4827-84b7-a543154654fd+13:2005:x1830881263736064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065160.114101:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.114110:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012f84a000/0xad6b7ddc1465321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d860 expref: 13 pid: 8144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.114117:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065160.114131:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124d38bc-0f92-4827-84b7-a543154654fd+12:2005:x1830881263736064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.114136:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 737 00000100:00100000:0.0:1746065160.115789:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.115884:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263736576 00000100:00100000:2.0:1746065160.115890:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263736576 00000100:00100000:2.0:1746065160.115927:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13731 00000100:00100000:2.0:1746065160.115933:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2003:x1830881263736576:12345-192.168.202.27@tcp:9:umount.0 00000020:00000080:2.0:1746065160.115958:0:3068:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc146533d 00000020:00010000:2.0:1746065160.115963:0:3068:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a4e4d800: total 0 00000100:00080000:2.0:1746065160.115966:0:3068:0:(import.c:66:import_set_state_nolock()) ffff8800a4e49800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065160.116558:0:3068:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873544 00000020:00010000:0.0:1746065160.116711:0:7193:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a4e4d800: total 0 00010000:00010000:0.0:1746065160.116745:0:7193:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a4e4d800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1746065160.116802:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc1470872 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934389 expref: 6 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065160.116822:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abadc00/0xad6b7ddc1470856 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934366 expref: 5 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065160.116835:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31a00/0xad6b7ddc14708e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343e4 expref: 4 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065160.116843:0:7193:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a4e4d800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746065160.116864:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065160.116866:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065160.116867:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065160.119461:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+2:2003:x1830881263736576:12345-192.168.202.27@tcp:9:umount.0 Request processed in 3519us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.119472:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13731 00000100:00100000:0.0:1746065160.131143:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.131188:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263737088 00000100:00100000:2.0:1746065160.131196:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263737088 00000100:00100000:2.0:1746065160.131277:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13732 00000100:00100000:2.0:1746065160.131286:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+8:2003:x1830881263737088:12345-192.168.202.27@tcp:9:umount.0 00000020:00000080:2.0:1746065160.131312:0:3068:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1465336 00000020:00010000:2.0:1746065160.131318:0:3068:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a4e4f800: total 0 00000100:00080000:2.0:1746065160.131321:0:3068:0:(import.c:66:import_set_state_nolock()) ffff8800a4e48800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065160.131364:0:3068:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841004 00000020:00010000:3.0:1746065160.131407:0:8351:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a4e4f800: total 0 00010000:00010000:3.0:1746065160.131411:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.131441:0:8351:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a4e4f800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746065160.131480:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc14708db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343eb expref: 7 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.131515:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489a00/0xad6b7ddc1470817 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934335 expref: 6 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.131529:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14708cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343d6 expref: 5 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.131536:0:8351:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a4e4f800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746065160.131544:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.131545:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.131547:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065160.131944:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ccc4a269-0136-4970-860c-c944630694a4+2:2003:x1830881263737088:12345-192.168.202.27@tcp:9:umount.0 Request processed in 658us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.131950:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13732 00000100:00100000:0.0:1746065160.136761:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.136987:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263737472 00000100:00100000:2.0:1746065160.136994:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263737472 00000100:00100000:2.0:1746065160.137179:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13740 00000100:00100000:2.0:1746065160.137186:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+10:2003:x1830881263737472:12345-192.168.202.27@tcp:39:umount.0 00000020:00000080:2.0:1746065160.137216:0:7204:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1465328 00000020:00010000:2.0:1746065160.137229:0:7204:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009c229000: total 0 00000100:00080000:2.0:1746065160.137232:0:7204:0:(import.c:66:import_set_state_nolock()) ffff88009c228000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065160.137391:0:7204:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589936089 00000100:00100000:2.0:1746065160.137494:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+9:2003:x1830881263737472:12345-192.168.202.27@tcp:39:umount.0 Request processed in 307us (740us total) trans 8589936090 rc 0/0 00000100:00100000:2.0:1746065160.137500:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13740 00000020:00010000:3.0:1746065160.137583:0:7194:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009c229000: total 0 00010000:00010000:3.0:1746065160.137616:0:7194:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009c229000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746065160.137643:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065160.137646:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065160.137652:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1470895 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93439e expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.137668:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065160.137670:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746065160.137673:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7000/0xad6b7ddc1468d19 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92f91b expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.137684:0:7194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065160.137686:0:7194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065160.137688:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc14653fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d91d expref: 6 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.137696:0:7194:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009c229000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746065160.137703:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.137704:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.137706:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065160.144100:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.144230:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263737600 00000100:00100000:2.0:1746065160.144239:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263737600 00000100:00100000:2.0:1746065160.144299:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13741 00000100:00100000:2.0:1746065160.144307:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+5:2003:x1830881263737600:12345-192.168.202.27@tcp:39:umount.0 00000020:00000080:2.0:1746065160.144348:0:7204:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc146532f 00000100:00080000:3.0:1746065160.144356:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746065160.144356:0:7204:0:(import.c:66:import_set_state_nolock()) ffff8800a4e4b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065160.144491:0:7204:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294975980 00010000:00010000:1.0:1746065160.144680:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065160.144829:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ccc4a269-0136-4970-860c-c944630694a4+3:2003:x1830881263737600:12345-192.168.202.27@tcp:39:umount.0 Request processed in 523us (737us total) trans 4294975981 rc 0/0 00000100:00100000:2.0:1746065160.144835:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13741 00000100:00100000:0.0:1746065160.627916:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.627958:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.627985:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.628129:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263738240 00000100:00100000:3.0:1746065160.628137:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263738240 00000100:00100000:3.0:1746065160.628188:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263738496 00000100:00100000:3.0:1746065160.628191:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263738496 00000100:00100000:3.0:1746065160.628203:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263738368 00000100:00100000:3.0:1746065160.628205:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263738368 00000100:00100000:3.0:1746065160.628226:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 738 00000100:00100000:3.0:1746065160.628232:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124d38bc-0f92-4827-84b7-a543154654fd+14:2005:x1830881263738240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.628243:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.628259:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012f84b400/0xad6b7ddc1465344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d891 expref: 14 pid: 8144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.628276:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065160.628312:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124d38bc-0f92-4827-84b7-a543154654fd+13:2005:x1830881263738240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.628317:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 738 00000100:00100000:3.0:1746065160.628331:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 739 00000100:00100000:3.0:1746065160.628336:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124d38bc-0f92-4827-84b7-a543154654fd+12:2005:x1830881263738496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.628342:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065160.628429:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 740 00000100:00100000:2.0:1746065160.628435:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:124d38bc-0f92-4827-84b7-a543154654fd+12:2005:x1830881263738368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065160.628445:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065160.628453:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012f84ae00/0xad6b7ddc146534b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d8c2 expref: 12 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.628463:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065160.628479:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:124d38bc-0f92-4827-84b7-a543154654fd+11:2005:x1830881263738368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 44us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.628488:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 740 00010000:00010000:3.0:1746065160.628492:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800985b7e00/0xad6b7ddc1465352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d8c9 expref: 12 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.628500:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065160.628501:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.628514:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124d38bc-0f92-4827-84b7-a543154654fd+9:2005:x1830881263738496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 177us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.628523:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 739 00000100:00100000:2.0:1746065160.628525:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263738112 00000100:00100000:2.0:1746065160.628527:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263738112 00000100:00100000:2.0:1746065160.628545:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13733 00000100:00100000:2.0:1746065160.628550:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+8:2003:x1830881263738112:12345-192.168.202.27@tcp:9:umount.0 00000020:00000080:2.0:1746065160.628567:0:3068:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc146536e 00000020:00010000:2.0:1746065160.628572:0:3068:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880135777000: total 0 00000100:00080000:2.0:1746065160.628575:0:3068:0:(import.c:66:import_set_state_nolock()) ffff880135770800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065160.628614:0:3068:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873544 00000100:00100000:2.0:1746065160.628694:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2003:x1830881263738112:12345-192.168.202.27@tcp:9:umount.0 Request processed in 144us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.628699:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13733 00000020:00010000:3.0:1746065160.628796:0:8351:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880135777000: total 0 00010000:00010000:3.0:1746065160.628820:0:8351:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880135777000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746065160.628863:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1c00/0xad6b7ddc1468f57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92fa3a expref: 5 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.628887:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147078b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342fd expref: 4 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.628902:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1470784 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934319 expref: 3 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.628909:0:8351:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880135777000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746065160.628918:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.628920:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.628921:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065160.633529:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.633615:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263739264 00000100:00100000:2.0:1746065160.633623:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263739264 00000100:00100000:2.0:1746065160.633671:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13734 00000100:00100000:2.0:1746065160.633678:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+10:2003:x1830881263739264:12345-192.168.202.27@tcp:9:umount.0 00000020:00000080:2.0:1746065160.633704:0:3068:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1465367 00000020:00010000:2.0:1746065160.633708:0:3068:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a4e48000: total 0 00000100:00080000:2.0:1746065160.633711:0:3068:0:(import.c:66:import_set_state_nolock()) ffff8800b51c4000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1746065160.633721:0:7194:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a4e48000: total 0 00010000:00010000:3.0:1746065160.633724:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1746065160.633742:0:3068:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841004 00010000:00010000:3.0:1746065160.633753:0:7194:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a4e48000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1746065160.633820:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1468bd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2330624->2367487) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92f85e expref: 10 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.633857:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc1468793 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3940352->4009983) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92f5fd expref: 7 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.633877:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac600/0xad6b7ddc1468bd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5476352->5513215) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92f865 expref: 6 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.633886:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2003:x1830881263739264:12345-192.168.202.27@tcp:9:umount.0 Request processed in 207us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.633892:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13734 00010000:00010000:3.0:1746065160.633894:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1470776 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9342f6 expref: 5 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.633906:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1200/0xad6b7ddc1468f5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92fa41 expref: 3 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.633918:0:7194:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a4e48000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1746065160.633928:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.633929:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065160.633931:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065160.638709:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.638797:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263739520 00000100:00100000:2.0:1746065160.638803:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263739520 00000100:00100000:2.0:1746065160.638854:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13742 00000100:00100000:2.0:1746065160.638862:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+6:2003:x1830881263739520:12345-192.168.202.27@tcp:39:umount.0 00000020:00000080:2.0:1746065160.638889:0:7204:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1465359 00000020:00010000:2.0:1746065160.638894:0:7204:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800ac55f800: total 0 00000100:00080000:2.0:1746065160.638898:0:7204:0:(import.c:66:import_set_state_nolock()) ffff8800ac55f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065160.638921:0:7204:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589936090 00000020:00010000:1.0:1746065160.638955:0:7193:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800ac55f800: total 0 00010000:00010000:1.0:1746065160.638997:0:7193:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800ac55f800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1746065160.639022:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065160.639025:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746065160.639030:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fa00/0xad6b7ddc146537c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd92d8fa expref: 5 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.639074:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+4:2003:x1830881263739520:12345-192.168.202.27@tcp:39:umount.0 Request processed in 209us (368us total) trans 8589936091 rc 0/0 00000100:00100000:2.0:1746065160.639080:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13742 00010000:00010000:1.0:1746065160.639130:0:7193:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800ac55f800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1746065160.639141:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065160.639143:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065160.639145:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065160.645062:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.645141:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263739648 00000100:00100000:2.0:1746065160.645148:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263739648 00000100:00080000:3.0:1746065160.645276:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065160.645327:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13743 00000100:00100000:2.0:1746065160.645335:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+5:2003:x1830881263739648:12345-192.168.202.27@tcp:39:umount.0 00000020:00000080:2.0:1746065160.645361:0:7204:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1465360 00000100:00080000:2.0:1746065160.645367:0:7204:0:(import.c:66:import_set_state_nolock()) ffff8800a4e49000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065160.645382:0:7204:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294975981 00000100:00100000:2.0:1746065160.645488:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8adb6cf4-807a-4620-a3cb-7b9d021f2493+3:2003:x1830881263739648:12345-192.168.202.27@tcp:39:umount.0 Request processed in 154us (433us total) trans 4294975982 rc 0/0 00000100:00100000:2.0:1746065160.645494:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13743 00010000:00010000:3.0:1746065160.645557:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065160.674987:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.675458:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263739776 00000100:00100000:2.0:1746065160.675466:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263739776 00000100:00100000:2.0:1746065160.676032:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13744 00000100:00100000:2.0:1746065160.676041:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32536:x1830881263739776:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.676064:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.676078:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14708f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9343f9 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.676126:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.676137:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.676145:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.676155:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.676161:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.676166:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.676227:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.676236:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.676242:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.676267:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.676278:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 30 pid: 7204 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746065160.676287:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263419136:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065160.676377:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.681834:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263419136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065160.681870:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065160.683357:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.683435:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263740032 00000100:00100000:1.0:1746065160.683441:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263740032 00000100:00100000:1.0:1746065160.683489:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4980 00000100:00100000:1.0:1746065160.683496:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+31:8522:x1830881263740032:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065160.683668:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+32:8522:x1830881263740032:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 173us (318us total) trans 8589936092 rc 0/0 00000100:00100000:1.0:1746065160.683674:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4980 00000100:00100000:0.0:1746065160.686347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.686410:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263740160 00000100:00100000:1.0:1746065160.686417:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263740160 00010000:00010000:1.0:1746065160.686448:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 32 pid: 7204 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746065160.686480:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6234 00000100:00100000:1.0:1746065160.686485:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263740160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065160.686496:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.686501:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 32 pid: 7204 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746065160.686511:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 32 pid: 7204 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746065160.686528:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147083a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93436d expref: 32 pid: 7204 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746065160.686540:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065160.686544:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065160.686807:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065160.686817:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065160.686858:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065160.686907:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263740160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 420us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.686914:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6234 00010000:00010000:2.0:1746065160.687359:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687367:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065160.687413:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:2.0:1746065160.687417:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065160.687431:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687440:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687449:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687454:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687459:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687467:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687472:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065160.687475:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687481:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687488:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065160.687491:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065160.687493:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687498:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc14708f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687526:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687531:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687535:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687539:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ac800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065160.687541:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687545:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687554:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098c65300) 00010000:00010000:2.0:1746065160.687556:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065160.687558:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687562:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac800/0xad6b7ddc14708fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.687588:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14708f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.687599:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.687604:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.687606:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065160.687608:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538600, rc 0) 00000100:00100000:2.0:1746065160.687633:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+30:32536:x1830881263739776:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11594us (12654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.687639:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13744 00000100:00100000:0.0:1746065160.694383:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.694658:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263740416 00000100:00100000:2.0:1746065160.694669:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263740416 00000100:00100000:2.0:1746065160.694726:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13745 00000100:00100000:2.0:1746065160.694734:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+30:32536:x1830881263740416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.694756:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.694786:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147090c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934400 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.694876:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.694887:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.694894:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.694917:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.694926:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 31 pid: 7203 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746065160.694935:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263419264:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065160.695016:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.696529:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263419264:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065160.696545:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065160.698064:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.698223:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263740544 00000100:00100000:1.0:1746065160.698229:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263740544 00010000:00010000:1.0:1746065160.698257:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 32 pid: 7203 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746065160.698287:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6235 00000100:00100000:1.0:1746065160.698294:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263740544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065160.698306:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.698311:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 32 pid: 7203 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746065160.698320:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 32 pid: 7203 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746065160.698341:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1470905 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f9 expref: 32 pid: 7203 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746065160.698352:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065160.698356:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065160.698363:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065160.698369:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065160.698389:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065160.698416:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263740544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 122us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.698421:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6235 00010000:00010000:2.0:1746065160.698637:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.698643:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065160.698658:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065160.698746:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147090c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.698759:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.698764:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.698767:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065160.698769:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538800, rc 0) 00000100:00100000:2.0:1746065160.698814:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+31:32536:x1830881263740416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4080us (4443us total) trans 8589936093 rc 0/0 00000100:00100000:2.0:1746065160.698819:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13745 00000100:00100000:0.0:1746065160.702638:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.702810:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263740672 00000100:00100000:2.0:1746065160.702818:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263740672 00000100:00100000:2.0:1746065160.702870:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13746 00000100:00100000:2.0:1746065160.702877:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+31:32536:x1830881263740672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.702897:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.702915:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc1470921 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934407 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.702985:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.702998:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.703003:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.703028:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.703039:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 32 pid: 7203 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746065160.703054:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263419392:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065160.704235:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929b3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065160.708209:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881263419392:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065160.708232:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065160.709742:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.709922:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263740800 00000100:00100000:3.0:1746065160.709929:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263740800 00010000:00010000:3.0:1746065160.709957:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 33 pid: 7203 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746065160.711046:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6236 00000100:00100000:3.0:1746065160.711055:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263740800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.711067:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.711073:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 33 pid: 7203 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746065160.711084:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 33 pid: 7203 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746065160.711102:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1470913 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934400 expref: 33 pid: 7203 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746065160.711131:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065160.711135:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065160.711143:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065160.711150:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065160.711175:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065160.711187:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.711193:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065160.711226:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881263740800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 172us (1487us total) trans 0 rc 0/0 00000004:00200000:2.0:1746065160.711229:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000100:00100000:3.0:1746065160.711232:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6236 00000004:00200000:2.0:1746065160.711232:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065160.711242:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.711263:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc1470921 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934407 expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.711278:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934407 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.711282:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.711283:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065160.711285:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3c00, rc 0) 00000100:00100000:2.0:1746065160.711305:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+31:32536:x1830881263740672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8429us (8675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.711309:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13746 00000100:00100000:0.0:1746065160.713106:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.713192:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263741056 00000100:00100000:2.0:1746065160.713197:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263741056 00000100:00100000:2.0:1746065160.713235:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4981 00000100:00100000:2.0:1746065160.713241:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+31:32536:x1830881263741056:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065160.713386:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+32:32536:x1830881263741056:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 144us (284us total) trans 8589936094 rc 0/0 00000100:00100000:2.0:1746065160.713392:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4981 00000100:00100000:0.0:1746065160.715858:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.715961:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263741312 00000100:00100000:2.0:1746065160.715966:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263741312 00000100:00100000:2.0:1746065160.716018:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13747 00000100:00100000:2.0:1746065160.716025:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+32:32536:x1830881263741312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.716043:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.716045:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065160.716066:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc146e970 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd933003 expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.716080:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.716083:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065160.716092:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147092f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93440e expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.716162:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1470936 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.716172:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1470936 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.716178:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1470936 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065160.716190:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00010000:00010000:2.0:1746065160.716255:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147092f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93440e expref: 34 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.716267:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1470936 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93440e expref: 33 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.716272:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.716274:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065160.716276:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00000100:00100000:2.0:1746065160.716323:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+33:32536:x1830881263741312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 298us (479us total) trans 8589936095 rc 0/0 00000100:00100000:2.0:1746065160.716329:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13747 00000100:00100000:0.0:1746065160.718463:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.718497:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.718522:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.718548:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.718550:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263741440 00000100:00100000:3.0:1746065160.718557:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263741440 00000100:00100000:0.0:1746065160.718561:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.718666:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263741568 00000100:00100000:1.0:1746065160.718671:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263741568 00000100:00100000:2.0:1746065160.718677:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263741696 00000100:00100000:3.0:1746065160.718678:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263741824 00000100:00100000:3.0:1746065160.718681:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263741824 00000100:00100000:2.0:1746065160.718681:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263741696 00000100:00100000:1.0:1746065160.718697:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263741952 00000100:00100000:1.0:1746065160.718699:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263741952 00000100:00100000:3.0:1746065160.718701:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13735 00000100:00100000:2.0:1746065160.718707:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13736 00000100:00100000:3.0:1746065160.718708:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263741440:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:2.0:1746065160.718717:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263741568:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065160.718741:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.718741:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.718753:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 23 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.718753:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 28 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.718759:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.718759:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.718761:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.718761:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.718763:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.718763:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.718764:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13737 00000100:00100000:1.0:1746065160.718770:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263741824:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065160.718807:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.718809:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 28 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.718812:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 23 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.718818:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.718819:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 28 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.718820:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 23 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.718827:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.718829:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065160.718830:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263419648:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065160.718830:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263419520:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065160.718831:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.718858:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.718866:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 23 pid: 12258 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746065160.718874:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263419776:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065160.718899:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13738 00000100:00100000:0.0:1746065160.718905:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263741696:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065160.718919:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.718928:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.718933:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.718934:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.718936:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.718952:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.718958:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 28 pid: 12260 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746065160.718964:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263419904:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065160.719089:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13739 00000100:00100000:3.0:1746065160.719094:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263741952:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:1.0:1746065160.719096:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1aa80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065160.719110:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.719111:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929b3300 going to sleep for 11 seconds 00010000:00010000:3.0:1746065160.719120:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.719132:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.719133:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.719135:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.719150:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.719157:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 23 pid: 12258 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.719164:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263420032:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065160.719178:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.719185:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065160.719203:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131535e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.719275:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065160.719541:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263742080 00000100:00100000:1.0:1746065160.719545:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263742080 00000100:00100000:1.0:1746065160.719571:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13740 00000100:00100000:1.0:1746065160.719576:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263742080:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065160.719590:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.719600:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.719605:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.719606:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.719608:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.719621:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.719629:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 29 pid: 9548 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746065160.719636:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263420160:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065160.719664:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.723726:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263420160:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065160.723746:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.723852:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.723872:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263742336 00000100:00100000:0.0:1746065160.723877:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263742336 00010000:00010000:0.0:1746065160.723904:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 30 pid: 12260 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746065160.723924:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6237 00000100:00100000:0.0:1746065160.723929:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881263742336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065160.723930:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263420032:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065160.723940:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.723945:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.723955:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 30 pid: 12260 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746065160.723963:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 30 pid: 12260 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746065160.723964:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263419648:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065160.723973:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.723981:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.723982:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.723986:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.723992:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724061:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc14708b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343ba expref: 30 pid: 12260 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746065160.724088:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263419904:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065160.724100:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.724119:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263419776:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065160.724127:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.724212:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065160.724245:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881263742336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 315us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.724251:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6237 00000100:00100000:2.0:1746065160.724611:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263419520:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065160.724630:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724676:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724684:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724701:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724707:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724713:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724718:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065160.724721:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724727:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724736:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.724740:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc1470959 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.724809:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263741696:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 5903us (6285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.724816:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13738 00000100:00100000:0.0:1746065160.726028:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.726059:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.726080:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.726109:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263742464 00000100:00100000:3.0:1746065160.726115:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263742464 00000100:00100000:0.0:1746065160.726125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.726138:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263742208 00000100:00100000:1.0:1746065160.726141:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263742208 00010000:00010000:3.0:1746065160.726144:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 24 pid: 12258 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746065160.726153:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 25 pid: 3067 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.726164:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263742592 00000100:00100000:3.0:1746065160.726166:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263742592 00000100:00100000:1.0:1746065160.726168:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263742720 00000100:00100000:1.0:1746065160.726170:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263742720 00010000:00010000:3.0:1746065160.726175:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 29 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.726178:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 29 pid: 9548 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.726185:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6238 00000100:00100000:3.0:1746065160.726191:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263742464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065160.726191:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6239 00000100:00100000:1.0:1746065160.726196:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6240 00000100:00100000:2.0:1746065160.726197:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263742208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.726201:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065160.726201:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263742592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065160.726203:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.726207:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.726212:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 25 pid: 12258 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746065160.726212:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 25 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.726213:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 29 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.726220:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 25 pid: 12258 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746065160.726221:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 25 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.726221:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 29 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746065160.726233:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc147081e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93433c expref: 25 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.726233:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488800/0xad6b7ddc1470825 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934343 expref: 29 pid: 3067 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.726234:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30000/0xad6b7ddc14708d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343dd expref: 25 pid: 12258 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746065160.726243:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.726244:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.726246:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.726247:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.726247:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.726247:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.726248:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.726249:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.726251:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726254:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726256:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.726256:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726269:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065160.726269:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065160.726270:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065160.726291:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263742592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.726307:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6240 00000100:00100000:1.0:1746065160.726318:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6241 00000100:00100000:1.0:1746065160.726323:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263742720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065160.726328:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.726335:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 27 pid: 9548 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.726342:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 27 pid: 9548 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.726352:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc147084f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93435f expref: 27 pid: 9548 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.726359:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.726361:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.726363:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726368:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726384:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065160.726391:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263742208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 194us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.726395:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263742464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 204us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.726396:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6239 00000100:00100000:1.0:1746065160.726396:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263742720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.726401:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6238 00000100:00100000:1.0:1746065160.726404:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6241 00010000:00010000:1.0:1746065160.726417:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726420:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726423:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726426:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726434:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726436:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726440:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726441:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726446:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726446:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726451:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065160.726451:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065160.726454:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726454:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726459:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726468:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726474:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470952 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.726497:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.726503:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.726507:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263741824:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 7738us (7958us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.726513:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13737 00010000:00010000:0.0:1746065160.726518:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.726524:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726526:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.726530:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726532:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.726534:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065160.726537:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726541:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.726541:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726546:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.726550:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726551:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.726555:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470967 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726556:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065160.726558:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726563:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726569:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.726575:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc147094b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.726584:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263742080:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 7008us (7405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.726589:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13740 00000100:00100000:1.0:1746065160.726594:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263741568:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 7883us (8097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.726598:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13736 00010000:00010000:3.0:1746065160.726666:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726675:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.726685:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5e00/0xad6b7ddc1470944 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.726714:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881263741440:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 8007us (8256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.726720:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13735 00000100:00100000:0.0:1746065160.727231:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.727811:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263742848 00000100:00100000:3.0:1746065160.727815:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263742848 00010000:00010000:3.0:1746065160.727829:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 20 pid: 12258 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.727881:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6242 00000100:00100000:3.0:1746065160.727886:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881263742848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.727892:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.727900:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 20 pid: 12258 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.727908:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 20 pid: 12258 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.727919:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30c00/0xad6b7ddc14708e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9343f2 expref: 20 pid: 12258 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.727926:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.727927:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.727930:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.727935:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.727956:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065160.727981:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+19:2006:x1830881263742848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.727986:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6242 00010000:00010000:2.0:1746065160.728069:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.728106:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.728120:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.728127:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.728132:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.728142:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065160.728144:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.728150:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.728159:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.728164:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4400/0xad6b7ddc1470960 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.728440:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+18:2004:x1830881263741952:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 9344us (9876us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.728446:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13739 00000100:00100000:0.0:1746065160.729701:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.729792:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263743104 00000100:00100000:1.0:1746065160.729797:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263743104 00000100:00100000:1.0:1746065160.729839:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13748 00000100:00100000:1.0:1746065160.729857:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+33:32536:x1830881263743104:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065160.729895:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746065160.729911:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147088e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934397 expref: 33 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.729928:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1470928 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934407 expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.729936:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065160.729939:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065160.729958:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.729967:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.729974:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000040:00080000:1.0:1746065160.730288:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].622, 88 off62800 00000004:00080000:1.0:1746065160.730296:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756748521563ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730328:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].557, 88 off57072 00000004:00080000:1.0:1746065160.730333:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756748559481ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065160.730406:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].558, 88 off57160 00000004:00080000:1.0:1746065160.730410:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756748636656ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065160.730421:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].623, 88 off62888 00000004:00080000:1.0:1746065160.730424:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756748650183ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730432:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].624, 88 off62976 00000004:00080000:1.0:1746065160.730434:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756748660899ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730552:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].559, 88 off57248 00000004:00080000:1.0:1746065160.730557:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756748783194ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065160.730865:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].561, 88 off57432 00000004:00080000:1.0:1746065160.730869:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756749095887ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065160.730884:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].562, 88 off57520 00000004:00080000:1.0:1746065160.730887:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756749113524ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065160.730897:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].625, 88 off63064 00000004:00080000:1.0:1746065160.730899:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756749125817ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730908:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].563, 88 off57608 00000004:00080000:1.0:1746065160.730910:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756749136647ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065160.730917:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].626, 88 off63152 00000004:00080000:1.0:1746065160.730919:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756749145666ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730926:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].564, 88 off57696 00000004:00080000:1.0:1746065160.730928:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756749154286ns, next at 615601404258ns, rc = 0 00000040:00080000:1.0:1746065160.730934:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].627, 88 off63240 00000004:00080000:1.0:1746065160.730936:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756749162924ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730944:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].628, 88 off63328 00000004:00080000:1.0:1746065160.730946:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756749172312ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730952:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].629, 88 off63416 00000004:00080000:1.0:1746065160.730954:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756749180812ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730961:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].630, 88 off63504 00000004:00080000:1.0:1746065160.730963:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756749189201ns, next at 615601378837ns, rc = 0 00000040:00080000:1.0:1746065160.730969:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].565, 88 off57784 00000004:00080000:1.0:1746065160.730971:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756749197734ns, next at 615601404258ns, rc = 0 00000001:00080000:0.0:1746065160.732811:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936096 is committed 00000004:00080000:0.0:1746065160.732818:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 558 committed 00000004:00080000:0.0:1746065160.733035:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 622 committed 00000004:00080000:0.0:1746065160.733075:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 621 committed 00000004:00080000:0.0:1746065160.733077:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 620 committed 00000004:00080000:0.0:1746065160.733078:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 619 committed 00000004:00080000:0.0:1746065160.733079:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 557 committed 00000004:00080000:0.0:1746065160.733081:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 618 committed 00000004:00080000:0.0:1746065160.733082:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 556 committed 00000004:00080000:0.0:1746065160.733083:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 617 committed 00000004:00080000:0.0:1746065160.733084:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 555 committed 00000004:00080000:0.0:1746065160.733085:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 554 committed 00000004:00080000:0.0:1746065160.733086:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 553 committed 00000004:00080000:0.0:1746065160.733088:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 616 committed 00000004:00080000:0.0:1746065160.733089:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 615 committed 00000004:00080000:0.0:1746065160.733090:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 552 committed 00000004:00080000:0.0:1746065160.733091:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 551 committed 00000004:00080000:0.0:1746065160.733092:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 614 committed 00000001:00100000:0.0:1746065160.733102:0:8138:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8adb6cf4-807a-4620-a3cb-7b9d021f2493 00000001:00080000:0.0:1746065160.733105:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936091 is committed 00000020:00000080:0.0:1746065160.733107:0:8138:0:(genops.c:904:class_export_put()) final put ffff8800ac55f800/8adb6cf4-807a-4620-a3cb-7b9d021f2493 00000001:00100000:0.0:1746065160.733116:0:8138:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ccc4a269-0136-4970-860c-c944630694a4 00000001:00080000:0.0:1746065160.733118:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936090 is committed 00000020:00000080:0.0:1746065160.733122:0:8138:0:(genops.c:904:class_export_put()) final put ffff88009c229000/ccc4a269-0136-4970-860c-c944630694a4 00000020:00000080:2.0:1746065160.733217:0:300:0:(genops.c:863:class_export_destroy()) destroying export ffff8800ac55f800/8adb6cf4-807a-4620-a3cb-7b9d021f2493 for lustre-MDT0000 00000100:00100000:3.0:1746065160.733220:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263420288:0@lo:2:osp-syn-1-0.0 00000020:00000080:2.0:1746065160.733264:0:300:0:(genops.c:863:class_export_destroy()) destroying export ffff88009c229000/ccc4a269-0136-4970-860c-c944630694a4 for lustre-MDT0000 00000100:00100000:3.0:1746065160.733267:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1746065160.733285:0:300:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800ac55f000 for lustre-MDT0000 00000020:00000080:2.0:1746065160.733289:0:300:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009c228000 for lustre-MDT0000 00000100:00100000:3.0:1746065160.733299:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263420800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065160.733303:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420288 00000100:00100000:2.0:1746065160.733308:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420288 00000100:00100000:3.0:1746065160.733312:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.733323:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263421440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065160.733333:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420800 00000100:00100000:3.0:1746065160.733335:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065160.733335:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420800 00000100:00100000:3.0:1746065160.733343:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263421952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065160.733344:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421440 00000100:00100000:2.0:1746065160.733345:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421440 00000100:00100000:3.0:1746065160.733356:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065160.733356:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13741 00000100:00100000:2.0:1746065160.733362:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3762:x1830881263420288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.733368:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1746065160.733372:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263420672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.733384:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.733393:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263421312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.733404:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.733412:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263421824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.733422:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.733436:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263420416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.733449:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.733458:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263420928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.733468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065160.733473:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3762:x1830881263420288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (206us total) trans 17179873545 rc 0/0 00000100:00100000:3.0:1746065160.733474:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263421568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065160.733479:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13741 00000100:00100000:3.0:1746065160.733484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.733491:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263422080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065160.733491:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421952 00000100:00100000:2.0:1746065160.733493:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421952 00000100:00100000:2.0:1746065160.733499:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420672 00000100:00100000:3.0:1746065160.733500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065160.733501:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420672 00000100:00100000:2.0:1746065160.733507:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421312 00000100:00100000:3.0:1746065160.733508:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [1->0] 00000100:00100000:2.0:1746065160.733508:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421312 00000100:00100000:3.0:1746065160.733511:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263420544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065160.733513:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421824 00000100:00100000:2.0:1746065160.733515:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421824 00000100:00100000:2.0:1746065160.733519:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420416 00000100:00100000:2.0:1746065160.733521:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420416 00000100:00100000:3.0:1746065160.733523:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065160.733526:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420928 00000100:00100000:2.0:1746065160.733527:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420928 00000100:00100000:3.0:1746065160.733529:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263421056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065160.733532:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421568 00000100:00100000:2.0:1746065160.733533:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421568 00000100:00100000:2.0:1746065160.733538:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422080 00000100:00100000:3.0:1746065160.733539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065160.733539:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422080 00000100:00100000:3.0:1746065160.733545:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263421184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065160.733545:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420544 00000100:00100000:2.0:1746065160.733546:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420544 00000100:00100000:2.0:1746065160.733551:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421056 00000100:00100000:2.0:1746065160.733553:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421056 00000100:00100000:3.0:1746065160.733555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065160.733559:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421184 00000100:00100000:3.0:1746065160.733560:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263421696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065160.733560:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421184 00000100:00100000:2.0:1746065160.733566:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13742 00000100:00100000:3.0:1746065160.733570:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065160.733570:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881263420800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.733576:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263422208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.733586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.733598:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421696 00000100:00100000:3.0:1746065160.733601:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421696 00000100:00100000:3.0:1746065160.733611:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422208 00000100:00100000:3.0:1746065160.733613:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422208 00000100:00100000:2.0:1746065160.733618:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263420800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (304us total) trans 17179873546 rc 0/0 00000100:00100000:3.0:1746065160.733620:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13743 00000100:00100000:3.0:1746065160.733623:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263421440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065160.733623:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13742 00000100:00100000:2.0:1746065160.733631:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13744 00000100:00100000:2.0:1746065160.733634:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263421952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.733672:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263421440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (336us total) trans 17179873547 rc 0/0 00000100:00100000:2.0:1746065160.733672:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263421952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (315us total) trans 17179873548 rc 0/0 00000100:00100000:2.0:1746065160.733677:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13744 00000100:00100000:3.0:1746065160.733679:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13743 00000100:00100000:2.0:1746065160.733685:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13745 00000100:00100000:2.0:1746065160.733689:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263420672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.733690:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13746 00000100:00100000:3.0:1746065160.733693:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263421312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.733730:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13747 00000100:00100000:3.0:1746065160.733733:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263421824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065160.733747:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263420672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (362us total) trans 21474841005 rc 0/0 00000100:00100000:2.0:1746065160.733752:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13745 00000100:00100000:2.0:1746065160.733760:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13748 00000100:00100000:2.0:1746065160.733764:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263420416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.733869:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13749 00000100:00100000:0.0:1746065160.733875:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263420928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.733933:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3759:x1830881263420928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (463us total) trans 21474841008 rc 0/0 00000100:00100000:0.0:1746065160.733941:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13749 00000100:00100000:1.0:1746065160.733946:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13750 00000100:00100000:0.0:1746065160.733949:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13751 00000100:00100000:1.0:1746065160.733952:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263421568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.733952:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263422080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065160.733987:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13752 00000100:00100000:1.0:1746065160.733991:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263420544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065160.733997:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3759:x1830881263422080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (496us total) trans 21474841009 rc 0/0 00000100:00100000:0.0:1746065160.734001:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13751 00000100:00100000:0.0:1746065160.734010:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13753 00000100:00100000:0.0:1746065160.734013:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263421056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065160.734045:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263420544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (520us total) trans 17179873549 rc 0/0 00000100:00100000:1.0:1746065160.734050:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13752 00000100:00100000:0.0:1746065160.734050:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263421056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (511us total) trans 17179873550 rc 0/0 00000100:00100000:0.0:1746065160.734054:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13753 00000100:00100000:1.0:1746065160.734059:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13754 00000100:00100000:0.0:1746065160.734061:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13755 00000100:00100000:1.0:1746065160.734062:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3759:x1830881263421184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.734064:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263421696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065160.734106:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263421696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (534us total) trans 17179873551 rc 0/0 00000100:00100000:1.0:1746065160.734108:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3759:x1830881263421184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (553us total) trans 21474841011 rc 0/0 00000100:00100000:0.0:1746065160.734111:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13755 00000100:00100000:1.0:1746065160.734113:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13754 00000100:00100000:0.0:1746065160.734119:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13756 00000100:00100000:0.0:1746065160.734123:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3759:x1830881263422208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065160.734167:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263422208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (579us total) trans 17179873552 rc 0/0 00000100:00100000:0.0:1746065160.734171:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13756 00000004:00010000:1.0:1746065160.734179:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f1a4000 reply state ffff88009aaa6c00 transno 8589936096 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.734193:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.734203:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065160.734206:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065160.734209:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746065160.734269:0:7204:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065160.734281:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:32536:x1830881263743104:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 4434us (4581us total) trans 8589936096 rc 0/0 00000100:00100000:1.0:1746065160.734287:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13748 00010000:00010000:1.0:1746065160.734305:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.734310:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.734315:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.734320:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065160.734323:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.734328:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.734336:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065160.734338:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065160.734340:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.734344:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147096e lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065160.734862:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3759:x1830881263420416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1097us (1411us total) trans 21474841012 rc 0/0 00000100:00100000:2.0:1746065160.734868:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13748 00000100:00100000:3.0:1746065160.734887:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3762:x1830881263421824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1152us (1462us total) trans 21474841007 rc 0/0 00000100:00100000:3.0:1746065160.734891:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13747 00000100:00100000:2.0:1746065160.734898:0:3762:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841002 gen 2 00000004:00080000:2.0:1746065160.734901:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f52a00, transno 21474840984 00000004:00080000:2.0:1746065160.734907:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f50700, transno 21474840985 00000004:00080000:2.0:1746065160.734909:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f51500, transno 21474840986 00000004:00080000:2.0:1746065160.734912:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f50e00, transno 21474840987 00000004:00080000:2.0:1746065160.734914:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f52d80, transno 21474840988 00000004:00080000:2.0:1746065160.734916:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f53480, transno 21474840989 00000004:00080000:2.0:1746065160.734918:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f50a80, transno 21474840990 00000004:00080000:2.0:1746065160.734920:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097f51880, transno 21474840991 00000004:00080000:2.0:1746065160.734922:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6d80, transno 21474840992 00000004:00080000:2.0:1746065160.734924:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bed80, transno 21474840994 00000004:00080000:2.0:1746065160.734927:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bca80, transno 21474840995 00000004:00080000:2.0:1746065160.734929:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bea00, transno 21474840996 00000100:00100000:3.0:1746065160.734931:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263421312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1237us (1526us total) trans 21474841006 rc 0/0 00000004:00080000:2.0:1746065160.734931:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bdf80, transno 21474840997 00000004:00080000:2.0:1746065160.734933:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bd880, transno 21474840998 00000100:00100000:3.0:1746065160.734935:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13746 00000004:00080000:2.0:1746065160.734935:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bce00, transno 21474840999 00000004:00080000:2.0:1746065160.734938:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907be680, transno 21474841000 00000004:00080000:2.0:1746065160.734940:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907be300, transno 21474841001 00000004:00080000:2.0:1746065160.734942:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3100, transno 21474841002 00000100:00100000:2.0:1746065160.734947:0:3762:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880134b02a00 x1830881263420672/t21474841005(21474841005) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065176 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:3.0:1746065160.734953:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873543 gen 2 00000004:00080000:3.0:1746065160.734955:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf800, transno 17179873536 00000004:00080000:2.0:1746065160.734956:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b02a00/2, rc 0, transno 21474841005 00000004:00080000:3.0:1746065160.734959:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf480, transno 17179873537 00000100:00100000:2.0:1746065160.734960:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263420672:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065160.734961:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa3800, transno 17179873538 00000004:00080000:3.0:1746065160.734963:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa1500, transno 17179873539 00000004:00080000:3.0:1746065160.734965:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa2d80, transno 17179873540 00000004:00080000:3.0:1746065160.734967:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edae300, transno 17179873541 00000004:00080000:2.0:1746065160.734967:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b03b80/2, rc 0, transno 21474841006 00000004:00080000:3.0:1746065160.734969:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa1f80, transno 17179873542 00000100:00100000:2.0:1746065160.734970:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263421312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065160.734971:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa0a80, transno 17179873543 00000100:00100000:3.0:1746065160.734975:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012f09e680 x1830881263420544/t17179873549(17179873549) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065176 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746065160.734975:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b01500/2, rc 0, transno 21474841007 00000100:00100000:2.0:1746065160.734978:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263421824:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065160.734981:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09e680/2, rc 0, transno 17179873549 00000100:00100000:3.0:1746065160.734983:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263420544:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065160.734984:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09ce00/2, rc 0, transno 17179873545 00000100:00100000:2.0:1746065160.734986:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263420288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065160.734989:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09ed80/2, rc 0, transno 17179873550 00000100:00100000:3.0:1746065160.734992:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263421056:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065160.734992:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09c380/2, rc 0, transno 17179873546 00000100:00100000:2.0:1746065160.734994:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263420800:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065160.734998:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b03100/2, rc 0, transno 21474841011 00000004:00080000:2.0:1746065160.735000:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edace00/2, rc 0, transno 17179873547 00000100:00100000:3.0:1746065160.735001:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263421184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065160.735003:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263421440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065160.735006:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edac000/2, rc 0, transno 17179873551 00000100:00100000:3.0:1746065160.735008:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263421696:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065160.735008:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaf100/2, rc 0, transno 17179873548 00000100:00100000:2.0:1746065160.735010:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263421952:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065160.735013:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edac380/2, rc 0, transno 17179873552 00000100:00100000:3.0:1746065160.735015:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263422208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065160.735020:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b01c00/2, rc 0, transno 21474841012 00000100:00100000:3.0:1746065160.735023:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263420416:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065160.735028:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b00e00/2, rc 0, transno 21474841008 00000100:00100000:3.0:1746065160.735030:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263420928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065160.735036:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b01f80/2, rc 0, transno 21474841009 00000100:00100000:3.0:1746065160.735038:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263422080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065160.735176:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263421568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1224us (1690us total) trans 21474841010 rc 0/0 00000100:00100000:1.0:1746065160.735181:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13750 00000004:00080000:0.0:1746065160.735686:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 1 in flight, 18 done 00000100:00100000:0.0:1746065160.735719:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263422336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.735745:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065160.735793:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422336 00000100:00100000:1.0:1746065160.735798:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422336 00000100:00100000:1.0:1746065160.735816:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13757 00000100:00100000:1.0:1746065160.735820:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263422336:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065160.735925:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b00380/2, rc 0, transno 21474841010 00000100:00100000:3.0:1746065160.735929:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263421568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065160.735930:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263422336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (184us total) trans 21474841013 rc 0/0 00000100:00100000:1.0:1746065160.735935:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13757 00000004:00080000:2.0:1746065160.736029:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 8 done 00000004:00080000:0.0:1746065160.736072:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a5c00/2, rc 0, transno 21474841013 00000100:00100000:0.0:1746065160.736076:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263422336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.736553:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.736608:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263743232 00000100:00100000:1.0:1746065160.736611:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263743232 00000100:00100000:1.0:1746065160.736645:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13749 00000100:00100000:1.0:1746065160.736650:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+27:32536:x1830881263743232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065160.736664:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.736676:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934415 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.736753:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 28 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.736763:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 28 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.736883:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065160.736886:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065160.736888:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1600, rc 0) 00000100:00100000:1.0:1746065160.736957:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:32536:x1830881263743232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 305us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.736962:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13749 00000100:00100000:0.0:1746065160.742706:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.742801:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263743360 00000100:00100000:1.0:1746065160.742917:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263743360 00000100:00100000:1.0:1746065160.742965:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13750 00000100:00100000:1.0:1746065160.742972:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:32536:x1830881263743360:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065160.742987:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.743004:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147097c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93441c expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.743070:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470983 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.743081:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.743090:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065160.743114:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x2e:0x0]: returning size 9215520 00000004:00200000:1.0:1746065160.743117:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065160.743128:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065160.743146:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147097c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93441c expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.743171:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470983 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93441c expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.743178:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065160.743180:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065160.743183:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:1.0:1746065160.743217:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+29:32536:x1830881263743360:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 245us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.743225:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13750 00000100:00100000:0.0:1746065160.746379:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.747570:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.748664:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.749033:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263743488 00000100:00100000:1.0:1746065160.749041:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263743488 00000100:00100000:1.0:1746065160.749087:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263743744 00000100:00100000:1.0:1746065160.749089:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263743744 00000100:00100000:1.0:1746065160.749105:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13758 00000100:00100000:1.0:1746065160.749112:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+18:2005:x1830881263743488:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065160.749123:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13759 00010000:00010000:1.0:1746065160.749127:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065160.749131:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263743744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065160.749138:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.749144:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934423 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.749148:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934431 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065160.749162:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8a:0x0] initial LVB size: 1048576, mtime: 0x6812d706, atime: 0x6812d706, ctime: 0x6812d706, blocks: 0x7f8 00002000:00010000:3.0:1746065160.749163:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 2097152, mtime: 0x6812d707, atime: 0x6812d707, ctime: 0x6812d707, blocks: 0x800 00010000:00010000:3.0:1746065160.749176:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.749176:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.749178:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.749178:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.749184:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.749184:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.749197:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065160.749197:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.749205:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ada00, rc 0) 00010000:00010000:1.0:1746065160.749206:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0600, rc 0) 00000100:00100000:1.0:1746065160.749240:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+19:2005:x1830881263743488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 129us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.749241:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263743744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 111us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.749246:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13758 00000100:00100000:3.0:1746065160.749249:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13759 00000100:00100000:3.0:1746065160.749322:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263744000 00000100:00100000:3.0:1746065160.749325:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263744000 00000100:00100000:3.0:1746065160.749341:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13760 00000100:00100000:3.0:1746065160.749345:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+19:2005:x1830881263744000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065160.749350:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.749357:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93443f expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065160.749367:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8d:0x0] initial LVB size: 5021216, mtime: 0x6812d707, atime: 0x6812d705, ctime: 0x6812d707, blocks: 0x1650 00010000:00010000:3.0:1746065160.749374:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.749375:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.749379:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 20 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.749388:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 20 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.749399:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:3.0:1746065160.749413:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881263744000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 68us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.749418:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13760 00000100:00100000:0.0:1746065160.749429:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.749444:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263743616 00000100:00100000:3.0:1746065160.749446:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263743616 00000100:00100000:0.0:1746065160.749451:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.749456:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263743872 00000100:00100000:3.0:1746065160.749458:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263743872 00000100:00100000:3.0:1746065160.749467:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13761 00000100:00100000:3.0:1746065160.749472:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263743616:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065160.749477:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.749484:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93442a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065160.749494:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 2097152, mtime: 0x6812d705, atime: 0x6812d705, ctime: 0x6812d705, blocks: 0x808 00010000:00010000:3.0:1746065160.749500:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.749501:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.749505:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 26 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.749513:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 26 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.749519:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac400, rc 0) 00000100:00100000:0.0:1746065160.749528:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.749536:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263743616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 64us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.749543:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13761 00000100:00100000:3.0:1746065160.749550:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263744128 00000100:00100000:3.0:1746065160.749552:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263744128 00000100:00100000:3.0:1746065160.749563:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13762 00000100:00100000:3.0:1746065160.749566:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881263743872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065160.749571:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.749578:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934438 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065160.749586:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8c:0x0] initial LVB size: 2097152, mtime: 0x6812d707, atime: 0x6812d703, ctime: 0x6812d707, blocks: 0x808 00010000:00010000:3.0:1746065160.749592:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.749593:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.749596:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.749604:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065160.749610:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13763 00010000:00010000:3.0:1746065160.749611:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9dc00, rc 0) 00000100:00100000:2.0:1746065160.749618:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263744128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.749626:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.749634:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934446 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.749639:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263743872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.749644:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13762 00002000:00010000:2.0:1746065160.749645:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x70:0x0] initial LVB size: 4194304, mtime: 0x6812d705, atime: 0x6812d705, ctime: 0x6812d705, blocks: 0x1000 00010000:00010000:2.0:1746065160.749653:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.749654:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.749658:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 27 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.749667:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 27 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.749674:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45600, rc 0) 00000100:00100000:2.0:1746065160.749690:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263744128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.749750:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13763 00000100:00100000:0.0:1746065160.752729:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.752767:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.752831:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.752857:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.752878:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.752900:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.752913:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263744256 00000100:00100000:2.0:1746065160.752919:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263744256 00000100:00100000:2.0:1746065160.752948:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263744512 00000100:00100000:2.0:1746065160.752950:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263744512 00000100:00100000:2.0:1746065160.752965:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263744768 00000100:00100000:2.0:1746065160.752967:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263744768 00000100:00100000:1.0:1746065160.752971:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263744384 00000100:00100000:2.0:1746065160.752975:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263744640 00000100:00100000:1.0:1746065160.752975:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263744384 00000100:00100000:2.0:1746065160.752977:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263744640 00000100:00100000:2.0:1746065160.752984:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263744896 00000100:00100000:2.0:1746065160.752986:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263744896 00000100:00100000:2.0:1746065160.752996:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13764 00000100:00100000:2.0:1746065160.753002:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263744256:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065160.753007:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13765 00000100:00100000:1.0:1746065160.753013:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263744512:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065160.753042:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13766 00000100:00100000:3.0:1746065160.753049:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263744768:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065160.753082:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263744512:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 69us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.753083:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263744256:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 81us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.753084:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263744768:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 37us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.753088:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13764 00000100:00100000:1.0:1746065160.753091:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13765 00000100:00100000:3.0:1746065160.753098:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13766 00000100:00100000:2.0:1746065160.753101:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13767 00000100:00100000:2.0:1746065160.753106:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263744640:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065160.753106:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13768 00000100:00100000:3.0:1746065160.753108:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13769 00000100:00100000:1.0:1746065160.753110:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263744384:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065160.753112:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263744896:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065160.753130:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881263744640:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.753135:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13767 00000100:00100000:3.0:1746065160.753136:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263744896:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 23us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.753136:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263744384:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.753140:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13768 00000100:00100000:3.0:1746065160.753142:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13769 00000100:00100000:0.0:1746065160.755439:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.755744:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.755829:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.755859:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263745152 00000100:00100000:0.0:1746065160.755865:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263745152 00000100:00100000:0.0:1746065160.755900:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263745408 00000100:00100000:0.0:1746065160.755902:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263745408 00000100:00100000:0.0:1746065160.756197:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263745664 00000100:00100000:0.0:1746065160.756200:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263745664 00000100:00100000:3.0:1746065160.756203:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13770 00000100:00100000:3.0:1746065160.756212:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263745152:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065160.756217:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13771 00000100:00100000:0.0:1746065160.756222:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263745408:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065160.756288:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881263745152:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 77us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.756294:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13770 00000100:00100000:3.0:1746065160.756308:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13772 00000100:00100000:3.0:1746065160.756312:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263745664:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065160.756399:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263745664:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 83us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065160.756402:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263745408:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 179us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.756404:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13772 00000100:00100000:0.0:1746065160.756408:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13771 00000100:00100000:0.0:1746065160.756432:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.756566:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.756742:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.756792:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263745024 00000100:00100000:2.0:1746065160.756795:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263745024 00000100:00100000:3.0:1746065160.756806:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263745280 00000100:00100000:3.0:1746065160.756809:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263745280 00000100:00100000:2.0:1746065160.756814:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13773 00000100:00100000:2.0:1746065160.756819:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263745024:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065160.756839:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13774 00000100:00100000:3.0:1746065160.756853:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263745280:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065160.756869:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263745024:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 49us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.756874:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13773 00000100:00100000:3.0:1746065160.756885:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263745280:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 41us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.756890:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13774 00000100:00100000:3.0:1746065160.756993:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263745536 00000100:00100000:3.0:1746065160.756997:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263745536 00000100:00100000:3.0:1746065160.757012:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13775 00000100:00100000:3.0:1746065160.757016:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263745536:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065160.757050:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881263745536:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.757055:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13775 00000100:00100000:0.0:1746065160.762399:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.762500:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263745792 00000100:00100000:2.0:1746065160.762508:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263745792 00000100:00100000:2.0:1746065160.762560:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13776 00000100:00100000:2.0:1746065160.762867:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+27:32536:x1830881263745792:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.762884:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.762900:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc14709b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93444d expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065160.762923:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6d:0x0] initial LVB size: 2097152, mtime: 0x6812d6da, atime: 0x0, ctime: 0x6812d6da, blocks: 0xff0 00010000:00010000:2.0:1746065160.762941:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.762942:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.762949:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc14709b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93444d expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.762961:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc14709b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93444d expref: 28 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.762970:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45a00, rc 0) 00000100:00100000:2.0:1746065160.763019:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:32536:x1830881263745792:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 452us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.763025:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13776 00000100:00100000:0.0:1746065160.765688:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.765752:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263745920 00000100:00100000:2.0:1746065160.765759:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263745920 00000100:00100000:2.0:1746065160.765835:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13777 00000100:00100000:2.0:1746065160.765851:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881263745920:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:2.0:1746065160.765998:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065160.766001:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065160.766004:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065160.766006:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:2.0:1746065160.766008:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:2.0:1746065160.766054:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263745920:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 211us (372us total) trans 17179873553 rc 0/0 00000100:00100000:2.0:1746065160.766059:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13777 00000100:00100000:0.0:1746065160.768089:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.768177:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263746048 00000100:00100000:2.0:1746065160.768183:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263746048 00000100:00100000:2.0:1746065160.768223:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13778 00000100:00100000:2.0:1746065160.768231:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+21:32536:x1830881263746048:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.768246:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.768265:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14709bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934454 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065160.768281:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x8b:0x0] initial LVB size: 4194304, mtime: 0x6812d6db, atime: 0x0, ctime: 0x6812d6db, blocks: 0x1ff0 00010000:00010000:2.0:1746065160.768297:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.768299:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.768306:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14709bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934454 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.768318:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14709bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934454 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.768326:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44e00, rc 0) 00000100:00100000:2.0:1746065160.768365:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:32536:x1830881263746048:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 135us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.768370:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13778 00000100:00100000:0.0:1746065160.769352:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.769416:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263746176 00000100:00100000:2.0:1746065160.769420:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263746176 00000100:00100000:2.0:1746065160.769483:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13779 00000100:00100000:2.0:1746065160.769489:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881263746176:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:2.0:1746065160.769604:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065160.769606:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065160.769609:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065160.769611:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00002000:00010000:2.0:1746065160.769612:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:2.0:1746065160.769650:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263746176:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 160us (298us total) trans 21474841014 rc 0/0 00000100:00100000:2.0:1746065160.769655:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13779 00000100:00100000:0.0:1746065160.773530:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.773573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.773584:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263746432 00000100:00100000:2.0:1746065160.773593:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263746432 00000100:00100000:3.0:1746065160.773616:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263746688 00000100:00100000:3.0:1746065160.773621:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263746688 00000100:00100000:2.0:1746065160.773641:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 3999 00000100:00100000:2.0:1746065160.773648:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263746432:12345-192.168.202.27@tcp:3:lfs.0 00000100:00100000:3.0:1746065160.773653:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4000 00000100:00100000:3.0:1746065160.773658:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263746688:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065160.773675:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.773675:0:9554:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.773687:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.773687:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.773688:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.773689:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.773693:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.773693:0:9554:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.773703:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.773703:0:9554:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.775834:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.775874:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.775922:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263746944 00000100:00100000:1.0:1746065160.775927:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263746944 00000100:00100000:1.0:1746065160.775961:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263747200 00000100:00100000:1.0:1746065160.775962:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263747200 00000100:00100000:3.0:1746065160.775969:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4001 00000100:00100000:3.0:1746065160.775977:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263746944:12345-192.168.202.27@tcp:3:lfs.0 00000100:00100000:1.0:1746065160.775979:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4002 00000100:00100000:1.0:1746065160.775984:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263747200:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065160.776001:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.776001:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.776010:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.776010:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.776012:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.776013:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.776016:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.776016:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.776025:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.776025:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.777456:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.777539:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263747456 00000100:00100000:1.0:1746065160.777544:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263747456 00000100:00100000:1.0:1746065160.777575:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4003 00000100:00100000:1.0:1746065160.777581:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881263747456:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065160.777601:0:29488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.777609:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.777611:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.777614:0:29488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.777622:0:29488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.779888:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.779919:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.779942:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.780189:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263747712 00000100:00100000:3.0:1746065160.780197:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263747712 00000100:00100000:3.0:1746065160.780238:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263747968 00000100:00100000:3.0:1746065160.780240:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263747968 00000100:00100000:3.0:1746065160.780252:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263748224 00000100:00100000:3.0:1746065160.780254:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263748224 00000100:00100000:3.0:1746065160.780269:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4004 00000100:00100000:3.0:1746065160.780275:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881263747712:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065160.780303:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.780315:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.780316:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.780320:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.780330:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.781055:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4005 00000100:00100000:1.0:1746065160.781062:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263747968:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065160.781083:0:20324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 3/1,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.781091:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.781092:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.781095:0:20324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.781103:0:20324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.781248:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4006 00000100:00100000:0.0:1746065160.781255:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881263748224:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065160.781269:0:29489:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.781276:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.781277:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.781280:0:29489:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.781292:0:29489:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.787293:0:9554:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.787308:0:9554:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.787317:0:9554:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.787323:0:9554:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f45800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065160.787326:0:9554:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.787332:0:9554:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.787347:0:9554:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.787353:0:9554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45800/0xad6b7ddc14709c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.787588:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263746432:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 13935us (14060us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746065160.787597:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 3999 00010000:00010000:3.0:1746065160.790866:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.790880:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.790888:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.790898:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065160.790902:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.790908:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.790924:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.790928:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5e00/0xad6b7ddc14709c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.791017:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881263746688:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 17353us (17438us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.791027:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4000 00010000:00010000:3.0:1746065160.795328:0:29490:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.795342:0:29490:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.795350:0:29490:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.795355:0:29490:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065160.795359:0:29490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.795366:0:29490:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.795381:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.795386:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc14709d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.795454:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881263746944:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 19474us (19621us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.795461:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4001 00010000:00010000:1.0:1746065160.798371:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.798392:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.798400:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.798407:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065160.798411:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.798418:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.798434:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.798439:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc14709d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.798520:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881263747200:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 22529us (22640us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.798529:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4002 00010000:00010000:1.0:1746065160.803290:0:29488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.803306:0:29488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.803318:0:29488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.803324:0:29488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0a0800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065160.803333:0:29488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.803340:0:29488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.803356:0:29488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.803362:0:29488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0a0800/0xad6b7ddc14709de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.803437:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881263747456:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 25851us (25980us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.803446:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4003 00010000:00010000:3.0:1746065160.807041:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.807056:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.807064:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.807070:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa8ea00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065160.807073:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.807079:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.807101:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.807106:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aa8ea00/0xad6b7ddc14709e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.807175:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881263747712:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 26894us (27287us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065160.807185:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4004 00010000:00010000:1.0:1746065160.810818:0:20324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.810832:0:20324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.810838:0:20324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.810861:0:20324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab6e400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065160.810865:0:20324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.810871:0:20324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.810886:0:20324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.810891:0:20324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab6e400/0xad6b7ddc14709ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.810958:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881263747968:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 29892us (31033us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065160.810966:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4005 00010000:00010000:2.0:1746065160.813803:0:29489:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.813816:0:29489:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.813823:0:29489:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.813831:0:29489:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065160.813834:0:29489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.813840:0:29489:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.813864:0:29489:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.813869:0:29489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2400/0xad6b7ddc14709f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.813930:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263748224:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 32671us (33983us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065160.813939:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4006 00000100:00100000:0.0:1746065160.818475:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.818593:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263748480 00000100:00100000:2.0:1746065160.818600:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263748480 00000100:00100000:2.0:1746065160.818650:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13751 00000100:00100000:2.0:1746065160.818657:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:32536:x1830881263748480:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065160.818699:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065160.818720:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1470983 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93441c expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.818736:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.818740:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065160.818794:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.818805:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.818812:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00010000:2.0:1746065160.818901:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c5f0a80 reply state ffff88009a99c000 transno 8589936097 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.818909:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.818914:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.818917:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065160.818919:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065160.818986:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+30:32536:x1830881263748480:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 328us (518us total) trans 8589936097 rc 0/0 00000100:00100000:2.0:1746065160.818992:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13751 00000100:00100000:0.0:1746065160.820568:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.820703:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263748608 00000100:00100000:2.0:1746065160.820708:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263748608 00000100:00100000:2.0:1746065160.820926:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13780 00000100:00100000:2.0:1746065160.820934:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+23:32536:x1830881263748608:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.820946:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.820958:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc1470a01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93445b expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.820979:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.820991:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.820993:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.820995:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc1470a01 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93445b expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.821018:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.821029:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 24 pid: 9548 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746065160.821040:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263422464:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065160.821465:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.823368:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.823454:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263422464:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065160.823474:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc1470a01 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93445b expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.823488:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b400, rc 0) 00000100:00100000:2.0:1746065160.823518:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:32536:x1830881263748608:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2585us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.823525:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13780 00000100:00100000:1.0:1746065160.823591:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263748736 00000100:00100000:1.0:1746065160.823596:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263748736 00010000:00010000:1.0:1746065160.823618:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 24 pid: 9548 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746065160.823649:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6243 00000100:00100000:1.0:1746065160.823658:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263748736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065160.823668:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.823685:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 24 pid: 9548 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.823698:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 24 pid: 9548 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.823715:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0600/0xad6b7ddc147098a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934423 expref: 24 pid: 9548 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.823725:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.823726:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.823731:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc1470a01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93445b expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.823737:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc1470a01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93445b expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.823763:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b400/0xad6b7ddc1470a01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93445b expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.823800:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263422592:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065160.823875:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065160.825263:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263422592:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065160.825274:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065160.825514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.825594:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263748864 00000100:00100000:3.0:1746065160.825599:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263748864 00000100:00100000:3.0:1746065160.825626:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13781 00000100:00100000:3.0:1746065160.825631:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:32536:x1830881263748864:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065160.825642:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.826086:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470a08 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934462 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.826108:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.826115:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.826117:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.826120:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470a08 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934462 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.826139:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.826150:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.826159:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263422720:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065160.826325:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263748736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2668us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.826332:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6243 00000100:00100000:3.0:1746065160.826466:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065160.828828:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263422720:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065160.828875:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470a08 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934462 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.828887:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:0.0:1746065160.828891:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.828915:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:32536:x1830881263748864:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3284us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.828921:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13781 00000100:00100000:1.0:1746065160.828998:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263748992 00000100:00100000:1.0:1746065160.829003:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263748992 00010000:00010000:1.0:1746065160.829020:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746065160.829045:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6244 00000100:00100000:1.0:1746065160.829050:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263748992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065160.829058:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065160.829072:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.829081:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.829097:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc147099f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93442a expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.829106:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.829107:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065160.829112:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470a08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934462 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.829119:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470a08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934462 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.829433:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1470a08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934462 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065160.829518:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263422848:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065160.829811:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3f1a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.832749:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.833069:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263749120 00000100:00100000:3.0:1746065160.833075:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263749120 00000100:00100000:3.0:1746065160.833118:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13782 00000100:00100000:3.0:1746065160.833125:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:32536:x1830881263749120:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065160.833139:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.833152:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1470a0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934469 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.833176:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 31 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.833187:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.833189:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.833192:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1470a0f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934469 expref: 31 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.833214:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 31 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065160.833214:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263422848:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065160.833223:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 31 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746065160.833227:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065160.833233:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263422976:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065160.833274:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263748992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4223us (4383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.833282:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6244 00000100:00100000:3.0:1746065160.834731:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.837942:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.838305:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263422976:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065160.838328:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1470a0f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934469 expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.838343:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1200, rc 0) 00000100:00100000:3.0:1746065160.838378:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:32536:x1830881263749120:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5254us (5635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.838386:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13782 00000100:00100000:0.0:1746065160.838602:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263749248 00000100:00100000:0.0:1746065160.838608:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263749248 00010000:00010000:0.0:1746065160.838628:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746065160.838655:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6245 00000100:00100000:0.0:1746065160.838661:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263749248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065160.838671:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065160.838686:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746065160.838696:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746065160.838713:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ada00/0xad6b7ddc1470991 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934431 expref: 30 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746065160.838738:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.838740:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.838745:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1470a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934469 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.838753:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1470a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934469 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.838796:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1470a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934469 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.838806:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263423104:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065160.838860:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.842000:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.842050:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263423104:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065160.842066:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065160.842104:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881263749248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3442us (4167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.842116:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6245 00000100:00100000:3.0:1746065160.842584:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263749376 00000100:00100000:3.0:1746065160.842590:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263749376 00000100:00100000:3.0:1746065160.842817:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13783 00000100:00100000:3.0:1746065160.842825:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+23:32536:x1830881263749376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065160.842838:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065160.842860:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1470a16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934470 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.842881:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 24 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.842887:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.842889:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.842892:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1470a16 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934470 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.842915:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 24 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065160.842926:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 24 pid: 9549 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.842935:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263423232:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065160.843693:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065160.845010:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263423232:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065160.845029:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1470a16 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934470 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.845043:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1e00, rc 0) 00000100:00100000:3.0:1746065160.845081:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:32536:x1830881263749376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2256us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.845088:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13783 00000100:00100000:0.0:1746065160.849113:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.849750:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263749504 00000100:00100000:2.0:1746065160.849757:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263749504 00010000:00010000:2.0:1746065160.849812:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 24 pid: 9549 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746065160.849860:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6246 00000100:00100000:2.0:1746065160.849868:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263749504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065160.849881:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065160.849898:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 24 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746065160.849908:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 24 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746065160.849926:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9dc00/0xad6b7ddc14709a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934438 expref: 24 pid: 9549 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746065160.849955:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.849957:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.849962:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1470a16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934470 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.849970:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1470a16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934470 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.849996:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1470a16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934470 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065160.850006:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263423360:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065160.850078:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.852992:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.853018:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263749632 00000100:00100000:0.0:1746065160.853024:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263749632 00000100:00100000:3.0:1746065160.853043:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263423360:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065160.853058:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065160.853063:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13784 00000100:00100000:0.0:1746065160.853070:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:32536:x1830881263749632:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065160.853084:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065160.853093:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881263749504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3226us (3988us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065160.853097:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc1470a1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934477 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.853101:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6246 00010000:00010000:0.0:1746065160.853117:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065160.853129:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.853131:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065160.853134:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc1470a1d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934477 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065160.853155:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065160.853166:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 24 pid: 12258 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746065160.853176:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263423488:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065160.853225:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131b56540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.856486:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263423488:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065160.856511:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc1470a1d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934477 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.856530:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51b800, rc 0) 00000100:00100000:2.0:1746065160.856563:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:32536:x1830881263749632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3493us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.856570:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13784 00000100:00100000:0.0:1746065160.856922:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.856974:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263749760 00000100:00100000:3.0:1746065160.856980:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263749760 00010000:00010000:3.0:1746065160.857000:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 24 pid: 12258 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.857020:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6247 00000100:00100000:3.0:1746065160.857026:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881263749760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.857036:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.857051:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 24 pid: 12258 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.857060:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 24 pid: 12258 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.857079:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1470998 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93443f expref: 24 pid: 12258 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.857104:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.857106:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.857112:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc1470a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934477 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.857120:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc1470a1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934477 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.857143:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc1470a1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934477 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.857152:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263423616:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065160.857209:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065160.858923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.859206:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263749888 00000100:00100000:2.0:1746065160.859212:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263749888 00000100:00100000:2.0:1746065160.859277:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13785 00000100:00100000:2.0:1746065160.859283:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:32536:x1830881263749888:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065160.859297:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065160.859309:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1470a24 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93447e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.859328:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 30 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.859335:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.859336:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065160.859339:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1470a24 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93447e expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.859362:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 30 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065160.859372:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 30 pid: 12260 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.859373:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263423616:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065160.859381:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263423744:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065160.859385:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065160.859413:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881263749760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2387us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.859420:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6247 00000100:00100000:2.0:1746065160.859733:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929b3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.860997:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263423744:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065160.861016:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1470a24 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93447e expref: 30 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.861027:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b200, rc 0) 00000100:00100000:2.0:1746065160.861052:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:32536:x1830881263749888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1768us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065160.861058:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13785 00000100:00100000:0.0:1746065160.861361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.861711:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263750016 00000100:00100000:3.0:1746065160.861800:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263750016 00010000:00010000:3.0:1746065160.861824:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 30 pid: 12260 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746065160.861974:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6248 00000100:00100000:3.0:1746065160.861982:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881263750016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.861992:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.862007:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 30 pid: 12260 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.862020:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 30 pid: 12260 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.862036:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45600/0xad6b7ddc14709ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934446 expref: 30 pid: 12260 timeout: 856 lvb_type: 1 00010000:00010000:3.0:1746065160.862047:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.862049:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065160.862054:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1470a24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93447e expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.862061:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1470a24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93447e expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065160.862198:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1470a24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93447e expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065160.862208:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263423872:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065160.862557:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b488bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065160.864155:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263423872:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065160.864168:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065160.864198:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881263750016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2216us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.864209:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6248 00000100:00100000:0.0:1746065160.864389:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.864435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.864461:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263750144 00000100:00100000:0.0:1746065160.864461:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.864466:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263750144 00000100:00100000:0.0:1746065160.864474:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.864491:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263750400 00000100:00100000:3.0:1746065160.864493:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263750400 00000100:00100000:0.0:1746065160.864496:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.864607:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263750656 00000100:00100000:3.0:1746065160.864609:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263750272 00000100:00100000:0.0:1746065160.864610:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263750656 00000100:00100000:3.0:1746065160.864612:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263750272 00000100:00100000:3.0:1746065160.864626:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263750528 00000100:00100000:3.0:1746065160.864628:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263750528 00000100:00100000:0.0:1746065160.864635:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13786 00000100:00100000:0.0:1746065160.864640:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263750144:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:3.0:1746065160.864655:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13787 00000100:00100000:3.0:1746065160.864660:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263750400:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065160.864745:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065160.864745:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065160.864748:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00002000:00010000:0.0:1746065160.864748:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065158 -> 1746065159 00002000:00010000:0.0:1746065160.864749:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065158 -> 1746065159 00002000:00010000:3.0:1746065160.864750:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065159 -> 1746065159 00002000:00010000:0.0:1746065160.864750:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065158 -> 1746065161 00002000:00010000:0.0:1746065160.864751:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00002000:00010000:3.0:1746065160.864752:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065159 -> 1746065161 00002000:00010000:3.0:1746065160.864753:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065160.864770:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263750144:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 130us (382us total) trans 21474841015 rc 0/0 00000100:00100000:3.0:1746065160.864791:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263750400:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 111us (336us total) trans 17179873554 rc 0/0 00000100:00100000:0.0:1746065160.864791:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13786 00000100:00100000:3.0:1746065160.864798:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13787 00000100:00100000:0.0:1746065160.864800:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13788 00000100:00100000:0.0:1746065160.864804:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263750272:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:3.0:1746065160.864809:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13789 00000100:00100000:3.0:1746065160.864813:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881263750656:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065160.864834:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065160.864835:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065157 -> 1746065159 00002000:00010000:0.0:1746065160.864836:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065157 -> 1746065159 00002000:00010000:0.0:1746065160.864838:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065157 -> 1746065161 00002000:00010000:0.0:1746065160.864839:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746065160.864869:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00000100:00100000:0.0:1746065160.864870:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263750272:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 64us (394us total) trans 17179873555 rc 0/0 00002000:00010000:3.0:1746065160.864872:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00002000:00010000:3.0:1746065160.864873:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065157 -> 1746065159 00002000:00010000:3.0:1746065160.864875:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065159 -> 1746065161 00000100:00100000:0.0:1746065160.864875:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13788 00002000:00010000:3.0:1746065160.864876:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00000100:00100000:0.0:1746065160.864884:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13790 00000100:00100000:0.0:1746065160.864889:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263750528:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:3.0:1746065160.864894:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263750656:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 81us (433us total) trans 21474841016 rc 0/0 00000100:00100000:3.0:1746065160.864899:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13789 00002000:00010000:0.0:1746065160.864926:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065160.864929:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00002000:00010000:0.0:1746065160.864930:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065155 -> 1746065159 00002000:00010000:0.0:1746065160.864932:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065159 -> 1746065161 00002000:00010000:0.0:1746065160.864934:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065160.864949:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881263750528:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 60us (453us total) trans 21474841017 rc 0/0 00000100:00100000:0.0:1746065160.864955:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13790 00000100:00100000:0.0:1746065160.865135:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.865261:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263750784 00000100:00100000:2.0:1746065160.865265:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263750784 00000100:00100000:2.0:1746065160.865295:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13791 00000100:00100000:2.0:1746065160.865299:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263750784:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065160.865341:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065160.865343:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065157 -> 1746065159 00002000:00010000:2.0:1746065160.865344:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065157 -> 1746065159 00002000:00010000:2.0:1746065160.865346:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065157 -> 1746065161 00002000:00010000:2.0:1746065160.865348:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746065160.865372:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881263750784:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 72us (237us total) trans 17179873556 rc 0/0 00000100:00100000:2.0:1746065160.865378:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13791 00000100:00100000:0.0:1746065160.867516:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065160.867567:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263751040 00000100:00100000:2.0:1746065160.867573:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263751040 00000100:00100000:2.0:1746065160.867613:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4982 00000100:00100000:2.0:1746065160.867620:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b209050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+30:32536:x1830881263751040:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:2.0:1746065160.867833:0:16721:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1470936 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93440e expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.867886:0:16721:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065160.867898:0:16721:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.867904:0:16721:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065160.867930:0:16721:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065160.867940:0:16721:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 30 pid: 7204 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746065160.867951:0:16721:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16721:1830881263424000:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065160.868031:0:16721:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929b3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065160.870689:0:16721:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16721:1830881263424000:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065160.870711:0:16721:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00000100:00100000:0.0:1746065160.871044:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065160.871399:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263751168 00000100:00100000:3.0:1746065160.871405:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263751168 00010000:00010000:3.0:1746065160.871434:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 31 pid: 7204 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746065160.871455:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6249 00000100:00100000:3.0:1746065160.871462:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881263751168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065160.871472:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065160.871477:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 31 pid: 7204 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746065160.871486:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 31 pid: 7204 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746065160.871505:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc1470975 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934415 expref: 31 pid: 7204 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746065160.872169:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065160.872175:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.872183:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.872189:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.872469:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065160.872517:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881263751168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1053us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065160.872528:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6249 00010000:00010000:2.0:1746065160.872661:0:16721:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00010000:00010000:2.0:1746065160.872668:0:16721:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00000040:00080000:2.0:1746065160.872923:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].631, 88 off63592 00000004:00080000:2.0:1746065160.872928:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891153819ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.872945:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].566, 88 off57872 00000004:00080000:2.0:1746065160.872948:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756891174684ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065160.872960:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].567, 88 off57960 00000004:00080000:2.0:1746065160.872962:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756891188981ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065160.872970:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].632, 88 off63680 00000004:00080000:2.0:1746065160.872972:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891198546ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.872979:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].633, 88 off63768 00000004:00080000:2.0:1746065160.872981:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891207643ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.872987:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].568, 88 off58048 00000004:00080000:2.0:1746065160.872990:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756891216456ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065160.872997:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].569, 88 off58136 00000004:00080000:2.0:1746065160.872999:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756891225769ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065160.873006:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].570, 88 off58224 00000004:00080000:2.0:1746065160.873009:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756891235379ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065160.873015:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].634, 88 off63856 00000004:00080000:2.0:1746065160.873017:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891243866ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.873024:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].571, 88 off58312 00000004:00080000:2.0:1746065160.873026:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756891252211ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065160.873033:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].635, 88 off63944 00000004:00080000:2.0:1746065160.873036:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891262103ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.873042:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].572, 88 off58400 00000004:00080000:2.0:1746065160.873045:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756891271281ns, next at 615601404258ns, rc = 0 00000040:00080000:2.0:1746065160.873051:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].636, 88 off64032 00000004:00080000:2.0:1746065160.873053:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891279871ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.873060:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].637, 88 off64120 00000004:00080000:2.0:1746065160.873062:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891288485ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.873068:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].638, 88 off64208 00000004:00080000:2.0:1746065160.873070:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891296544ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.873076:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].639, 88 off64296 00000004:00080000:2.0:1746065160.873079:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756891305196ns, next at 615601378837ns, rc = 0 00000040:00080000:2.0:1746065160.873085:0:16721:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].573, 88 off58488 00000004:00080000:2.0:1746065160.873087:0:16721:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756891313136ns, next at 615601404258ns, rc = 0 00000001:00080000:0.0:1746065160.874583:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936098 is committed 00000004:00080000:0.0:1746065160.874591:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 566 committed 00000004:00080000:0.0:1746065160.874603:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 631 committed 00000100:00100000:3.0:1746065160.874714:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263424128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.874764:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065160.875069:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.875078:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065160.875082:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263424640:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746065160.875084:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.875089:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065160.875092:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065160.875098:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065160.875099:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746065160.875113:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.875115:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065160.875117:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:2.0:1746065160.875119:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065160.875122:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263424512:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746065160.875123:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc14709fa lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065160.875137:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.875145:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263425024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065160.875145:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424128 00000100:00100000:2.0:1746065160.875150:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424128 00000100:00100000:3.0:1746065160.875156:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.875174:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263424256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.875191:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065160.875204:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 630 committed 00000004:00080000:0.0:1746065160.875210:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 629 committed 00000004:00080000:0.0:1746065160.875212:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 628 committed 00000004:00080000:0.0:1746065160.875214:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 565 committed 00000004:00080000:0.0:1746065160.875215:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 627 committed 00000004:00080000:0.0:1746065160.875216:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 564 committed 00000004:00080000:0.0:1746065160.875218:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 626 committed 00000004:00080000:0.0:1746065160.875219:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 563 committed 00000004:00080000:0.0:1746065160.875220:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 562 committed 00000004:00080000:0.0:1746065160.875222:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 561 committed 00000004:00080000:0.0:1746065160.875224:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 625 committed 00000004:00080000:0.0:1746065160.875225:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 624 committed 00000004:00080000:0.0:1746065160.875227:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 560 committed 00000004:00080000:0.0:1746065160.875228:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 559 committed 00000004:00080000:0.0:1746065160.875232:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 623 committed 00000100:00100000:1.0:1746065160.875347:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263425152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065160.875373:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065160.875390:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263424384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065160.875411:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263425536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.875591:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263424768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.875613:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424640 00000100:00100000:3.0:1746065160.875616:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424640 00000100:00100000:1.0:1746065160.875627:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263425664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.875631:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424512 00000100:00100000:3.0:1746065160.875633:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424512 00000100:00100000:3.0:1746065160.875642:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425024 00000100:00100000:1.0:1746065160.875642:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.875643:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425024 00000100:00100000:3.0:1746065160.875651:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424256 00000100:00100000:3.0:1746065160.875653:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424256 00000100:00100000:3.0:1746065160.875660:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425152 00000100:00100000:3.0:1746065160.875662:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425152 00000100:00100000:1.0:1746065160.875663:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425664 00000100:00100000:1.0:1746065160.875666:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425664 00000100:00100000:3.0:1746065160.875674:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13792 00000100:00100000:3.0:1746065160.875679:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263424128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065160.875681:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13793 00000100:00100000:1.0:1746065160.875685:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263424640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.875758:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13794 00000100:00100000:3.0:1746065160.875763:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3762:x1830881263424512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065160.875808:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3762:x1830881263424640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (706us total) trans 17179873557 rc 0/0 00000100:00100000:1.0:1746065160.875813:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13793 00002000:00010000:3.0:1746065160.875824:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746065160.875825:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13795 00002000:00010000:3.0:1746065160.875826:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065160.875828:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746065160.875829:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3762:x1830881263425024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065160.875830:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1746065114 -> 1746065114 00002000:00010000:3.0:1746065160.875831:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 4080 -> 4080 00000100:00100000:3.0:1746065160.875864:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3762:x1830881263424512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (725us total) trans 17179873559 rc 0/0 00000100:00100000:3.0:1746065160.875869:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13794 00000100:00100000:3.0:1746065160.875879:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13796 00000100:00100000:3.0:1746065160.875884:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f86ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263424256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065160.875893:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3762:x1830881263425024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (735us total) trans 17179873560 rc 0/0 00000100:00100000:1.0:1746065160.875898:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13795 00000100:00100000:1.0:1746065160.875908:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13797 00000100:00100000:1.0:1746065160.875912:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3762:x1830881263425152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065160.875919:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065160.875921:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00002000:00010000:3.0:1746065160.875923:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1746065159 -> 1746065159 00002000:00010000:3.0:1746065160.875925:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1746065161 -> 1746065161 00002000:00010000:3.0:1746065160.875927:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065160.875944:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f86ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263424256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (753us total) trans 17179873561 rc 0/0 00000100:00100000:3.0:1746065160.875949:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13796 00000100:00100000:3.0:1746065160.875957:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13798 00000100:00100000:3.0:1746065160.875961:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3762:x1830881263425664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065160.875962:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065160.875965:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00002000:00010000:1.0:1746065160.875967:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb atime from disk: 1746065159 -> 1746065159 00002000:00010000:1.0:1746065160.875969:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb ctime from disk: 1746065161 -> 1746065161 00002000:00010000:1.0:1746065160.875971:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8a:0x0] updating lvb blocks from disk: 2040 -> 2040 00000100:00100000:1.0:1746065160.875988:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263425152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (614us total) trans 21474841018 rc 0/0 00000100:00100000:1.0:1746065160.875993:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13797 00000100:00100000:3.0:1746065160.876002:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3762:x1830881263425664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (360us total) trans 21474841019 rc 0/0 00000100:00100000:3.0:1746065160.876007:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13798 00002000:00010000:1.0:1746065160.876018:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065160.876020:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00002000:00010000:1.0:1746065160.876022:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1746065159 -> 1746065159 00000100:00100000:3.0:1746065160.876023:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065160.876023:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1746065161 -> 1746065161 00002000:00010000:1.0:1746065160.876024:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065160.876037:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263425280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065160.876040:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3762:x1830881263424128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 361us (1276us total) trans 17179873558 rc 0/0 00000100:00100000:1.0:1746065160.876044:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13792 00000100:00100000:3.0:1746065160.876050:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.876059:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263425792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.876068:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065160.876087:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bc380/2, rc 0, transno 17179873561 00000100:00100000:3.0:1746065160.876090:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263424256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.876095:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065160.876098:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263425408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.876108:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.876113:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263425920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.876121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065160.876130:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424768 00000100:00100000:3.0:1746065160.876132:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424768 00000100:00100000:3.0:1746065160.876140:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425792 00000100:00100000:1.0:1746065160.876140:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425280 00000100:00100000:3.0:1746065160.876141:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425792 00000100:00100000:1.0:1746065160.876142:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425280 00000100:00100000:3.0:1746065160.876145:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425408 00000100:00100000:3.0:1746065160.876147:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425408 00000100:00100000:1.0:1746065160.876153:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425920 00000100:00100000:1.0:1746065160.876154:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425920 00000100:00100000:3.0:1746065160.876155:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13799 00000100:00100000:3.0:1746065160.876158:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3759:x1830881263424768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065160.876162:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13800 00000100:00100000:1.0:1746065160.876166:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263425792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065160.876200:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263424768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (176us total) trans 17179873562 rc 0/0 00000100:00100000:3.0:1746065160.876205:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13799 00000100:00100000:3.0:1746065160.876212:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13801 00000100:00100000:3.0:1746065160.876215:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263425280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065160.876220:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263425792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (149us total) trans 21474841020 rc 0/0 00000100:00100000:1.0:1746065160.876225:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13800 00000100:00100000:1.0:1746065160.876234:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13802 00000100:00100000:1.0:1746065160.876238:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263425408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065160.876242:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065160.876244:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00002000:00010000:3.0:1746065160.876246:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb atime from disk: 1746065159 -> 1746065159 00002000:00010000:3.0:1746065160.876248:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb ctime from disk: 1746065161 -> 1746065161 00002000:00010000:3.0:1746065160.876250:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8c:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065160.876262:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263425280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (211us total) trans 21474841021 rc 0/0 00000100:00100000:3.0:1746065160.876266:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13801 00000100:00100000:3.0:1746065160.876273:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13803 00000100:00100000:3.0:1746065160.876276:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263425920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065160.876276:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb size from disk: 5021216 -> 5021216 00002000:00010000:1.0:1746065160.876279:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00002000:00010000:1.0:1746065160.876280:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb atime from disk: 1746065159 -> 1746065159 00002000:00010000:1.0:1746065160.876282:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb ctime from disk: 1746065161 -> 1746065161 00002000:00010000:1.0:1746065160.876284:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8d:0x0] updating lvb blocks from disk: 5712 -> 5712 00002000:00010000:3.0:1746065160.876300:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746065160.876301:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263425408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (192us total) trans 21474841022 rc 0/0 00002000:00010000:3.0:1746065160.876302:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb mtime from disk: 1746065115 -> 1746065115 00002000:00010000:3.0:1746065160.876304:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065160.876305:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb ctime from disk: 1746065115 -> 1746065115 00000100:00100000:1.0:1746065160.876305:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13802 00002000:00010000:3.0:1746065160.876307:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x8b:0x0] updating lvb blocks from disk: 8176 -> 8176 00000100:00100000:3.0:1746065160.876319:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263425920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (196us total) trans 21474841023 rc 0/0 00000100:00100000:3.0:1746065160.876323:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13803 00000004:00080000:1.0:1746065160.876324:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834c000/2, rc 0, transno 21474841018 00000100:00100000:1.0:1746065160.876330:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263425152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065160.876336:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834dc00/2, rc 0, transno 21474841019 00000100:00100000:1.0:1746065160.876338:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263425664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065160.876339:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834f800/2, rc 0, transno 21474841022 00000100:00100000:3.0:1746065160.876342:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263425408:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065160.876344:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bf100/2, rc 0, transno 17179873559 00000100:00100000:1.0:1746065160.876347:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263424512:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065160.876348:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a6a00/2, rc 0, transno 21474841023 00000100:00100000:3.0:1746065160.876350:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263425920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065160.876352:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bca80/2, rc 0, transno 17179873560 00000100:00100000:1.0:1746065160.876354:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263425024:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065160.876355:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834ea00/2, rc 0, transno 21474841021 00000100:00100000:3.0:1746065160.876357:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263425280:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065160.876359:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bd180/2, rc 0, transno 17179873558 00000004:00080000:3.0:1746065160.876362:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a5500/2, rc 0, transno 21474841020 00000100:00100000:1.0:1746065160.876362:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263424128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065160.876365:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263425792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065160.876366:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bf800/2, rc 0, transno 17179873557 00000100:00100000:1.0:1746065160.876369:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263424640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065160.876370:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bf480/2, rc 0, transno 17179873562 00000100:00100000:3.0:1746065160.876373:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263424768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065160.876394:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263426176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065160.876410:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065160.876443:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426176 00000100:00100000:1.0:1746065160.876446:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426176 00000100:00100000:1.0:1746065160.876459:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13804 00000100:00100000:1.0:1746065160.876463:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263426176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065160.876513:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263426176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (102us total) trans 21474841024 rc 0/0 00000100:00100000:1.0:1746065160.876517:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13804 00000004:00080000:1.0:1746065160.876534:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6a00/2, rc 0, transno 21474841024 00000100:00100000:1.0:1746065160.876537:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263426176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.876601:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065160.876617:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263426048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.876633:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065160.876648:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065160.876658:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263424896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065160.876671:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065160.876686:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425536 00000100:00100000:0.0:1746065160.876689:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425536 00000100:00100000:0.0:1746065160.876700:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426048 00000100:00100000:0.0:1746065160.876702:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426048 00000100:00100000:0.0:1746065160.876707:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424384 00000100:00100000:0.0:1746065160.876709:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424384 00000100:00100000:0.0:1746065160.876714:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424896 00000100:00100000:0.0:1746065160.876716:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424896 00000100:00100000:0.0:1746065160.876723:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13805 00000100:00100000:0.0:1746065160.876727:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263425536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.876802:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263425536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (200us total) trans 21474841025 rc 0/0 00000100:00100000:0.0:1746065160.876807:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13805 00000100:00100000:0.0:1746065160.876818:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13806 00000100:00100000:0.0:1746065160.876821:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3761:x1830881263426048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065160.876884:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263426048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (250us total) trans 21474841026 rc 0/0 00000100:00100000:0.0:1746065160.876888:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13806 00000100:00100000:2.0:1746065160.876898:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13807 00000100:00100000:2.0:1746065160.876906:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263424384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065160.876951:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13808 00002000:00010000:2.0:1746065160.876953:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065160.876956:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb mtime from disk: 1746065159 -> 1746065159 00000100:00100000:0.0:1746065160.876957:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263424896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065160.876958:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb atime from disk: 1746065159 -> 1746065159 00002000:00010000:2.0:1746065160.876959:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb ctime from disk: 1746065161 -> 1746065161 00002000:00010000:2.0:1746065160.876961:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x70:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746065160.876989:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881263424384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (339us total) trans 17179873563 rc 0/0 00000100:00100000:2.0:1746065160.876995:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13807 00000100:00100000:0.0:1746065160.877013:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263424896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (340us total) trans 17179873564 rc 0/0 00000100:00100000:0.0:1746065160.877017:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13808 00000004:00010000:2.0:1746065160.877036:0:16721:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b209050 reply state ffff88009df67400 transno 8589936098 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 00000004:00080000:0.0:1746065160.877037:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834f480/2, rc 0, transno 21474841025 00000100:00100000:0.0:1746065160.877041:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263425536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065160.877047:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a7480/2, rc 0, transno 21474841026 00010000:00010000:2.0:1746065160.877048:0:16721:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 00000100:00100000:0.0:1746065160.877049:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263426048:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065160.877054:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:2.0:1746065160.877057:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065160.877059:0:16721:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1746065160.877062:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bfb80/2, rc 0, transno 17179873563 00010000:00010000:2.0:1746065160.877064:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00000100:00100000:0.0:1746065160.877064:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263424384:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746065160.877065:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:0.0:1746065160.877069:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bed80/2, rc 0, transno 17179873564 00010000:00010000:2.0:1746065160.877071:0:16721:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1470936 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93440e expref: 27 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065160.877071:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263424896:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746065160.877130:0:16721:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065160.877157:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b209050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+27:32536:x1830881263751040:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 9537us (9659us total) trans 8589936098 rc 0/0 00000100:00100000:2.0:1746065160.877164:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4982 00010000:00010000:3.0:1746065160.877392:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.877400:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.877405:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.877409:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065160.877412:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.877417:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.877425:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:3.0:1746065160.877427:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065160.877429:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 00010000:00010000:3.0:1746065160.877433:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc1470a2b lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 00000100:00100000:0.0:1746065160.879148:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065160.879201:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263751296 00000100:00100000:1.0:1746065160.879207:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263751296 00000100:00100000:1.0:1746065160.879294:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 13752 00000100:00100000:1.0:1746065160.879302:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+26:32536:x1830881263751296:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065160.879319:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065160.879332:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc1470a32 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd934485 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.879371:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc1470a32 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934485 expref: 27 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.879381:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9800/0xad6b7ddc1470a32 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934485 expref: 27 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065160.879392:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x2e:0x0].0x0 (ffff88006dc83600) 00010000:00010000:1.0:1746065160.879395:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065160.879397:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a9800, rc 0) 00000100:00100000:1.0:1746065160.879426:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+27:32536:x1830881263751296:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 125us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065160.879432:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 13752 00000100:00100000:2.0:1746065160.883698:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065160.883741:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263751552 00000100:00100000:0.0:1746065160.883748:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263751552 00000100:00100000:0.0:1746065160.883824:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 4983 00000100:00100000:0.0:1746065160.883832:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+27:32536:x1830881263751552:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065160.884081:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+28:32536:x1830881263751552:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 249us (389us total) trans 8589936099 rc 0/0 00000100:00100000:0.0:1746065160.884087:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 4983 00010000:00010000:3.0:1746065160.935142:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1746065161.601668:0:13450:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed 00010000:00010000:1.0:1746065161.938383:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69668 lines, 69668 kept, 0 dropped, 0 bad.